vLLM has introduced a new streaming parser for Qwen3+ available in its nightly build, addressing issues like mid-turn stopping and failed streaming tool calls due to chunk boundaries. The update reportedly resolves these problems in limited testing, improving reliability for agentic workflows.
media
r/LocalLLaMA
·
55d ago
·
open_models
vLLM releases new streaming parser for Qwen3+ in nightly
from English
Related articles
arxiv
arXiv cs.AI
·
47d ago
·
1 view
CORTIS: Text-Only Adaptation of Spoken Language Models
CORTIS enables task-oriented voice agents to generate structured speech outputs by fine-tuning spoken language models using only text-form task supervision. It outperforms ASR-LLM cascades under acoustic degradation, especially in preserving high-level task semantics, without requiring paired speech-target annotations during training.
media
r/LocalLLaMA
·
36d ago
Qwen3.6-27b-mtp-q8 creates A* pathfinding implementation via autonomous testing
The Qwen3.6-27b-mtp-q8 model successfully generated an A* pathfinding implementation for a Java-based test game using Claude Code locally. The process involved nearly 12 hours of iterative development where the model autonomously created and ran a testing suite.
media
r/LocalLLaMA
·
38d ago
·
6 views
Local benchmarks with a RTX 3090 - Qwen3.6 27b vs Ornith
A user compared Qwen3.6 27b, Gemma4 26B A4B QAT, and Ornith1.0 35B MoE using the inspect-ai framework on an RTX 3090 to evaluate local model performance. The testing revealed mixed results across general knowledge, grounding, and coding benchmarks, with Qwen3.6 generally leading in scores while Ornith showed strengths in specific areas like DROP.
media
r/LocalLLaMA
·
40d ago
Qwen3.6-27B with 3-Critic Harness Matches Frontier Quality
A user tested Qwen3.6-27B (8-bit) alongside GLM5.2 using a coding harness that employs three critics—code review, test review, and Playwright e2e—to validate output quality.
media
r/LocalLLaMA
·
41d ago
·
2 views
GLM 5.2 Q1_S vs Qwen 27B Q8: A Local LLM Comparison
An amateur comparison on consumer hardware demonstrates that the heavily quantized GLM-5.2 (Q1_S) outperforms the higher-bit Qwen 3.6 27B (Q8) in a complex coding task, despite significantly slower inference speeds.