A user reported that removing the GGML_CUDA_ALLREDUCE environment variable led to a noticeable improvement in throughput (TPS) for MTP in local LLM inference. The change, which was previously considered beneficial, unexpectedly reduced overhead and improved performance, especially after extensive configuration trials.
Finally seeing benefits of MTP after removing GGML_CUDA_ALLREDUCE
OpenAI Python SDK v0.21.0 adds provider-neutral testing APIs and OpenAI v3 compatibility
OpenAI released version 0.21.0 of the openai-agents-python SDK, introducing new provider-neutral testing utilities and updating compatibility for the OpenAI Python library version 3.
llama.cpp b10435 fixes quadratic cost in jinja gather_string_parts
The llama.cpp project has released version b10435, which addresses a performance issue within the Jinja template engine. The primary change fixes a quadratic time complexity bug in the `gather_string_parts` function.
Claude Code v2.1.233 adds GitLab MR support, memory limits, and disables todo tools on new models
Anthropic released Claude Code v2.1.233, introducing several new features and fixes including GitLab merge request URL support for the `--worktree` flag and `claude agents` view. The update also adds opt-in memory cgroup support for Bash tool commands on Linux to prevent runaway builds from stalling sessions.
xAI releases Grok 4.6 coding model in GitHub Copilot
xAI has made its latest coding model, Grok 4.6, available within GitHub Copilot for developers using VS Code and other platforms. Users can select the new model via the model picker, while enterprise customers may need to enable it through Copilot settings.
Z.ai releases GLM-5.3 with extended post-training
Z.ai announced GLM-5.3, a new model that achieves frontier performance on agentic coding benchmarks by extending the post-training of its GLM-5.2 base model. The ~750B parameter model currently surpasses Kimi K3 and matches or exceeds Claude Fable 5 and GPT-5.6-Sol on various benchmarks.