A real workload analysis shows headroom, rtk, and caveman reduce token costs by 2.8%, 0.5%, and 0.4% respectively, totaling 3.7% of baseline spending. However, savings are limited by payload diversity, with most traffic being plain text or source code, and the tools only compress structured outputs. Most cost reduction occurs on the cheapest token stream—cache reads—while the tools do not affect prompt caching or output costs, and coverage gaps exist, especially for rtk.
Real-world token cost savings from rtk, headroom, and caveman
llama.cpp b11000 fixes remote code execution via cached compute graph use-after-free
The llama.cpp project released version b11000, which addresses a critical security vulnerability in the RPC server. The fix resolves a use-after-free bug that allowed unauthenticated remote clients to achieve remote code execution by manipulating cached compute graphs.
OpenAI scales Habitat storage service to 70M requests per second
OpenAI has scaled its internal online storage platform, Habitat, to handle over 70 million requests per second for more than one billion weekly ChatGPT users across nearly 40 geographic regions. The system now serves more than 500 petabytes of data, evolving from a simple Python client-side library into a complex distributed service.
CyberTiel 35B-A3B uncensored 4-bit quant beats Opus 4.6 medium on codebase issues
An anonymous researcher has released CyberTiel 35B-A3B, an uncensored 4-bit quantized model designed for offensive security research and agentic software engineering. The model is built by abliteration on the TielCoder base and quantizing with an improved imatrix derived from a curated cybersecurity corpus.
qwen4exp adds recurrent state rollback support for MTP speculative decoding
The qwen4exp project has implemented recurrent state rollback support to enable effective Multi-Token Prediction (MTP) speculative decoding. This change allows the target state to move back by the number of rejected draft tokens, preventing unnecessary serialization of the entire recurrent state to host memory.
Prompt injection researcher breaks Claude Code Opus 5 Auto Mode
Anthropic recently made Claude Code's auto mode the default to protect users against prompt injection attacks, but researcher Johann Rehberger has demonstrated a significant vulnerability in this safety mechanism. He identified an attack that succeeds approximately 80% of the time by tricking the agent into downloading and uncompressing a zip archive containing a malicious Python file.