media r/LocalLLaMA · just now · open_models

CyberTiel 35B-A3B uncensored 4-bit quant beats Opus 4.6 medium on codebase issues

from English

An anonymous researcher has released CyberTiel 35B-A3B, an uncensored 4-bit quantized model designed for offensive security research and agentic software engineering. The model is built by abliteration on the TielCoder base and quantizing with an improved imatrix derived from a curated cybersecurity corpus.

CyberTiel 35B-A3B beats Opus 4.6 medium cleanly on real codebase issues, completing tasks in 27% of the time Qwen3.8-27b medium takes.
The quantization preserves relevant weights in higher precision while minimizing damage from abliteration.
GGUF and MLX formats with and without MTP are available on Hugging Face.

The author argues that uncensoring resolves alignment issues by returning user control over the model's actions, positioning CyberTiel as a capable coder for real problems despite sacrificing some world knowledge.

Importance 2/3 r/LocalLLaMA Code generation Inference efficiency

Read original

github llama.cpp · 10d ago · 9 views

qwen4exp adds recurrent state rollback support for MTP speculative decoding

The qwen4exp project has implemented recurrent state rollback support to enable effective Multi-Token Prediction (MTP) speculative decoding. This change allows the target state to move back by the number of rejected draft tokens, preventing unnecessary serialization of the entire recurrent state to host memory.

media Hugging Face Forums · 39d ago · 16 views

Qxern-v6 uses latent tokens and AST sidecar for faster, accurate code transfer

The Qxern-v6 system enables two LLMs to communicate via 32 compressed latent tokens while preserving exact symbol accuracy through an adaptive deterministic Abstract Syntax Tree (AST) sidecar. Built by a 15-year-old developer, the architecture uses Qwen2.5-Coder-1.5B to compress code and a frozen Qwen3.5-0.8B decoder to interpret it without seeing raw text.

arxiv arXiv cs.CL · 57d ago · 1 view

Claude Code billing study shows context reduction does not lower costs

A study of 2,848 provider-billed Claude Code runs reveals that reducing retrieved context or tool output does not reliably lower the actual billed cost of coding agents. The research challenges the common evaluation metric of text removal by analyzing a campaign of 2,908 executions across three models and seven repositories.

media r/LocalLLaMA · 59d ago · 7 views

User runs Qwen3.6 35B A3B on 20GB VRAM + 64GB RAM for local coding

A Reddit user shares their experience running the Qwen3.6 35B A3B model locally on a laptop equipped with a 20GB 7900XT eGPU and 64GB DDR5 RAM.

media r/LocalLLaMA · 62d ago · 3 views

Qwen3.6 35B-A3B generates flight simulator in single prompt

A Reddit user demonstrated Qwen3.6 35B-A3B generating a complete, relaxing flight simulator with mountains, clouds, and endless procedural terrain from a single prompt.