media Hugging Face Forums · 1h ago · open_models

Cymela finds latent states in continuous reasoning contain question info but are unusable by decoder

from English

Researchers at Cymela investigating continuous latent-space reasoning with the Monarch Chrysalis v1 model observed a specific failure mode where the model's internal representations do not effectively aid generation. While causal tests confirmed that the latent vectors are clearly question-specific and vary substantially between prompts, transplanting these states between problems showed that answer quality barely changes.

The downstream decoder appears insensitive to the task-specific information present in the latent channel.
The team identified architectural and training issues since the initial checkpoint and is running a revised architecture.
A public checkpoint for the hyper-3b-latent model was released alongside the findings.

The authors are not claiming the mechanism works yet and are holding further claims until current runs determine if the architectural changes resolve the issue.

Importance 1/3 Trust 1/3 Hugging Face Forums Research paper Training methods

Read original

media Hugging Face Forums · 4d ago · 2 views

Experiments suggest neural networks are classical stateful dynamical systems

A researcher conducted causal experiments on nanoGPT, ResNet-18, and a diffusion U-Net to investigate the mechanics of training, learning, and inference. The results indicate that these processes form a continuous cycle where updates cause nonlinear responses and persistent functional reorganization, which then influence subsequent states.

arxiv arXiv cs.AI · 6d ago · 3 views

PLVR uses symbolic backpropagation to learn verifiable reasoning programs

Researchers introduce PLVR (Program Learning with Verifiable Rewards), a post-training method that learns explicit reasoning programs composed of deterministic and neural primitives rather than updating model weights. The approach utilizes symbolic backpropagation, where credit assignment is performed via type inference over primitive signatures instead of estimation.

arxiv arXiv cs.CL · 9d ago · 9 views

STAR metric and StarPO framework improve document-to-document machine translation alignment

Researchers introduce Sentence Translation Alignment Rate (STAR), an auxiliary metric designed to quantify sentence-level structural fidelity in document-to-document machine translation, addressing issues like omissions and hallucinations. They propose STAR-masked Preference Optimization (StarPO), a framework that ranks hypotheses by structural quality and uses a dynamic alignment mask to focus optimization on misaligned segments.

arxiv arXiv cs.AI · 17d ago · 17 views

Harness Continual Learning adapts agent state outside frozen model parameters

The authors introduce Harness Continual Learning (HCL), a paradigm where an agent improves by evolving its execution-facing harness rather than updating model parameters. This approach addresses the challenge of retaining previously acquired behavior while adapting to new experiences through components like prompts, memories, and routing rules.

media r/LocalLLaMA · 18d ago · 13 views

Z.ai scales GLM-5.3 post-training to improve long-horizon reasoning

Z.ai released GLM-5.3, a controlled experiment demonstrating that scaling post-training yields significant gains in long-horizon reasoning without changing the base model or parameter count.