Adaptive Data Scheduling (ADS) introduces a dual-level data scheduling framework that replaces uniform sampling with adaptive distribution over semantic clusters and policy-boundary sample selection. Experimental results show ADS improves average accuracy by 5.2% over GRPO across three LLMs and seven reasoning benchmarks, demonstrating its effectiveness as a general strategy for LLM RL post-training.
CURIOBOT uses Berlyne's collative variables to create curiosity-driven linguistic interventions in tutoring dialogues. Across 270 conversations, these interventions increased exploratory behaviors by up to 2.4x in conversational turns under fixed time budgets, with gains persisting despite unchanged tutor instruction quality.
ORBIT enables training-free, simultaneous control of multiple behavioral attributes by using orthogonal subspace rotation. It achieves balanced, coherent steering across attributes without retraining, outperforming existing baselines on TraitFactory and ToneBank benchmarks.
The paper proposes a design-centric taxonomy for conceptual alignment in human-robot dialogue, defining it as a bidirectional, co-constructive process. It introduces a dialogue act schema to capture interactional moves that enable alignment, offering a structured framework for analyzing and designing such interactions.
LIHA identifies a small set of first-token broadcaster heads in GPT-2 that persistently attend to the initial prompt token, causing language switches. Instruction tuning reorganizes these circuits, concentrating language identity at early layers, as shown in a controlled comparison between Qwen2.5-1.5B-Base and Qwen2-1.5B-Instruct models. First-token broadcasting is script-specific, with non-Latin languages processed at layer 0, matching the instruct-tuned model's pattern.
P4IR, a two-stage framework, uses supervised fine-tuning and Group Relative Policy Optimization to enhance large language model-based automated code compliance systems. It reduces tree edit and token-level Levenshtein distances by up to 23.8% and 38.6% respectively, outperforming leading LLMs like Claude Opus, GPT-5.2, and GLM-4.7 in zero-shot settings with few-shot prompting, and reduces false positives by a statistically significant margin.
A study finds that knowledge-graph grounding improves LLMs only when answering questions based on out-of-training facts. On public biomedical knowledge, grounding adds no benefit, but on novel or private data, it boosts accuracy from chance to near-perfect levels, confirming that LLMs rely on external data beyond training for true performance gains.
Large language models learn causal structure through a difference-making logic during training, identifying which word sequences influence others. This approach mirrors the experimental method, using variation in text to infer causal relationships, and is supported by analyses of token embeddings and self-attention mechanisms.
This study compares characters in LLM-generated and human-written stories using narratological dimensions. It finds that while LLMs produce characters with similar basic traits, they lack diversity in complex character features like wholeness and stylization. The analysis reveals LLMs generate stories with limited character variety compared to human-written narratives.
Interleaved speech-language models undergo an implicit transcription phase where spoken words become decodable as text tokens in intermediate layers, despite no speech recognition training. Up to 77% of the data shows the spoken word appearing as a top candidate text prediction, followed by text continuation and return to speech. This behavior is driven by interleaving data and text LM initialization, correlating with spoken knowledge performance.
FACTOR introduces adaptive verification for factual long-form generation by adjusting validation criteria based on claim-level uncertainty. It improves factuality and reduces verification cost through uncertainty estimation, language inference, and candidate re-ranking, with results showing strong performance across diverse models.
The Buddy System uses a Rust entropy monitor to detect per-token uncertainty in local Gemma 3 4B inference, routing only uncertain tokens to Sonnet via NER-gated span extraction and semantic retrieval. Benchmarks show it achieves 71.4% accuracy at $0.21, outperforming the Anthropic Advisor pattern (62.9% at $0.44) across seven Hugging Face datasets, with a key improvement on SQuAD v2 by routing source passage chunks to the cloud model.
VADAOrchestra introduces a neurosymbolic framework that combines LLM-based workflow orchestration with Datalog+/- symbolic reasoning. It enables adaptive, explainable decision-making by incrementally planning workflows and executing logical inference on demand, offering auditability, scalability, and verifiability in real-world financial scenarios.
VCM addresses the likelihood trap in large language model decoding by introducing dynamic mechanisms to reshape probability distributions. It improves diversity, coherence, and reasoning accuracy in open-ended generation, factual QA, and mathematical reasoning with minimal computational overhead.
Gazer introduces a training-free framework that uses multimodal large language model feedback to correct semantic errors in real time during autoregressive visual model generation. By integrating reflective diagnosis and semantic correction stages, Gazer improves compositional accuracy and semantic alignment across multiple models without additional training.
Multimodal Chain-of-Thought reasoning improves performance in mathematical and scientific reasoning but harms visual grounding and object counting in perception tasks. Models exhibit a 'Look Light, Think Heavy' pattern, where visual reflection diminishes while verbal reflection increases, indicating a persistent bottleneck in visual reasoning.
A theoretical analysis shows that off-policy degree, determined by gradient steps per rollout, significantly impacts importance sampling ratios and token update dominance. The study introduces Adaptive Clip Policy Optimization (ACPO), which adjusts clipping boundaries by token group variance, outperforming DAPO and CISPO on 3B and 7B models across mathematical, QA, and logic reasoning tasks.
A new Text2DSL system uses context-aware distillation with a structured context of BNF grammar, API specification, and closed identifier vocabulary. Ablation studies show that the vocabulary has the largest impact on semantic quality, while API and BNF significantly improve structural validity, confirming structured context as a critical, not superficial, component.
A 300M-parameter SLM fine-tuned on general-domain data achieves 0.83 micro-F1 in general-domain relation extraction, surpassing zero-shot GPT-5.4 and Claude Sonnet 4.6. On literary benchmarks, the SLM reaches 0.92 on the Biographical dataset, outperforming GPT-5.4 and exceeding frontier models on average. These results demonstrate that task-adapted small models can deliver accurate, private, and hardware-efficient performance without relying on large-scale generative models.
PeerCheck analyzes differences between LLM and human academic reviews, finding LLMs focus on theory while humans prioritize methodology and experiments. The framework uses prompt engineering like Chain-of-Thought and retrieval-augmented generation, with CoT significantly improving review quality, though RAG introduces an unexpected 'paradox' that sometimes reduces quality.