Reasoning models
arxiv arXiv cs.AI · 2d ago

Benchmark Evaluation of Small Language Models for Arabic NLP

A benchmark of 240 Arabic test items across eight domains and ten skills assesses twelve small language models in zero-shot settings. Gemma 3 (12B) achieved the highest overall score (4.548/5), followed by Aya and C4AI Command Arabic, with performance linked more to Arabic alignment and instruction-following than model size. Common failure modes include prompt leakage, hallucination, and weak task adherence.

arxiv arXiv cs.CL · 2d ago

Group-Graph Policy Optimization for Long-Horizon Agentic RL

Group-Graph Policy Optimization (G2PO) introduces a graph-based approach to enhance long-horizon agentic reinforcement learning by transforming interaction trajectories into state-transition graphs. It enables group-aggregated state-value estimation and edge-centric advantage calculation, improving credit assignment and reducing variance, and achieves up to 22.2% success rate improvement over GRPO on WebShop, ALFWorld, and AppWorld benchmarks.

arxiv arXiv cs.CL · 2d ago

Dual-Track Framework for Template-Constrained LaTeX Conversion

A new Dual-Track Framework decouples template formatting from document processing by using an offline track to extract template constraints into a reusable manifest and an online track with a hybrid pipeline. It limits LLM use to reasoning tasks like metadata and bibliographic handling, while applying rule-based engines for deterministic operations, improving structural fidelity, layout compliance, and compilation success over baseline methods.