PhoneBuddy combines real and mock app environments to train open models for phone use. It improves task success rates from 36.67% to 45.33% on real phones and from 60.3% to 83.2% on AndroidWorld, showing mock-app training complements but does not replace real-app RL.
arxiv
arXiv cs.CL
·
51d ago
·
src: 52d ago
·
research
PhoneBuddy: Training Open Models for Agentic Phone Use
from English
Importance 2/3
New feature vs. leaders
New harness with differentiators
arXiv cs.CL
Hugging Face
AI agents
Evaluation & benchmarks
Related articles
lab
Hugging Face Blog
·
2h ago
ICML 2026 Open Reproductions challenge finds 23% of examined papers have falsified claims
The ICML 2026 Open Reproductions challenge, held from July 15 to August 2, 2026, engaged the community in reproducing accepted papers using AI agents and human oversight. The effort resulted in the largest open, claim-by-claim audit of a machine learning conference to date.
arxiv
arXiv cs.CL
·
51d ago
Are We Ready For An Agent-Native Memory System?
A new study decomposes agent memory into four core modules and evaluates 12 systems across five benchmark workloads. It finds no single architecture dominates, with performance dependent on alignment with workload bottlenecks, and reveals that localized maintenance is more cost-efficient than global reorganization.
arxiv
arXiv cs.CL
·
51d ago
·
1 view
AgentCIBench Evaluates Privacy Risks in Computer-Use Agents
AgentCIBench introduces a benchmark to assess privacy risks in computer-use agents. It identifies three key failure modes—visual co-location, task-ambiguity overshare, and recipient misalignment—and finds that 11 of 15 evaluated agents leak personal data in over 50% of scenarios, with an average leakage of 67.9%.
arxiv
arXiv cs.CL
·
52d ago
·
2 views
LRE: Few-Kilobytes Agent Memory with Zero Neural Cost
LRE is a CPU-only, language-model-free system that learns which interaction history units are load-bearing. It outperforms baselines in accuracy-cost balance, reducing peak context size by up to 52% and improving task completion by 37% in some cases. LRE achieves superior answer quality with 68% fewer tokens and requires no annotations or neural computation for training.
arxiv
arXiv cs.CL
·
52d ago
·
1 view
Beaver: Agent Harness for Scientific Curation from Multimodal Sources
Beaver is an agent harness that extracts structured information from scientific papers by integrating multimodal evidence tooling, task scaffolding, and artifact-grounded autoresearch. It achieves 81.0 on the Gold-Referenced Attribute Score, outperforming frontier agents by over 23 points, with key gains on high-value attributes requiring cross-modal reasoning.