We introduce a method to identify agents by their procedural behavior fingerprints, achieving 85.7% accuracy in attributing unseen trajectories to correct agents. Using ProcGrep, we analyze coding agent behavior in SWE-Bench, finding that models from similar release periods or distilled from each other exhibit closer behavioral similarity, with a Jensen-Shannon divergence of 0.25.
arxiv
arXiv cs.LG
·
54d ago
·
research
Fingerprinting agent behavior through procedural trajectories
from English
Importance 3/3
New feature vs. leaders
New harness with differentiators
arXiv cs.LG
OpenAI
Cohere
Mistral AI
AI agents
Code generation
Reasoning models
Related articles
arxiv
arXiv cs.AI
·
51d ago
·
3 views
Trajectory Mining Reveals Skill Structure but Fails to Improve Policies
A three-stage pipeline mines skill libraries from GUI interaction data, achieving high purity in five of eight clusters against InteraSkill labels. However, the method only slightly improves skill-step accuracy on IW and fails to advance performance on BrowseComp+ or key metrics, indicating limitations in cross-domain policy transfer.
arxiv
arXiv cs.AI
·
51d ago
·
3 views
AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning
AutoPass uses runtime and compiler evidence to guide LLM-generated optimization decisions, outperforming expert heuristics and classical autotuning methods. It achieves geometric-mean speedups of 1.043x on x86-64 and 1.117x on ARM64 systems without prior training or fine-tuning.
arxiv
arXiv cs.CL
·
51d ago
·
1 view
AgentFinVQA: Auditable, On-Premise Financial Chart QA
AgentFinVQA introduces a multi-agent pipeline for financial chart question answering that ensures auditability and on-premise deployability without significant accuracy loss. It outperforms baseline models by +7.68 pp using a proprietary backbone and +4.84 pp with open-weights Qwen3.6-27B-FP8, while providing a confidence signal via verifier output that improves human review routing.
arxiv
arXiv cs.CL
·
51d ago
·
1 view
Zero-Shot Agentic LLMs Extract Lung Pathology from Narratives
A zero-shot agentic workflow using open-source LLMs extracts 13 College of American Pathologists synoptic fields from lung resection pathology reports. The best model (GPT-OSS-20B) achieved a Micro-F1 of 0.893, outperforming baseline recall and accurately capturing complex pathologic relations without task-specific training.
arxiv
arXiv cs.AI
·
52d ago
LLM-as-Interface, ML-as-Predictor for Pediatric Appendicitis
ClaMPAPP, a hybrid system, uses an LLM to extract structured clinical features from free-text notes and passes them to an XGBoost classifier for diagnosis. It outperformed end-to-end LLMs in both internal and external validation, with better diagnostic performance and fewer missed cases, demonstrating superior stability and safety in pediatric appendicitis triage.