A zero-shot agentic workflow using open-source LLMs extracts 13 College of American Pathologists synoptic fields from lung resection pathology reports. The best model (GPT-OSS-20B) achieved a Micro-F1 of 0.893, outperforming baseline recall and accurately capturing complex pathologic relations without task-specific training.
arxiv
arXiv cs.CL
·
51d ago
·
research
Zero-Shot Agentic LLMs Extract Lung Pathology from Narratives
from English
Related articles
arxiv
arXiv cs.AI
·
52d ago
·
1 view
CAPRA: Multi-Agent LLM System for Software Architecture Feedback
CAPRA is a multi-agent LLM system that generates personalized, template-compliant LaTeX feedback on software architecture deliverables. It uses specialized agents, PyMuPDF, and gpt-4o to extract and analyze text and UML diagrams, with evidence anchoring and consistency management to ensure reliability. A preliminary evaluation of 10 student reports shows CAPRA met 88.8% of eight criteria and achieved moderate inter-rater agreement (kappa = 0.582), with each report processed in under 4 minutes.
arxiv
arXiv cs.AI
·
53d ago
ALeRCE Launches Text-to-SQL System with LLMs
The ALeRCE astronomical database introduces a text-to-SQL system using large language models, enabling natural language queries to generate executable SQL. The system, evaluated on 110 NL/SQL pairs, uses a step-by-step framework that outperforms direct-inference baselines, with Claude Opus 4.6 achieving high precision on simple queries and among the best overall performance across evaluated models.
arxiv
arXiv cs.LG
·
54d ago
·
1 view
Fingerprinting agent behavior through procedural trajectories
We introduce a method to identify agents by their procedural behavior fingerprints, achieving 85.7% accuracy in attributing unseen trajectories to correct agents. Using ProcGrep, we analyze coding agent behavior in SWE-Bench, finding that models from similar release periods or distilled from each other exhibit closer behavioral similarity, with a Jensen-Shannon divergence of 0.25.
arxiv
arXiv cs.AI
·
51d ago
·
3 views
Trajectory Mining Reveals Skill Structure but Fails to Improve Policies
A three-stage pipeline mines skill libraries from GUI interaction data, achieving high purity in five of eight clusters against InteraSkill labels. However, the method only slightly improves skill-step accuracy on IW and fails to advance performance on BrowseComp+ or key metrics, indicating limitations in cross-domain policy transfer.
arxiv
arXiv cs.AI
·
51d ago
·
3 views
AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning
AutoPass uses runtime and compiler evidence to guide LLM-generated optimization decisions, outperforming expert heuristics and classical autotuning methods. It achieves geometric-mean speedups of 1.043x on x86-64 and 1.117x on ARM64 systems without prior training or fine-tuning.