CAPRA is a multi-agent LLM system that generates personalized, template-compliant LaTeX feedback on software architecture deliverables. It uses specialized agents, PyMuPDF, and gpt-4o to extract and analyze text and UML diagrams, with evidence anchoring and consistency management to ensure reliability. A preliminary evaluation of 10 student reports shows CAPRA met 88.8% of eight criteria and achieved moderate inter-rater agreement (kappa = 0.582), with each report processed in under 4 minutes.
arxiv
arXiv cs.AI
·
52d ago
·
research
CAPRA: Multi-Agent LLM System for Software Architecture Feedback
from English
Importance 2/3
arXiv cs.AI
Hugging Face
Cohere
OpenAI
AI agents
Code generation
Evaluation & benchmarks
Related articles
arxiv
arXiv cs.CL
·
51d ago
·
1 view
Zero-Shot Agentic LLMs Extract Lung Pathology from Narratives
A zero-shot agentic workflow using open-source LLMs extracts 13 College of American Pathologists synoptic fields from lung resection pathology reports. The best model (GPT-OSS-20B) achieved a Micro-F1 of 0.893, outperforming baseline recall and accurately capturing complex pathologic relations without task-specific training.
arxiv
arXiv cs.AI
·
52d ago
·
1 view
Data Intelligence Agents Enable Autonomous Data Querying
Data Intelligence Agents (DIA) deploy autonomous coding agents to streamline enterprise data workflows. The Query Generator matches or exceeds top published results on seven SQL benchmarks across four dialects, showing generalization through natural-language instructions and execution-based architecture.
arxiv
arXiv cs.LG
·
53d ago
ReproRepo: Scalable Reproducibility Audits with GitHub Issues
ReproRepo introduces a scalable framework using GitHub issues to evaluate ML paper reproducibility. It shows that LLM agents like Codex with GPT-5.5 identify at least one human-reported blocker in 90% of 1,149 ML papers, highlighting their ability to detect visible failures and semantic issues, though exact localization remains limited.
arxiv
arXiv cs.CL
·
53d ago
ReproRepo: Scaling Reproducibility Audits with GitHub Issues
ReproRepo introduces a scalable framework using GitHub issues to evaluate ML paper reproducibility. It shows that LLM agents like Codex with GPT-5.5 identify at least one semantically related blocker in 90% of paper-repository pairs without executing code.
arxiv
arXiv cs.AI
·
53d ago
ReproRepo: Scaling Reproducibility Audits with GitHub Issues
ReproRepo introduces a scalable framework using GitHub issues to evaluate ML paper reproducibility. It shows that LLM agents like Codex with GPT-5.5 identify at least one blocker in 90% of paper-repository pairs without executing code, though exact localization remains challenging.