Safety & alignment
arxiv arXiv cs.AI · 8d ago

LegalHalluLens: Auditing Hallucinations in Legal AI

LegalHalluLens introduces a framework to audit AI hallucinations in legal contexts by analyzing typed hallucination profiles across four claim categories. It reveals a 38-40 point gap between obligation/numeric and temporal claims, and shows two systems with identical 52% hallucination rates can have opposite risk directions. The framework uses a Risk Direction Index and calibrated debate pipelines to reduce fabricated detections by 45% and improve accountability in legal AI deployment.

arxiv arXiv cs.AI · 8d ago

ScaFE: Using LLMs to Extract Clinically Meaningful Scar Features

ScaFE proposes using large language models as feature engineers to transform medical images into clinically interpretable representations. By generating deterministic Python code from established scar assessment criteria, it extracts features aligned with clinical scoring systems like the Vancouver Scar Scale. The method achieves superior performance under limited data, with advantages in data efficiency, privacy preservation, and interpretability.

arxiv arXiv cs.AI · 8d ago

Agentic AI Framework Reduces Diagnostic Errors in Healthcare

A multi-agent AI framework addresses premature diagnostic handoff and silent hallucinations in healthcare by enforcing structured clinical protocol completion and epistemic uncertainty quantification. Evaluations on 150 simulated cases show 49.3% diagnostic precision, an 11.3 percentage point improvement over baseline, with a statistically significant negative correlation between OLDCARTS completeness and diagnostic uncertainty.

arxiv arXiv cs.AI · 8d ago

Introducing COGNITIVE ATROPHY BENCH for LLM Mental-Health Interactions

A new benchmark, COGNITIVE ATROSPHY BENCH, measures how LLMs induce cognitive decline in mental-health conversations. Built from 1,576 human-generated counseling sessions and evaluated by clinical experts, it identifies patterns like directive advice and validation that may reduce user autonomy. The tool introduces metrics such as UIRI and ARI to assess atrophy risk and track behavioral trajectories across user interactions.

arxiv arXiv cs.CL · 8d ago

LLM Recommendation Bias and Brand Competition Dynamics

Well-known brands dominate LLM recommendations by 100% when products are identical, but this advantage vanishes with a mere +0.1-star rating edge. Authority-style marketing claims, such as fabricated clinical evidence, break this dominance at a bias surplus of +0.17 rating points, with models responding differently. A social dilemma emerges in multi-brand competition, where collective optimization reduces individual payoff from +0.802 to +0.007 and eliminates recommendations for non-participating brands.

arxiv arXiv cs.CL · 8d ago

Second-Order Bias in LLMs: Evaluating Judgment-Based Bias

A new study identifies second-order bias in large language models—social bias in their judgments about biased content. Using entitlement epistemology, the research develops a reasoning task to assess whether LLMs accept or reject biased texts based on demographics, revealing implicit biases that vary by target group and evade safety guardrails. The work introduces two metrics to quantify these biases and calls for more theoretically grounded evaluation methods in NLP.