media Hugging Face Forums · 16h ago · open_models

Linda-Pro releases local English AI-text detector using stylometry and DeBERTa

from English

Linda-Pro is a new local tool for detecting AI-generated English text that combines stylometry with two fine-tuned DeBERTa models. It analyzes text in approximately 300-word windows and provides a per-sentence heat map to identify mixed authorship.

On the Chicago Booth benchmark, it achieves 99.7% detection for plain AI text and 85% after StealthGPT humanization at 1% false positives.
It flagged 92.6% of texts from generators the models never saw during training.
Weak spots include TOEFL exam essays with 8.8% false positives (reduced to 1.1% in precise mode), humanized text, and short texts.

The model weights are available for free research use on Hugging Face, and code is provided on GitHub for local evaluation.

Importance 1/3 Trust 1/3 Hugging Face Forums Evaluation & benchmarks Open weights

Read original

media Together AI Blog · 15d ago · 20 views

Together outlines strategy for migrating from closed to open source models

Together provides a framework for enterprises to migrate from closed-source AI models to open-source models (OSM) using managed services, aiming to reduce complexity and accelerate adoption. The process involves discovering suitable models through benchmarks, evaluating them via traffic replay, adapting prompts or weights, and calculating ROI to justify the switch.

arxiv arXiv cs.CL · 63d ago · 26 views

OSReward introduces standardized evaluation for cross-platform computer-use reward models

Researchers introduce OSReward, a realistic benchmark designed to evaluate the reliability of vision-language models (VLMs) acting as judges for computer-using agent trajectories. The study reveals that even state-of-the-art VLMs suffer from systematic leniency bias and are often too expensive for scale, while affordable open models perform poorly.

media Hugging Face Forums · 71d ago · 21 views

John6666 releases first independent reference implementation for REO v1.5

John "John6666" has developed the first independent reference implementation of the Reference Evaluation Object (REO v1.5) protocol, fulfilling a key goal of the EPE research program to enable reproducible benchmarks by external contributors.

arxiv arXiv cs.CL · 89d ago · 22 views

AGC-Bench introduces unified benchmark and AGC-Judge to measure artificial general creativity

Researchers introduce AGC-Bench, a unified benchmark for artificial general creativity constructed from 3,101 screened papers and covering 78 datasets across domains like brainstorming and STEM. To address bias in automated evaluation, the team fine-tunes Qwen3-30B on bias-corrected ratings to create AGC-Judge, an open-weight model that robustly scores new creativity benchmarks.

media r/LocalLLaMA · 91d ago · 21 views

Fine-tuned Gemma-4-31B for Copywriting Scores +290 Elo on EqBench3

A user has released a narrow fine-tune of the Gemma-4-31B-it model specifically optimized for copywriting and creative writing tasks. The model was trained to eliminate generic marketing clichés and adopt a direct-response style characterized by concrete specifics and tight calls to action.