Reddit user proposes community project for specialized open source models

A Reddit user suggests a collaborative initiative to build small, workflow-specific verification models ranging from 3B to 14B parameters. The proposal aims to leverage community data gathered through tools like Pi, aider, or OMP to address reliability issues such as semantic drift and dependency errors.

• Create specialized models for tasks like tracing, criticism, and testing rather than general frontier models.
• Utilize existing benchmarks and trajectory datasets from projects like SWE-Bench, SWE-gym, and Openhands.
• Develop a specific taxonomy to focus on reliability aspects including architecture drift and bad rollback behavior.

The author invites feedback on the feasibility of this approach or information regarding any existing similar initiatives.