Senior SWE Bench is introduced as a new benchmark designed to evaluate software engineering capabilities through the lens of realistically underspecified feature tasks.
The benchmark focuses on assessing how models handle complex, ambiguous requirements that mirror real-world senior-level engineering challenges.