flâneur

Senior SWE-Bench

senior-swe-bench.snorkel.ai · 6,142 words · saved by 4 readers

Evaluating agents as senior engineers on the work we actually give them

June 30, 2026 How Senior SWE-Bench works By Henry Kiss Ehrenberg We're excited to release Senior SWE-Bench, a benchmark for evaluating agents on their ability to act as senior engineers. Senior SWE-Bench is open-source and Harbor-compatible. The initial release has 100 total tasks, with 50 kept private to mitigate contamination. Why we built Senior SWE-Bench With the rise of more capable agents and integrations with natural working surfaces like Slack and GitHub, most of us already treat agents like senior engineers. We expect them to complete work independently and tastefully from messages or

saved by

related reading