flâneur

MirrorCode: Evidence AI can already do some weeks-long coding tasks | Epoch AI

epoch.ai · 11,210 words · saved by 1 readers

Early results from MirrorCode benchmark with METR: AI agents can complete weeks-long coding tasks, including reimplementing a 16,000-line codebase.

MirrorCode: Evidence AI can already do some weeks-long coding tasks | Epoch AI Introduction We present early results from MirrorCode , a benchmark (co-developed with METR ) of long-horizon coding tasks derived from real software applications. We find that AI models can autonomously reimplement complex existing software without access to the original program’s source code, provided there is a detailed, checkable specification. For example, Claude Opus 4.6 successfully reimplemented gotree — a bioinformatics toolkit with ~16,000 lines of Go and 40+ commands. We guess this same task would take a

saved by

related reading