flâneur

Agent Leaderboards · Which tools coding agents choose · Armature

armature.tech · 259 words · saved by 1 readers

Which solutions coding agents choose, measured with controlled experiments. Replay every run.

Every number comes from a controlled experiment. Same repositories, same prompts, real agents, judged results. Amplifying's greenfield benchmark measures open-ended recommendations. These boards also require an approved implementation and a production operating path. Community-baseline asks are therefore shown separately from deployment- and repository-constrained work; that seam is the closest like-for-like comparison. 01 A panel of repositories Synthetic repositories that look like real companies. Different languages, stacks and personas. Every run starts from the same code. 02 Real…

saved by

related reading