FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale | alphaXiv
Researchers from UC Berkeley, Stanford, Princeton, MIT, and Bespoke Labs developed FrontierSmith, an automated system that synthesizes open-ended coding problems by mutating existing closed-ended...
Abstract Many real-world coding challenges are open-ended and admit no known optimal solution. Yet, recent progress in LLM coding has focused on well-defined tasks such as feature implementation, bug fixing, and competitive programming. Open-ended coding remains a weak spot for LLMs, largely because open-ended training problems are scarce and expensive to construct. Our goal is to synthesize open-ended coding problems at scale to train stronger LLM coders. We introduce FrontierSmith, an automated system for iteratively evolving open-ended problems from existing closed-ended coding tasks. Start
saved by
related reading
- ALE-Bench: A Benchmark for Long-Horizon Objective-Driven Algorithm Engineering | alphaXivalphaxiv.org
- Composer2.pdfcursor.com
- As Rocks May Think | Eric Jangevjang.com
- Trending Papers - Hugging Facepaperswithcode.com
- [2203.07814] Competition-Level Code Generation with AlphaCodearxiv.org
- FrontierSWEfrontierswe.com
- CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimizationalphaxiv.org
- Competitive programming with AlphaCode — Google DeepMinddeepmind.com
- [2506.13131] AlphaEvolve: A coding agent for scientific and algorithmic discoveryarxiv.org
- Program Synthesis with Large Language Modelsarxiv.org
- Open-endedness: The last grand challenge you’ve never heard of – O’Reillyoreilly.com
- FrontierSWEfrontierswe.com