Article

FrontierCS 2: A Benchmark for Computer Science R&D Released

Researchers introduce FrontierCS 2, a benchmark of 48 open-ended tasks. Their approach takes a paper and the code its authors released, deletes the paper's contribution, and uses the remaining code as the human reference baseline. Unlike earlier benchmarks that only give a problem description and grade one program after the run, FrontierCS 2 places agents inside a research environment where they inherit a runnable repository and can submit patches at any time. The evaluator returns only a development-suite score, while the evaluator, the held-out final suite, and the reference remain private.

Part of the event: Release of the FrontierCS 2 computer science research and development benchmark

This page provides a summary and source link only.