Meta FAIR · Benchmark

ProgramBench

Benchmark of 200 tasks where SWE-agents must rebuild full programs (FFmpeg, SQLite, PHP) from only an executable and documentation, evaluated via agent-driven behavioral fuzzing.

Open the source ↗

Similar Research & Safety releases

More from Meta FAIR

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.