BenchFlow (Bingran You, Wenjun Ke, Ria Rosenauer, Bo Liu, Wenbo Chen, Min Chen, Shuqi Xu, Yue Ma) · Physics Agent Benchmark

FrontierPhysics

FrontierPhysics is an end-to-end benchmark of 56 physics research tasks written by 42 physicists from their own work, spanning nine domains. Agents must review literature, plan, run research and experiments, and produce a scientific manuscript, graded by deterministic verifiers and expert rubrics. Across 22 models in 26 configurations, no configuration passes more than 46 of its 168 rollouts, with frontier agents mainly weak in rigorous reasoning and expert intuition.