Yuanhao Zeng, Shaocheng Lan, Ao Lu, Kuang Yan, Heng Lin, Xinang Xu, Yuan Luo, Yueting Wang (ShanghaiTech University) · Agent Evolution Study

The Resolution Hypothesis: Agent Evolution's Key Is Identifying Improvements

The paper argues that agent evolution, where a proposer writes candidate prompts, skills or memories and selection keeps those that score higher, often stalls because noisy evaluations cannot reliably identify real improvements. Across seven evolution methods and six models, using over 10M LLM calls, the authors find selection at candidate level is no better than random at separating helpful from harmful artifacts. They also find typical margins of a few percentage points are smaller than run-to-run variance, so published method rankings often rest on luck.

Open the source ↗

Similar Research & Safety releases

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.