Lingkai Kong, Yuzhe Gu, Haiteng Zhao, Zijian Wu, Youqing Fang, Zhouqi Hua, Yanan Sun, Kai Chen (Intern Large Models) · RL Self-Learning

Incentivizing Self-Learning in Large Language Models via Reinforcement Learning

The paper studies self-learning, where an LLM autonomously retrieves, studies and applies knowledge from long-form textbooks while solving proof exercises. It introduces a BookNavigator interface and trains the behaviour with reinforcement learning using fine-grained rewards. On Intern-S2-Preview-35B, overall proof accuracy rises from 51.5% to 79.5%, and the authors report gains of 1.7 and 2.3 percentage points over the base model on BrowseComp-Plus and CL-bench.

Open the source ↗

Similar Research & Safety releases

Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.