E3-TIR: Enhanced Experience Exploitation for Tool-Integrated Reasoning
Harbin Institute of Technology, Shenzhen, China(哈尔滨工业大学(深圳));Huawei Technologies Co., Ltd.(华为技术有限公司);Hong Kong University of Science and Technology(香港科技大学)
Weiyang Guo, Zesheng Shi, Liye Zhao, Jiayuan Ma, Zeen Zhu, Junxian He, Min Zhang, Jing Li
While Large Language Models (LLMs) have demonstrated significant potential in Tool-Integrated Reasoning (TIR), existing training paradigms face significant limitations: Zero-RL suffers from inefficient exploration and mode degradation due to a lack of prior guidance, while SFT-then-RL is limited by high data costs and capability plateaus caused by low-entropy collapse. To address these challenges, we propose E3-TIR (Enhanced Experience Exploitation), a warm-up paradigm for the early stages of agent training. Specifically, we formulate training as the dynamic integration of three experience types: Expert Prefixes, Expert Guided, and Self-Exploration. By executing diverse branching exploration around expert "anchors" and employing a mix policy optimization mechanism, we effectively mitigate distribution shifts and resolve optimization conflicts arising from shared prefixes. Our method dynamically adapts the model's knowledge boundaries, effectively balancing exploration diversity with training efficiency.Experimental results demonstrate that E3-TIR achieves a 6 performance improvement over traditional paradigms on tool-use tasks, while requiring less than 10 of the synthetic data. Furthermore, in terms of ROI, a comprehensive metric integrating performance, data cost, and training efficiency we achieve a 1.46x gain compared to baselines. Code is available at https://github.com/yuki-younai/E3-TIR.
SAGE: Structured Strategic Reasoning for Efficient LLM Game Playing
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Johns Hopkins University(约翰斯·霍普金斯大学);Microsoft(微软);Fudan University(复旦大学);University of Science and Technology of China(中国科学技术大学)
CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University(吉林大学知识驱动人机智能工程研究中心);International Center of Future Science, Jilin University(吉林大学未来科学国际中心);Department of Informatics, King’s College London(伦敦国王学院信息学院);The Alan Turing Institute(艾伦·图灵研究所);AI Centre, Department of Computer Science, UCL(UCL计算机科学系人工智能中心)