Towards Adaptive Mechanism Activation in Language Agent
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
语言智能体可以被赋予不同机制,以自主完成任务。当前智能体通常依赖固定机制,或按预定义顺序激活的一组机制,这限制了它们对各种潜在任务解决方案结构的适应能力。为此,本文提出了基于自探索的自适应语言智能体机制激活学习(Adaptive Language Agent Mechanism Activation Learning with Self-Exploration,ALAMA),其重点是在不依赖专家模型的情况下优化机制激活的适应性。首先,它构建了一个统一智能体框架(UniAct),通过动作(Actions)统一(Unify)不同机制。随后,它利用一种基于自探索且训练高效的优化方法,使 UniAct 能够根据任务的潜在特征自适应地激活合适的机制。实验结果表明,下游智能体任务取得了显著提升,证实了该方法在促进更具动态性和上下文敏感性的机制激活方面的有效性。
英文摘要:
Language Agent could be endowed with different mechanisms for autonomous task accomplishment. Current agents typically rely on fixed mechanisms or a set of mechanisms activated in a predefined order, limiting their adaptation to varied potential task solution structures. To this end, this paper proposes \textbf{A}daptive \textbf{L}anguage \textbf{A}gent \textbf{M}echanism \textbf{A}ctivation Learning with Self-Exploration (\textbf{ALAMA}), which focuses on optimizing mechanism activation adaptability without reliance on expert models. Initially, it builds a harmonized agent framework (\textbf{UniAct}) to \textbf{Uni}fy different mechanisms via \textbf{Act}ions. Then it leverages a training-efficient optimization method based on self-exploration to enable the UniAct to adaptively activate the appropriate mechanisms according to the potential characteristics of the task. Experimental results demonstrate significant improvements in downstream agent tasks, affirming the effectiveness of our approach in facilitating more dynamic and context-sensitive mechanism activation.
AWARe: Mitigating Catastrophic Forgetting via Activation-Weighted Adaptive REtention
School of Software Technology, Zhejiang University(浙江大学软件学院);College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);School of Artificial Intelligence, Sun Yat-Sen University(中山大学人工智能学院);Graduate School of Information Science, Hokkaido University(北海道大学信息科学研究院)
SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activation
School of Computing, University of Georgia(佐治亚大学计算机学院);Department of Biosystems Engineering and Soil Science, University of Tennessee(田纳西大学生物系统工程与土壤科学系);Department of Biomedical Informatics, University of Colorado School of Medicine(科罗拉多医学院生物医学信息学系);Department of Biomedical Engineering, New Jersey Institute of Technology(新泽西理工学院生物医学工程系);Department of Physics and Astronomy, The University of Georgia(佐治亚大学物理与天文学系)
NeuronScope: A Multi-Agent Framework for Explaining Polysemantic Neurons in Language Models
Wuhan University(武汉大学);Hong Kong Baptist University(香港 Baptist大学);New Jersey Institute of Technology(新泽西理工学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))