Assistive agents should not only take actions on behalf of a human, but also step out of the way and cede control when there are important decisions to be made. However, current methods for building assistive agents, whether via mimicking expert humans or via RL finetuning on an inferred reward, often encourage agents to complete tasks on their own rather than truly assisting the human attain their objectives. Additionally, these methods often require costly explicit human feedback to provide a training signal. We propose a new approach to tuning assistive language models based on maximizing the human's empowerment, their ability to effect desired changes in the environment. Our empowerment-maximizing method, Empower, only requires offline text data, providing a self-supervised method for fine-tuning language models to better assist humans. To study the efficacy of our approach, we conducted an 18-person user study comparing our empowerment assistant with a strong baseline. Participants preferred our assistant 78% of the time (p=0.015), with a 31% higher acceptance rate and 38% fewer suggestions. Additionally, we introduce a new environment for evaluating multi-turn code assistance using simulated humans. Using this environment, we show that agents trained with Empower increase the success rate of a simulated human programmer on challenging coding questions by an average of 192% over an SFT baseline. With this empowerment objective, we provide a framework for useful aligned AI agents at scale using only offline data without the need for any additional human feedback or verifiable rewards.
Towards Mitigation of Hallucination for LLM-empowered Agents: Progressive Generalization Bound Exploration and Watchdog Monitor
College of Computer Science, Nankai University(南开大学计算机科学学院);Haihe Lab of ITAI College of intelligent Science and Technology, Inner Mongolia University of Technology(内蒙古工业大学智能科学与技术学院海河实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Department of Electrical and Computer Engineering, Stony Brook University(石溪大学电气与计算机工程系);Department of Computer Science, Michigan Technological University(密歇根技术大学计算机科学系)
BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens
Institute for AI Industry Research (AIR) Tsinghua University(人工智能产业研究院(AIR)清华大学);Global Innovation Exchange & Department of Automation Tsinghua University(全球创新交流中心及自动化系 清华大学)
LLM agents security duality: a comprehensive survey of self-security and empowered cybersecurity
School of Cyber Science and Engineering, Wuhan University(武汉大学计算机科学与工程学院);Department of Computer Science and Engineering, University at Buffalo(布法罗大学计算机科学与工程系)
LLM-hRIC: LLM-empowered Hierarchical RAN Intelligent Control for O-RAN
School of Electrical and Electronic Engineering, Yonsei University(延世大学电气与电子工程学院);Information System Technology and Design, Singapore University of Technology and Design(新加坡科技与设计大学信息系统技术与设计)
C-STEP: Continuous Space-Time Empowerment for Physics-informed Safe Reinforcement Learning of Mobile Agents
Faculty of Technology, Bielefeld University, Germany(比勒菲尔德大学技术学院,德国);Department of Electrical Engineering and Information Technology, Paderborn University, Germany(帕德博恩大学电气工程与信息科技系,德国)
Empowering LLM Agents with Geospatial Awareness: Toward Grounded Reasoning for Wildfire Response
University of Alabama(阿拉巴马大学);University of South Florida(佛罗里达州立大学);New York University(纽约大学);University of Michigan(密歇根大学);Texas Tech University(得克萨斯科技大学)
An Explainable Emotion Alignment Framework for LLM-Empowered Agent in Metaverse Service Ecosystem
College of Intelligence and Computing(智能与计算学院);Tianjin University(天津大学);Tianjin Key Laboratory of Healhy Habitat and Smart Technology(天津健康人居环境与智能技术重点实验室);Laboratory of Computation and Analytics of Complex Management Systems(复杂管理系统计算与分析实验室);Faculty of Environment, Science and Economy(环境、科学与经济学院)
Large Language Models Empowered Personalized Web Agents
National University of Singapore(新加坡国立大学);The Hong Kong Polytechnic University(香港理工大学);University of Science and Technology of China(中国科学技术大学);Eastern Institute of Technology(宁波东方理工大学)
LEED: A Highly Efficient and Scalable LLM-Empowered Expert Demonstrations Framework for Multi-Agent Reinforcement Learning
Department of Computer Science, The University of Hong Kong(香港大学计算机科学系);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);College of International Education, Hebei University of Economics and Business(河北经贸大学国际教育学院);Department of Electrical and Electronic Engineering, The University of Hong Kong(香港大学电子与电气工程系);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);Institute for Imaging, Data and Communications, University of Edinburgh(爱丁堡大学成像、数据与通讯研究所);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
BARTPredict: Empowering IoT Security with LLM-Driven Cyber Threat Prediction
Badji Mokhtar-Annaba University(巴吉·穆克塔尔-安纳巴大学);University of La Rochelle(拉罗谢尔大学);National Higher School of Technology and Engineering -Annaba(安纳巴国家技术与工程高等学校)
AOT*: Efficient Synthesis Planning via LLM-Empowered AND-OR Tree Search
School of Data Science, CUHK-Shenzhen(CUHK-Shenzhen数据科学学院);Shanghai AI Laboratory(上海人工智能实验室);Jilin University(吉林大学);Mila - Quebec AI Institute(魁北克AI研究所);HEC Montréal(蒙特利尔HEC)