People are relying on AI agents to assist them with various tasks. The human must know when to rely on the agent, collaborate with the agent, or ignore its suggestions. In this work, we propose to learn rules, grounded in data regions and described in natural language, that illustrate how the human should collaborate with the AI. Our novel region discovery algorithm finds local regions in the data as neighborhoods in an embedding space where prior human behavior should be corrected. Each region is then described using a large language model in an iterative and contrastive procedure. We then teach these rules to the human via an onboarding stage. Through user studies on object detection and question-answering tasks, we show that our method can lead to more accurate human-AI teams. We also evaluate our region discovery and description algorithms separately.
Development and Design of FLKit: A Structured Onboarding Toolkit for Federated Learning in Health and Life Sciences
STADIUS, Department of Electrical Engineering (ESAT), KU Leuven(STADIUS部门,电气工程系(ESAT),鲁汶大学);Biomedical Research Institute (BIOMED), Hasselt University(生物医学研究所(BIOMED),哈塞尔特大学);Data Science Institute (DSI), Hasselt University(数据科学研究所(DSI),哈塞尔特大学);Department of Medical Genetics, University of Antwerp(医学遗传学系,安特卫普大学)
Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition
ETH Zurich(苏黎世联邦理工学院);CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心);West University of Timisoara(蒂米什瓦拉西部大学);New York University(纽约大学);Microsoft(微软公司);Zurich University of the Arts(苏黎世艺术大学)
Interchangeable in Role, Not in History: Replacing Members of Formed LLM Teams
China Agricultural University(中国农业大学);Tianjin University of Finance and Economics(天津财经大学);Jilin University(吉林大学);Tianjin University of Science and Technology(天津科技大学)
SoK: DARPA's AI Cyber Challenge (AIxCC): Competition Design, Architectures, and Lessons Learned
Georgia Institute of Technology(佐治亚理工学院);Texas A&M University(德克萨斯大学);Smart Information Flow Technologies (SIFT)(智能信息流技术公司);Kudu Dynamics(Kudu动态公司);Microsoft(微软)
Lessons Learned: A Multi-Agent Framework for Code LLMs to Learn and Improve
Rensselaer Polytechnic Institute(拉特兰理工学院);Massachusetts Institute of Technology(麻省理工学院);Michigan State University(密歇根州立大学);MIT-IBM Watson AI Lab, IBM Research(MIT-IBM沃森人工智能实验室,IBM研究院)
TEAM: Topological Evolution-aware Framework for Traffic Forecasting--Extended Version
University of Science(科学大学);Vietnam National University(越南国家大学);Aalborg University(奥尔堡大学);University of Electronic Science and Technology of China(电子科技大学);East China Normal University(华东师范大学)