(2012) Developing embodied multisensory dialogue agents. In: R. Rzepka, M. Ptaszyński, P. Dybala (Eds) Linguistic and Cognitive Approaches To Dialogue Agents. AISB, 6-14
A few decades of work in the AI field have focused efforts on developing a new generation of systems which can acquire knowledge via interaction with the world. Yet, until very recently, most such attempts were underpinned by research which predominantly regarded linguistic phenomena as separated from the brain and body. This could lead one into believing that to emulate linguistic behaviour, it suffices to develop 'software' operating on abstract representations that will work on any computational machine. This picture is inaccurate for several reasons, which are elucidated in this paper and extend beyond sensorimotor and semantic resonance. Beginning with a review of research, I list several heterogeneous arguments against disembodied language, in an attempt to draw conclusions for developing embodied multisensory agents which communicate verbally and non-verbally with their environment. Without taking into account both the architecture of the human brain, and embodiment, it is unrealistic to replicate accurately the processes which take place during language acquisition, comprehension, production, or during non-linguistic actions. While robots are far from isomorphic with humans, they could benefit from strengthened associative connections in the optimization of their processes and their reactivity and sensitivity to environmental stimuli, and in situated human-machine interaction. The concept of multisensory integration should be extended to cover linguistic input and the complementary information combined from temporally coincident sensory impressions.
GenCoord: Executable Commitments for Embodied LLM Agents under Private Information
Tsinghua University（清华大学）；Beijing Normal-Hong Kong Baptist University（北京师范大学-香港浸会大学联合国际学院）；University of North Carolina at Charlotte（北卡罗来纳大学夏洛特分校）；University of California San Diego（加利福尼亚大学圣迭戈分校）
Suzume-chan: Your Personal Navigator as an Embodied Information Hub
Doctoral Program in Informatics, University of Tsukuba（信息学博士项目，东京大学）；Doctoral Program in Nursing Science, University of Tsukuba（护理科学博士项目，东京大学）；Institute of Library, Information and Media Science, University of Tsukuba（图书馆、信息与媒体科学研究所，东京大学）
BAP v2: An Enhanced Task Framework for Instruction Following in Minecraft Dialogues
University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Microsoft（微软）；University of Massachusetts Amherst（马萨诸塞大学阿姆赫斯特分校）；Amazon（亚马逊）；Amazon AGI（亚马逊人工智能实验室）
HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics
East China University of Science and Technology（东华大学）；The University of Sydney（悉尼大学）；Institute of Artificial Intelligence (TeleAI)（人工智能研究所）；China Telecom（中国电信）；Datawhale Org（Datawhale组织）；Independent Researcher（独立研究员）
ESearch-R1: Learning Cost-Aware MLLM Agents for Interactive Embodied Search via Reinforcement Learning
School of Traffic and Transportation, Beijing Jiaotong University（交通与运输学院，北京交通大学）；Tencent Robotics X & Futian Laboratory（腾讯机器人X与福田实验室）；Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences（基础模型研究中心，中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）
SoMi-ToM: Evaluating Multi-Perspective Theory of Mind in Embodied Social Interactions
The University of Hong Kong（香港大学）；Carnegie Mellon University（卡内基梅隆大学）；Johns Hopkins University（约翰霍普金斯大学）；University of California Irvine（加州大学尔湾分校）；Stanford University（斯坦福大学）
Collaborative Instance Object Navigation: Leveraging Uncertainty-Awareness to Minimize Human-Agent Dialogues
Polytechnic of Turin（都灵理工大学）；University of Verona（维罗纳大学）；ENSTA Paris（巴黎国立高等先进技术学校）；Institut Polytechnique de Paris（巴黎综合理工学院）；Fondazione Bruno Kessler（布鲁诺·凯塞勒基金会）
A Human Digital Twin Architecture for Knowledge-based Interactions and Context-Aware Conversations
University of Central Florida（中佛罗里达大学）；Osmania University（奥斯曼尼亚大学）；Virtual and Augmented Reality Applications Lab（虚拟与增强现实应用实验室）；Emerging Analytics Center（新兴分析中心）；Louisiana Immersive Technologies Enterprise（路易斯安那沉浸式技术企业）；University of Louisiana at Lafayette（路易斯安那大学拉斐特分校）；School of Modeling, Simulation and Training（建模、仿真与训练学院）；Institute for Simulation and Training（仿真与训练研究所）
Toward Evidence-Driven Human-Agent-Robot Teaming for Earth-Independent Anomaly Triage
NASA Ames Research Center（美国国家航空航天局艾姆斯研究中心）；SETI Institute（搜寻地外文明研究所）；The University of Texas at Austin（德克萨斯大学奥斯汀分校）；University of Michigan（密歇根大学）；Repertory Robotics
