Trustworthiness is a crucial concept in the context of human-robot interaction. Cooperative robots must be transparent regarding their decision-making process, especially when operating in a human-oriented environment. This paper presents a comprehensive end-to-end framework aimed at fostering trustworthy bidirectional human-robot interaction in collaborative environments for the social navigation of mobile robots. In this framework, the robot communicates verbally while the human guides with gestures. Our method enables a mobile robot to predict the trajectory of people and adjust its route in a socially-aware manner. In case of conflict between human and robot decisions, detected through visual examination, the route is dynamically modified based on human preference while verbal communication is maintained. We present our pipeline, framework design, and preliminary experiments that form the foundation of our proposition.
MAER-Nav: Bidirectional Motion Learning Through Mirror-Augmented Experience Replay for Robot Navigation
Hong Kong Polytechnic University(香港理工大学);Eastern Institute of Technology(宁波东方理工大学);National University of Singapore(新加坡国立大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
Enabling Socially Competent navigation through incorporating HRI
Softbank Robotics Europe(软银机器人欧洲公司)
在过去的几年里,社交机器人已经被部署在公共环境中,这表明了人类感知导航能力的需求。在这方面,机器人社区已经做出努力,将化学或社会惯例包括在导航方法中。然而,很少有作品已经解决了这个问题的标签人类作为一个互动代理时,阻止机器人的运动轨迹。当前最先进的导航规划者将提出替代路径或冻结运动直到路径空闲。我们提出了第一个原型的框架,旨在提高社会能力的机器人在室内环境中导航。该实现使用导航和目标检测开源软件完成。具体来说,分别是机器人操作系统(ROS)导航堆栈,以及OpenCV与Caffe深度学习模型和MobileNet Single Shot Detector(SSD)。
Bidirectional Intent Communication: A Role for Large Foundation Models
TU Chemnitz(开姆尼茨工业大学);Robert Bosch GmbH(罗伯特·博世有限公司);Technical University of Munich(慕尼黑工业大学);Centre for Applied Autonomous Sensor Systems (AASS), Örebro University(厄勒布鲁大学应用自主传感系统中心)
Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework
ShanghaiTech University(上海科技大学);Harbin Institute of Technology(哈尔滨工业大学);University of Shanghai for Science and Technology(上海理工大学);The University of Manchester(曼彻斯特大学);University College London(伦敦大学学院)
CoINS: Counterfactual Interactive Navigation via Skill-Aware VLM
School of Advanced Manufacturing and Robotics, Peking University(北京大学先进制造与机器人学院);Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong(香港中文大学机械与自动化工程系);College of Design and Engineering, National University Of Singapore(新加坡国立大学设计与工程学院);Department of Computer Science, The University of Manchester(曼彻斯特大学计算机科学系)
SAIN: Structure-Aware Interactive Navigation with Active Dialogue Grounding for Mobile Robot
School of Mechanical Engineering and Automation, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)机械工程与自动化学院);Department of Mechanical Engineering, City University of Hong Kong(香港城市大学机械工程系)
Learning to Evolve: Multi-modal Interactive Fields for Robust Humanoid Navigation in Dynamic Environments
State Key Laboratory of General Artificial Intelligence, Peking University, Shenzhen Graduate School(一般人工智能国家重点实验室,北京大学深圳研究生院);Oxford Robotics Institute, University of Oxford(牛津大学机器人研究所);Institute for Machine Learning, Department of Computer Science, ETH Zurich(苏黎世联邦理工学院计算机科学系机器学习研究所)
Interactive Semantic Map Representation for Skill-based Visual Object Navigation
Moscow Institute of Physics and Technology(莫斯科物理技术学院);Artificial Intelligence Research Institute(人工智能研究院);Federal Research Center for Computer Science and Control of Russian Academy of Sciences(俄罗斯科学院联邦计算机科学与控制研究中心)
CoReLIN: Constraint-based Reasoning for Zero-shot Lifelong Interactive Navigation
Purdue University(普渡大学);Indian Institute of Technology, Kharagpur(印度理工学院卡哈拉格普尔分校);DEVCOM Army Research Lab(DEVCOM陆军研究实验室);National University of Singapore(新加坡国立大学)
AINav: Large Language Model-Based Adaptive Interactive Navigation
School of Advanced Manufacturing and Robotics, Peking University(北京大学先进制造与机器人学院);AI Institute, School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机学院人工智能研究所)
Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigation
Adelaide University(阿德莱德大学);Responsible AI Research Centre, Australian Institute for Machine Learning(负责任人工智能研究中心,澳大利亚机器学习研究所);Institute for Infocomm Research (I2R), A*STAR(信息与通信研究院(I2R),A*STAR);iMotion;CSIRO Data61 Project Website(CSIRO Data61项目网站)
SM2ITH: Safe Mobile Manipulation with Interactive Human Prediction via Task-Hierarchical Bilevel Model Predictive Control
Department of Computer, Control and Management Engineering, of Sapienza University of Rome(意大利萨皮恩扎大学计算机、控制与管理工程系);University of Toronto Institute for Aerospace Studies (UTIAS) and the Vector Institute for Artificial Intelligence(多伦多大学航空航天研究所(UTIAS)和向量人工智能研究所);Learning Systems and Robotics lab at the Technical University of Munich and the Munich Institute for Robotics and Machine Intelligence (MIRMI)(慕尼黑技术大学学习系统与机器人实验室及慕尼黑机器人与机器智能研究所(MIRMI));School of Computing Science, Faculty of Applied Sciences, Simon Fraser University(西蒙·弗雷泽大学应用科学学院计算机科学系)
Toward Reliable AR-Guided Surgical Navigation: Interactive Deformation Modeling with Data-Driven Biomechanics and Prompts
Department of Computer Science and Engineering, The Chinese University of Hong Kong, HKSAR, China(计算机科学与工程系,香港中文大学(深圳));Center of Smart Health, School of Nursing, The Hong Kong Polytechnic University, HKSAR, China(智能健康中心,香港理工大学);Department of Hepatobiliary Surgery, The Third Affiliated Hospital of Southern Medical University, Guangzhou, China(肝胆外科部,南方医科大学第三附属医院)
Enhancing Social Robot Navigation with Integrated Motion Prediction and Trajectory Planning in Dynamic Human Environments
School of Information Science, Japan Advanced Institute of Science and Technology(日本先进科学技术学院信息科学学院);University of Engineering and Technology, Vietnam National University Hanoi(越南国家大学河内工程技术大学)