Embodied robots which can interact with their environment and neighbours are increasingly being used as a test case to develop Artificial Intelligence. This creates a need for multimodal robot controllers that can operate across different types of information, including text. Large Language Models are able to process and generate textual as well as audiovisual data and, more recently, robot actions. Language Models are increasingly being applied to robotic systems; these Language-Based robots leverage the power of language models in a variety of ways. Additionally, the use of language opens up multiple forms of information exchange between members of a human-robot team. This survey motivates the use of language models in robotics, and then delineates works based on the part of the overall control flow in which language is incorporated. Language can be used by human to task a robot, by a robot to inform a human, between robots as a human-like communication medium, and internally for a robot's planning and control. Applications of language-based robots are explored, and numerous limitations and challenges are discussed to provide a summary of the development needed for the future of language-based robotics.
Learning to Optimize Edge Robotics: A Fast Integrated Perception-Motion-Communication Approach
Beijing University of Posts and Telecommunications(北京邮电大学);South China University of Technology(华南理工大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院);University of Macau(澳门大学)
This paper reviews various Evolutionary Approaches applied to the domain of Evolutionary Robotics with the intention of resolving difficult problems in the areas of robotic design and control. Evolutionary Robotics is a fast-growing field that has attracted substantial research attention in recent years. The paper thus collates recent findings along with some anticipated applications. The reviewed literature is organized systematically to give a categorical overview of recent developments and is presented in tabulated form for quick reference. We discuss the outstanding potentialities and chal…
Robotic Sensor Network: Achieving Mutual Communication Control Assistance With Fast Cross-Layer Optimization
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Southern University of Science and Technology(南方科技大学);University of Macau(澳门大学);University of New South Wales(新南威尔士大学)
Results of the Survey: Failures in Robotics and Intelligent Systems
Research Institute for Cognition and Robotics (CoR-Lab)(认知与机器人研究所);Center of Excellence Cognitive Interaction Technology (CITEC)(认知交互技术卓越中心);Bielefeld University(比勒费尔德大学)
Robotic Communications for 5G and Beyond: Challenges and Research Opportunities
Queen Mary University of London(伦敦玛丽女王大学);Beijing University of Posts and Telecommunications(北京邮电大学);Louisiana State University(路易斯安那州立大学);Memorial University(纪念大学);Princeton University(普林斯顿大学)
Aristotle University of Thessaloniki(塞萨洛尼基亚里士多德大学);Centre for Research and Technology Hellas(希腊研究与技术中心)
This paper presents a comprehensive review of ground agricultural robotic systems and applications with special focus on harvesting that span research and commercial products and results, as well as their enabling technologies. The majority of literature concerns the development of crop detection, field navigation via vision and their related challenges. Health monitoring, yield estimation, water status inspection, seed planting and weed removal are frequently encountered tasks. Regarding robotic harvesting, apples, strawberries, tomatoes and sweet peppers are mainly the crops considered in pu…
Maulana Azad National Institute of Technology(莫拉纳·阿扎德国家技术研究院);JNResearch Labs LLP(JN研究实验室有限责任公司)
Over the last several years, use cases for robotics based solutions have diversified from factory floors to domestic applications. In parallel, Deep Learning approaches are replacing traditional techniques in Computer Vision, Natural Language Processing, Speech processing, etc. and are delivering robust results. Our goal is to survey a number of research internship projects in the broad area of 'Deep Learning as applied to Robotics' and present a concise view for the benefit of aspiring student interns. In this paper, we survey the research work done by Robotic Institute Summer Scholars (RISS)…
Modern computing platforms for robotics applications comprise a set of heterogeneous elements, e.g., multi-core CPUs, embedded GPUs, and FPGAs. FPGAs are reprogrammable hardware devices that allow for fast and energy-efficient computation of many relevant tasks in robotics. ROS is the de-facto programming standard for robotics and decomposes an application into a set of communicating nodes. ReconROS is a previous approach that can map complete ROS nodes into hardware for acceleration. Since ReconROS relies on standard ROS communication layers, exchanging data between hardware-mapped nodes can …
Advantages of Multimodal versus Verbal-Only Robot-to-Human Communication with an Anthropomorphic Robotic Mock Driver
Centre for Applied Autonomous Sensor Systems (AASS)(应用自主传感器系统中心(AASS));Örebro University(厄勒布鲁大学);Robert Bosch GmbH(罗伯特·博世有限公司);University of Skövde(舍夫德大学);TU Munich(慕尼黑工业大学)
Trust in LLM-controlled Robotics: a Survey of Security Threats, Defenses and Challenges
School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院);Australian Centre for Robotics and School of Aerospace, Mechanical and Mechatronic Engineering, The University of Sydney(悉尼大学机器人中心及航空航天、机械与机电工程学院);Department of Information Systems and Cybersecurity, University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校信息系统与网络安全系);School of Engineering and Natural Sciences, University of Iceland(冰岛大学工程与自然科学学院)
Generative Artificial Intelligence in Robotic Manipulation: A Survey
LimX Dynamics(灵蜥科技);University of Hong Kong(香港大学);Southern University of Science and Technology(南方科技大学);Zhejiang University(浙江大学);The Hong Kong Polytechnic University(香港理工大学);The Hong Kong University of Science and Technology(香港科技大学);Tsinghua University(清华大学);Great Bay University(大湾区大学)
Robotic Vision for Human-Robot Interaction and Collaboration: A Survey and Systematic Review
Australian Research Council Centre of Excellence for Robotic Vision(澳大利亚研究理事会机器人视觉卓越中心);Queensland University of Technology(昆士兰科技大学);Monash University(莫纳什大学);University of Oxford(牛津大学)