Autonomous robots combine a variety of skills to form increasingly complex behaviors called missions. While the skills are often programmed at a relatively low level of abstraction, their coordination is architecturally separated and often expressed in higher-level languages or frameworks. Recently, the language of Behavior Trees gained attention among roboticists for this reason. Originally designed for computer games to model autonomous actors, Behavior Trees offer an extensible tree-based representation of missions. However, even though, several implementations of the language are in use, little is known about its usage and scope in the real world. How do behavior trees relate to traditional languages for describing behavior? How are behavior tree concepts used in applications? What are the benefits of using them?
We present a study of the key language concepts in Behavior Trees and their use in real-world robotic applications. We identify behavior tree languages and compare their semantics to the most well-known behavior modeling languages: state and activity diagrams. We mine open source repositories for robotics applications that use the language and analyze this usage. We find that Behavior Trees are a pragmatic language, not fully specified, allowing projects to extend it even for just one model. Behavior trees clearly resemble the models-at-runtime paradigm. We contribute a dataset of real-world behavior models, hoping to inspire the community to use and further develop this language, associated tools, and analysis techniques.
树木性状的自主测量,如分支结构,分支直径,分支长度和分支角度,是需要的任务,如机器人修剪树木以及结构表型。我们提出了一个机器人视觉系统称为机器人系统的树形状估计(RoTSE),以确定在现场设置的树性状。该过程由以下几个阶段组成:图像采集与移动机器人单元,分割,重建,曲线去卷积,转换为图形表示,然后计算的特点。苹果树的定量和定性结果显示在精度,计算时间和鲁棒性。与地面实况测量相比,RoTSE产生了以下估计值:分支直径(均方根误差$2.97$ mm)、分支长度(均方根误差$136.92$ mm)和分支角度(均方根误差$31.07$度)。当体素分辨率为$3$ mm $^3$时,平均运行时间为$8.47$分钟。
Semantics-guided Skeletonization of Sweet Cherry Trees for Robotic Pruning
Collaborative Robotics and Intelligent Systems (CoRIS) Institute(协作机器人与智能系统研究所);Oregon State University(俄勒冈州立大学);Field Robotics Center(野外机器人中心);Carnegie Mellon University(卡内基梅隆大学)
Robotic-CLIP: Fine-tuning CLIP on Action Data for Robotic Applications
FPT Software AI Center(FPT软件人工智能中心);Automation & Control Institute (ACIN), TU Wien(维也纳工业大学自动化与控制研究所);Center for Vision, Automation & Control, AIT Austrian Institute of Technology (GmbH)(奥地利技术研究所(GmbH)视觉、自动化与控制中心);The University of Tokyo(东京大学);University of Liverpool(利物浦大学);National University of Singapore(新加坡国立大学);University of Arkansas(阿肯色大学)
LLM-BT: Performing Robotic Adaptive Tasks based on Large Language Models and Behavior Trees
Institute of Robotics and Intelligent Systems, Wuhan University of Science and Technology(武汉科技大学机器人与智能系统研究院);School of Physics, Engineering and Technology, University of York(约克大学物理、工程与技术学院)
Supervised learning and tree search for real-time storage allocation in Robotic Mobile Fulfillment Systems
Polytechnique Montreal(蒙特利尔理工学院);CIRRELT, Research Centre on Enterprise Networks, Logistics and Transportation(企业网络、物流与运输研究中心);IVADO Labs(IVADO实验室);GERAD, Group for Research in Decision Analysis(决策分析研究组)
Automated Action Generation based on Action Field for Robotic Garment Smoothing and Alignment
JC STEM Lab of Robotics for Soft Materials(机器人软材料实验室);Department of Electrical and Electronic Engineering(电气电子工程系);Faculty of Engineering(工程学院);The University of Hong Kong(香港大学)
APTree: Extended Behavior Trees for Adaptive and Scalable Automated Robotic Task Planning in Construction
University of Stuttgart(斯图加特大学);Institute for Computational Design and Construction(计算设计与建造研究所);Institute for Control Engineering of Machine Tools and Manufacturing Units(机床与制造单元控制工程研究所)
ManipDreamer: Boosting Robotic Manipulation World Model with Action Tree and Visual Guidance
State Key Laboratory of Multimedia Information Processing(多媒体信息处理国家重点实验室);School of Computer Science, Peking University(北京大学计算机学院);Hong Kong University of Science and Technology(香港科技大学);Autonomous Driving Development, NIO(蔚来自动驾驶研发)
Video-to-BT: Generating Reactive Behavior Trees from Human Demonstration Videos for Robotic Assembly
Munich Institute of Robotics and Machine Intelligence (MIRMI)(慕尼黑机器人与机器智能研究所);Technical University of Munich(慕尼黑技术大学);Aalto University(艾尔沃斯大学);Shanghai University(上海大学);Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Multi-Risk-RRT: An Efficient Motion Planning Algorithm for Robotic Autonomous Luggage Trolley Collection at Airports
Southern University of Science and Technology(南方科技大学);Jiaxing Research Institute, Southern University of Science and Technology(南方科技大学嘉兴研究院);University of Pennsylvania(宾夕法尼亚大学);Shanghai Jiao Tong University(上海交通大学);Yanshan University(燕山大学)