树木性状的自主测量,如分支结构,分支直径,分支长度和分支角度,是需要的任务,如机器人修剪树木以及结构表型。我们提出了一个机器人视觉系统称为机器人系统的树形状估计(RoTSE),以确定在现场设置的树性状。该过程由以下几个阶段组成:图像采集与移动机器人单元,分割,重建,曲线去卷积,转换为图形表示,然后计算的特点。苹果树的定量和定性结果显示在精度,计算时间和鲁棒性。与地面实况测量相比,RoTSE产生了以下估计值:分支直径(均方根误差$2.97$ mm)、分支长度(均方根误差$136.92$ mm)和分支角度(均方根误差$31.07$度)。当体素分辨率为$3$ mm $^3$时,平均运行时间为$8.47$分钟。
英文摘要:
The autonomous measurement of tree traits, such as branching structure, branch diameters, branch lengths, and branch angles, is required for tasks such as robotic pruning of trees as well as structural phenotyping. We propose a robotic vision system called the Robotic System for Tree Shape Estimation (RoTSE) to determine tree traits in field settings. The process is composed of the following stages: image acquisition with a mobile robot unit, segmentation, reconstruction, curve skeletonization, conversion to a graph representation, and then computation of traits. Quantitative and qualitative results on apple trees are shown in terms of accuracy, computation time, and robustness. Compared to ground truth measurements, the RoTSE produced the following estimates: branch diameter (root mean-squared error $2.97$ mm), branch length (root mean-squared error $136.92$ mm), and branch angle (mean-squared error $31.07$ degrees). The average run time was $8.47$ minutes when the voxel resolution was $3$ mm$^3$.
A Vision-Based Shared-Control Teleoperation Scheme for Controlling the Robotic Arm of a Four-Legged Robot
Department of Mechanical Engineering, University of São Paulo(机械工程系,圣保罗大学);Instituto Israelita de Ensino e Pesquisa Albert Einstein, Hospital Israelita Albert Einstein(艾利哈德研究所,以色列医院)
Proceedings of the 1st Workshop on Robotics Challenges and Vision (RCV2013)
Texas A & M University(德州农工大学);Wayne State University(韦恩州立大学);Carnegie Mellon University(卡内基梅隆大学);Simon Fraser University(西蒙弗雷泽大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Rice University(莱斯大学);University of North Carolina-Chapel Hill(北卡罗来纳大学教堂山分校)
Bio-inspired reconfigurable stereo vision for robotics using omnidirectional cameras
Shenzhen Key Laboratory of Intelligent Robotics and Flexible Manufacturing Systems, Southern University of Science and Technology(深圳智能机器人与柔性制造系统重点实验室,南方科技大学)
Robotic Vision for Human-Robot Interaction and Collaboration: A Survey and Systematic Review
Australian Research Council Centre of Excellence for Robotic Vision(澳大利亚研究理事会机器人视觉卓越中心);Queensland University of Technology(昆士兰科技大学);Monash University(莫纳什大学);University of Oxford(牛津大学)
ViTacGen: Robotic Pushing with Vision-to-Touch Generation
Department of Engineering, King’s College London(工程系,伦敦国王学院);Department of Engineering Mathematics and Bristol, Robotics Laboratory, University of Bristol(工程数学系及布里斯托尔机器人实验室,布里斯托尔大学)
When would Vision-Proprioception Policies Fail in Robotic Manipulation?
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学光明学院人工智能学院);Beijing Key Laboratory of Research on Large Models(北京大模型与智能治理研究重点实验室);School of Artificial Intelligence, Beihang University(北航人工智能学院)
Towards Active Robotic Vision in Agriculture: A Deep Learning Approach to Visual Servoing in Occluded and Unstructured Protected Cropping Environments
Queensland University of Technology(昆士兰科技大学)
3D Move To See(3DMTS)是一种多视角视觉伺服方法,适用于非结构化和遮挡环境,例如机器人作物收割中遇到的环境。本文提出了一种深度学习方法Deep-3DMTS,用于通过使用卷积神经网络(CNN)为3DMTS创建单视角方法。新方法的开发和验证,通过模拟对标准的3DMTS方法。深度3DMTS方法被示出具有在引导机器人臂的末端执行器以改善被遮挡的水果(甜椒)的视图方面与标准3DMTS基线相当的性能:末端执行器最终位置在基线的11.4 mm内;并且与基线16.8(平均值)相比,图像中的水果尺寸增加了17.8倍。
Personalizing Federated Instrument Segmentation with Visual Trait Priors in Robotic Surgery
Wellcome/EPSRC Centre for Interventional and Surgical Sciences(Wellcome/EPSRC介入与外科科学中心);University College London(伦敦大学学院);Xiamen University(厦门大学);The University of Hong Kong(香港大学);National University of Singapore(新加坡国立大学)
Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
Sun Yat-sen University(中山大学);Guangdong Key Laboratory of Big Data Analysis(大数据分析与处理广东省重点实验室);X-Era AI Lab(X-Era人工智能实验室);AMAP, Alibaba(阿里妈妈实验室);Guangdong University of Technology(广东工业大学)
Vision-Guided Targeted Grasping and Vibration for Robotic Pollination in Controlled Environments
Department of Artificial Intelligence, Korea University(韩国大学人工智能系);University of California, Los Angeles(加州大学洛杉矶分校);Department of Mechanical & Aerospace Engineering, University of California, Los Angeles(加州大学洛杉矶分校机械与航空航天工程系);Department of Computer Science, University of California, Los Angeles(加州大学洛杉矶分校计算机科学系)
M3ET: Efficient Vision-Language Learning for Robotics based on Multimodal Mamba-Enhanced Transformer
School of Software Northwestern Polytechnical University Xi'an, China(软件学院 西安理工大学 西安);Laboratoire L2Tl University Sorbonne Paris Nord Paris, France(L2Tl实验室 索邦巴黎北大学 巴黎)