首页/论文/2011.01408

arXiv 2011.014082020-11cs.ROcs.SYeess.SY

Hybrid Visual Servoing Tracking Control of Uncalibrated Robotic Systems for Dynamic Dwarf Culture Orchards Harvest

Beijing Research Center of Intelligent Equipment for Agriculture（北京农业智能装备技术研究中心）；Beijing Academy of Agriculture and Forestry Sciences（北京市农林科学院）；National Engineering Research Center for Information Technology in Agriculture（国家农业信息化工程技术研究中心）

Tao Li, Quan Qiu, Chunjiang Zhao

备注：: 6 pages,15 figures, accepted by IEEE ICDL2021

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

The paper is concerned with the dynamic tracking problem of SNAP orchards harvesting robots in the presence of multiple uncalibrated model parameters in the application of dwarf culture orchards harvest. A new hybrid visual servoing adaptive tracking controller and three adaptive laws are proposed to guarantee harvesting robots to finish the dynamic harvesting task and the adaption to unknown parameters including camera intrinsic and extrinsic model and robot dynamics. By the Lyapunov theory, asymptotic convergence of the closed-loop system with the proposed control scheme is rigorously proven. Experimental and simulation results have been conducted to verify the performance of the proposed control scheme. The results demonstrate its effectiveness and superiority.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

A Novel Uncalibrated Visual Servoing Controller Baesd on Model-Free Adaptive Control Method with Neural Network

Harbin Institute of Technology（哈尔滨工业大学）

Nowadays, with the continuous expansion of application scenarios of robotic arms, there are more and more scenarios where nonspecialist come into contact with robotic arms. However, in terms of robotic arm visual servoing, traditional Position-based Visual Servoing (PBVS) requires a lot of calibration work, which is challenging for the nonspecialist to cope with. To cope with this situation, Uncalibrated Image-Based Visual Servoing (UIBVS) frees people from tedious calibration work. This work applied a model-free adaptive control (MFAC) method which means that the parameters of controller are …

2022-11-21cs.RO

基于单应矩阵的机器人无标定视觉伺服轨迹规划方法

Homography matrix based trajectory planning method for robot uncalibrated visual servoing

Wuhan Institute of Technology（武汉工程大学）；Huazhong University of Science and Technology（华中科技大学）；Wuhan University（武汉大学）

提出基于单应矩阵的轨迹规划方法，利用特征值分解与单应矩阵获取最优图像轨迹，使无标定视觉伺服在较大初始偏差下实现最短路径跟踪。

2023-08-30cs.RO

面向现代商业果园精准机器人修剪作业的集成视觉伺服框架

An Integrated Visual Servoing Framework for Precise Robotic Pruning Operations in Modern Commercial Orchard

Cornell University（康奈尔大学）；Virginia Tech（弗吉尼亚理工大学）；Washington State University（华盛顿州立大学）

本文提出一种基于Intel RealSense D435相机与CoTracker3点跟踪器的视觉伺服框架，结合比例控制和迭代逆运动学实现果树修剪机器人末端执行器的精准定位，并在Gazebo仿真中验证了其有效性。

2025-06-05cs.RO

Visual Servoing in Orchard Settings

Zurich University of Applied Sciences（苏黎世应用科学大学）；University of Minnesota（明尼苏达大学）

We present a general framework for accurate positioning of sensors and end effectors in farm settings using a camera mounted on a robotic manipulator. Our main contribution is a visual servoing approach based on a new and robust feature tracking algorithm. Results from field experiments performed at an apple orchard demonstrate that our approach converges to a given termination criterion even under environmental influences such as strong winds, varying illumination conditions and partial occlusion of the target object. Further, we show experimentally that the system converges to the desired vi…

2022-08-24cs.RO

无标定基于图像的视觉伺服在微观与宏观尺度机器人中的应用

Applications of Uncalibrated Image Based Visual Servoing in Micro- and Macroscale Robotics

Johns Hopkins University（约翰斯·霍普金斯大学）；Sanaria, Inc.（Sanaria公司）

本文提出一种无需手眼标定和相机标定的无标记图像视觉伺服方法，利用双相机结合经典图像处理与深度学习检测特征，在微尺度蚊虫解剖和宏观尺度螺丝紧固任务中实现了类似人类的操作精度。

2023-04-17cs.RO

输入饱和下基于滑模控制的3维未标定约束视觉形状伺服

Sliding Mode Control for 3-D Uncalibrated and Constrained Vision-based Shape Servoing within Input Saturation

University of Toronto（多伦多大学）

本文提出基于滑模控制的3维未标定视觉形状伺服方法，采用高斯连续可微非对称饱和函数处理输入饱和，结合积分滑模函数增强鲁棒性，并利用李雅普诺夫理论证明系统一致最终有界。

2023-12-26cs.RO

更多相关论文收起更多论文

CLIPUNetr：利用CLIP驱动的指代表达分割辅助无标定视觉伺服控制的人机接口

CLIPUNetr: Assisting Human-robot Interface for Uncalibrated Visual Servoing Control with CLIP-driven Referring Expression Segmentation

University of Alberta（阿尔伯塔大学）

本文提出CLIPUNetr，一种CLIP驱动的指代表达分割网络，并将其集成到无标定视觉伺服控制中，以自然语言提升人机接口的语义理解能力，实验表明边界与结构指标平均提升120%，可辅助真实环境机器人控制。

2023-09-17cs.CVcs.RO

Analyzing Neural Jacobian Methods in Applications of Visual Servoing and Kinematic Control

University of Alberta（阿尔伯塔大学）；Alberta Machine Intelligence Institute (Amii)（阿尔伯塔机器智能研究所（Amii））

Designing adaptable control laws that can transfer between different robots is a challenge because of kinematic and dynamic differences, as well as in scenarios where external sensors are used. In this work, we empirically investigate a neural networks ability to approximate the Jacobian matrix for an application in Cartesian control schemes. Specifically, we are interested in approximating the kinematic Jacobian, which arises from kinematic equations mapping a manipulator's joint angles to the end-effector's location. We propose two different approaches to learn the kinematic Jacobian. The fi…

2021-06-10cs.RO

视觉引导的物体抓取

Visually Guided Object Grasping

GRAVIR-CNRS（GRAVIR-法国国家科学研究中心）；INRIA Rhône-Alpes（法国国家信息与自动化研究所罗纳-阿尔卑斯分部）；The Chinese University of Hong Kong（香港中文大学）

本文提出一种视觉伺服方法解决物体抓取与对齐问题，扩展了相机未装于机器人上的方法并强调实时估计图像雅可比矩阵，利用未标定双目装置在三维射影空间表示对齐，分析了算法性能与抓取精度。

2023-11-21cs.CVcs.RO

将行为与几何约束解释为知识图谱用于机器人操作控制

Interpreting Behaviors and Geometric Constraints as Knowledge Graphs for Robot Manipulation Control

Department of Computing Science, University of Alberta（计算科学系，阿尔伯塔大学）

本文提出利用机器人知识图谱统一行为树与几何约束，将操作控制概念化为语义事件，以实现可解释的机器人操作控制。

2025-10-07cs.RO

Robot eye-hand coordination learning by watching human demonstrations: a task function approximation approach

University of Alberta（阿尔伯塔大学）

We present a robot eye-hand coordination learning method that can directly learn visual task specification by watching human demonstrations. Task specification is represented as a task function, which is learned using inverse reinforcement learning(IRL) by inferring differential rewards between state changes. The learned task function is then used as continuous feedbacks in an uncalibrated visual servoing(UVS) controller designed for the execution phase. Our proposed method can directly learn from raw videos, which removes the need for hand-engineered task specification. It can also provide ta…

2019-02-27cs.RO