This paper develops a flexible and robust robotic system for autonomous drawing on 3D surfaces. The system takes 2D drawing strokes and a 3D target surface (mesh or point clouds) as input. It maps the 2D strokes onto the 3D surface and generates a robot motion to draw the mapped strokes using visual recognition, grasp pose reasoning, and motion planning. The system is flexible compared to conventional robotic drawing systems as we do not fix drawing tools to the end of a robot arm. Instead, a robot selects drawing tools using a vision system and holds drawing tools for painting using its hand. Meanwhile, with the flexibility, the system has high robustness thanks to the following crafts: First, a high-quality mapping method is developed to minimize deformation in the strokes. Second, visual detection is used to re-estimate the drawing tool's pose before executing each drawing motion. Third, force control is employed to avoid noisy visual detection and calibration, and ensure a firm touch between the pen tip and a target surface. Fourth, error detection and recovery are implemented to deal with unexpected problems. The planning and executions are performed in a closed-loop manner until the strokes are successfully drawn. We evaluate the system and analyze the necessity of the various crafts using different real-word tasks. The results show that the proposed system is flexible and robust to generate a robot motion from picking and placing the pens to successfully drawing 3D strokes on given surfaces.
Improving Needle Penetration via Precise Rotational Insertion Using Iterative Learning Control
Dept. of Mechanical and Aerospace Engineering, University of California, Los Angeles(机械与航空航天工程系,加州大学洛杉矶分校);Jules Stein Eye Institute, University of California, Los Angeles(Jules Stein眼科研究所,加州大学洛杉矶分校)
Data-Driven MPC with Data Selection for Flexible Cable-Driven Robotic Arms
Center for Artificial Intelligence and Robotics, Shenzhen International Graduate School, Tsinghua University(人工智能与机器人中心,深圳国际研究生院,清华大学);Department of Advanced Manufacturing, Shenzhen International Graduate School, Tsinghua University(先进制造系,深圳国际研究生院,清华大学)
Ultrasound-Guided Robotic Blood Drawing and In Vivo Studies on Submillimetre Vessels of Rats
Tongji University(同济大学);Chengdu Aixam Medical Technology Co., Ltd.(成都 Aixam 医疗科技有限公司);Katholieke Universiteit Leuven(鲁汶大学);Scuola Superiore Sant’Anna(圣安娜高等学校);Shanghai East Hospital, School of Medicine, Tongji University(同济大学医学院附属上海东方医院);State Key Laboratory of Cardiovascular Diseases(心血管疾病国家重点实验室)
Autonomous and Teleoperation Control of a Drawing Robot Avatar
Munich Institute of Robotics and Machine Intelligence, Technical University of Munich(慕尼黑工业大学慕尼黑机器人与机器智能研究所);Centre for Tactile Internet with Human-in-the-Loop (CeTI)(人机协作触觉互联网中心);Omar Al-Mukhtar University (OMU)(奥马尔·阿尔-穆赫塔尔大学);Technische Universität Dresden(德累斯顿工业大学);Franka Emika GmbH(Franka Emika公司)
Precision Meets Art: Autonomous Multi-UAV System for Large Scale Mural Drawing
Sverk Ltd.(Svek有限公司);Lomonosov Moscow State University(罗蒙诺索夫莫斯科国立大学);Cognitive Pilot Ltd.(Cognitive Pilot有限公司);NUST MISIS(国立研究型技术大学莫斯科国立钢铁合金学院);Kosygin State University of Russia(俄罗斯柯西金国立大学)
Environment-Grounded Multi-Agent Workflow for Autonomous Penetration Testing
JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL – Institute for Digital Technologies(JOANNEUM RESEARCH 研究所,DIGITAL – 数字技术研究所);TU Graz, Institute for Technical Informatics(格拉茨技术大学,技术信息研究所);Jamk University of Applied Sciences, Institute of Information Technology(贾马克应用科学大学,信息技术研究所)
Visual Pressure Estimation and Control for Soft Robotic Grippers
Georgia Institute of Technology(佐治亚理工学院);Intel Labs(英特尔研究院);Meta Reality Labs(Meta现实实验室);Hello Robot Inc.(Hello Robot公司)
柔软的机器人抓手有助于实现接触式操作,包括对各种物体的牢固抓取。然而,软夹持器的有利顺应性也导致显著变形,这可能使精确操作具有挑战性。我们提出了视觉压力估计和控制(VPEC),一种方法,推断软抓手使用RGB图像从外部摄像头施加的压力。我们提供的视觉压力推断的结果时,气动夹持器和肌腱致动的夹持器与平面接触。我们还表明,VPEC可以通过推断的压力图像的闭环控制进行精确操作。在我们的评估中,移动机械手(来自Hello Robot的Stretch RE 1)使用视觉伺服在所需的压力下进行接触;遵循空间压力轨迹;并抓住小的低轮廓物体,包括microSD卡,硬币和药丸。总的来说,我们的研究结果表明,视觉估计施加的压力可以使软夹持器进行精确的操作。
Image-driven Robot Drawing with Rapid Lognormal Movements
Goldsmiths, University of London(伦敦大学金史密斯学院);Idiap Research Institute and École Polytechnique Fédérale de Lausanne (EPFL)(日内瓦联邦理工学院(EPFL)与IDIAP研究所);University of Konstanz(康斯坦茨大学);Ecole Polytechnique de Montréal(蒙特利尔联邦理工学院)
Novel Non-Prehensile Rolling Problem: Modelling and Balance Control of Pendulum-Driven Reconfigurable Disks Motion with Magnetic Coupling in Simulation
Geometric Mechanics and Mechatronics (gm 2 R) Lab, the School of Engineering, Cardiff University(几何力学与机电实验室,工程学院,卡迪夫大学)
Robots Pre-train Robots: Manipulation-Centric Robotic Representation from Large-Scale Robot Datasets
University of California, San Diego(加利福尼亚大学圣迭戈分校);Tongji University(同济大学);Shanghai Jiao Tong University(上海交通大学);University of Maryland, College Park(马里兰大学帕克分校);Tsinghua University(清华大学)