In this study, we introduce a deep-learning approach for determining both the 6DoF pose and 3D size of strawberries, aiming to significantly augment robotic harvesting efficiency. Our model was trained on a synthetic strawberry dataset, which is automatically generated within the Ignition Gazebo simulator, with a specific focus on the inherent symmetry exhibited by strawberries. By leveraging domain randomization techniques, the model demonstrated exceptional performance, achieving an 84.77\% average precision (AP) of 3D Intersection over Union (IoU) scores on the simulated dataset. Empirical evaluations, conducted by testing our model on real-world datasets, underscored the model's viability for real-world strawberry harvesting scenarios, even though its training was based on synthetic data. The model also exhibited robust occlusion handling abilities, maintaining accurate detection capabilities even when strawberries were obscured by other strawberries or foliage. Additionally, the model showcased remarkably swift inference speeds, reaching up to 60 frames per second (FPS).
Peduncle Gripping and Cutting Force for Strawberry Harvesting Robotic End-effector Design
Lincoln Institute of Agri-Technology (LIAT)(林肯农业技术研究所);School of Computer Science(计算机科学学院);Lincoln Center of Autonomous Systems (LCAS)(林肯自主系统中心);University of Lincoln(林肯大学)
Vision-Based Obstacle Separation for Strawberry Harvesting in Clusters Using Hierarchical Reinforcement Learning
The Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences(北京市农林科学院智能装备研究中心);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院);Happy Elements Ltd.(乐元素科技有限公司)
Optimal Scheduling of a Dual-Arm Robot for Efficient Strawberry Harvesting in Plant Factories
ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, China(浙大杭州国际科技成果转化中心,浙江大学,杭州,中国);Department of Mechanical and Aerospace Engineering, University of California, Davis(加州大学戴维斯分校机械与航空航天工程系);Department of Biological and Agricultural Engineering, University of California, Davis(加州大学戴维斯分校生物与农业工程系);College Of Biosystems Engineering And Food Science, Zhejiang University, Hangzhou, China(浙江大学生物系统工程与食品科学学院)
Robotic Strawberry Harvesting with Robust Vision and Deep Reinforcement Learning based Sim-to-Real Control
Department of Biological & Agricultural Engineering, Texas A&M University(德克萨斯A&M大学生物与农业工程系);Texas A&M AgriLife Research, Texas A&M University System(德克萨斯A&M大学系统农业生命研究);Department of Biomechatronics Engineering, National Taiwan University(国立台湾大学生物机械工程系)
HarvestFlex: Strawberry Harvesting via Vision-Language-Action Policy Adaptation in the Wild
The Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences(北京农业与林业科学研究院智能装备研究所);The School of Mechanical Electrical Engineering and Automation, Shanghai University(上海大学机械电子工程与自动化学院)
Optimising robotic operation speed with edge computing over 5G networks: Insights from selective harvesting robots
Lincoln Institute of Agri-food Technology, University of Lincoln(林肯大学林肯农食品技术学院);School of Computer Science, University of Lincoln(林肯大学计算机科学学院);School of Computer Science and Electronic Engineering, University of Surrey(萨里大学计算机科学与电子工程学院)
Online Estimation of Table-Top Grown Strawberry Mass in Field Conditions with Occlusions
The Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences(北京农业林业科学研究院智能装备研究中心);The College of Electrical Engineering and Automation, Tianjin University of Technology(天津理工大学电气与自动化学院);The College of Mechatronic Engineering and Automation, Shanghai University(上海大学机电工程与自动化学院)
A Fast Path-Planning Method for Continuous Harvesting of Table-Top Grown Strawberries
School of Mechanical Electrical Engineering and Automation, Shanghai University(上海大学机电工程与自动化学院);Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences(北京农林科学院智能装备研究中心)
Maximum Solar Energy Tracking Leverage High-DoF Robotics System with Deep Reinforcement Learning
North Carolina State University(北卡罗来纳州立大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Kyoto University(京都大学);Monash University(莫纳什大学);Indian Institute of Technology(印度理工学院);South East European University(东南欧大学);University of Buenos Aires(布宜诺斯艾利斯大学)