HarvestFlex: Strawberry Harvesting via Vision-Language-Action Policy Adaptation in the Wild
The Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences(北京农业与林业科学研究院智能装备研究所);The School of Mechanical Electrical Engineering and Automation, Shanghai University(上海大学机械电子工程与自动化学院)
Ziyang Zhao, Shuheng Wang, Zhonghua Miao, Ya Xiong
This work presents the first study on transferring vision-language-action (VLA) policies to real greenhouse tabletop strawberry harvesting, a long-horizon, unstructured task challenged by occlusion and specular reflections. We built an end-to-end closed-loop system on the HarvestFlex platform using three-view RGB sensing (two fixed scene views plus a wrist-mounted view) and intentionally avoided depth clouds and explicit geometric calibration. We collected 3.71 h of VR teleoperated demonstrations (227 episodes) and fine-tuned pi_0, pi_0.5, and WALL-OSS with full fine-tuning and LoRA. Under a unified 50 trials real-greenhouse protocol and metrics spanning completion, pi_0.5 with full fine-tuning achieved success rate of 74.0% with 32.6 s/pick and damage rate of 4.1%. Asynchronous inference-control decoupling further improved performance over synchronous deployment. Results showed non-trivial closed-loop picking with fewer than four hours of real data, while remaining limited by close-range observability loss and contact-dynamics mismatch. A demonstration video is available at: https://youtu.be/bN8ZowZKPMI.
Peduncle Gripping and Cutting Force for Strawberry Harvesting Robotic End-effector Design
Lincoln Institute of Agri-Technology (LIAT)(林肯农业技术研究所);School of Computer Science(计算机科学学院);Lincoln Center of Autonomous Systems (LCAS)(林肯自主系统中心);University of Lincoln(林肯大学)
Vision-Based Obstacle Separation for Strawberry Harvesting in Clusters Using Hierarchical Reinforcement Learning
The Intelligent Equipment Research Center, Beijing Academy of Agriculture and Forestry Sciences(北京市农林科学院智能装备研究中心);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院);Happy Elements Ltd.(乐元素科技有限公司)
Optimal Scheduling of a Dual-Arm Robot for Efficient Strawberry Harvesting in Plant Factories
ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, China(浙大杭州国际科技成果转化中心,浙江大学,杭州,中国);Department of Mechanical and Aerospace Engineering, University of California, Davis(加州大学戴维斯分校机械与航空航天工程系);Department of Biological and Agricultural Engineering, University of California, Davis(加州大学戴维斯分校生物与农业工程系);College Of Biosystems Engineering And Food Science, Zhejiang University, Hangzhou, China(浙江大学生物系统工程与食品科学学院)
Robotic Strawberry Harvesting with Robust Vision and Deep Reinforcement Learning based Sim-to-Real Control
Department of Biological & Agricultural Engineering, Texas A&M University(德克萨斯A&M大学生物与农业工程系);Texas A&M AgriLife Research, Texas A&M University System(德克萨斯A&M大学系统农业生命研究);Department of Biomechatronics Engineering, National Taiwan University(国立台湾大学生物机械工程系)
Optimising robotic operation speed with edge computing over 5G networks: Insights from selective harvesting robots
Lincoln Institute of Agri-food Technology, University of Lincoln(林肯大学林肯农食品技术学院);School of Computer Science, University of Lincoln(林肯大学计算机科学学院);School of Computer Science and Electronic Engineering, University of Surrey(萨里大学计算机科学与电子工程学院)