Laboratory processes involving small volumes of solutions and active ingredients are often performed manually due to challenges in automation, such as high initial costs, semi-structured environments and protocol variability. In this work, we develop a flexible and cost-effective approach to address this gap by introducing a vision-based system for liquid volume estimation and a simulation-driven pouring method particularly designed for containers with small openings. We evaluate both components individually, followed by an applied real-world integration of cell culture automation using a UR5 robotic arm. Our work is fully reproducible: we share our code at at \url{https://github.com/DaniSchober/LabLiquidVision} and the newly introduced dataset LabLiquidVolume is available at https://data.dtu.dk/articles/dataset/LabLiquidVision/25103102.
TransGraspNet: Physically and Geometrically Consistent Manipulation of Transparent Labware
Peking University(北京大学);School of Advanced Manufacturing and Robotics, Peking University(北京大学先进制造与机器人学院);Shanghai Jiao Tong University(上海交通大学);Southern University of Science and Technology(南方科技大学)
TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);College of Design and Innovation, Tongji University(同济大学设计创意学院);Shanghai Institute for Intelligent Autonomous Systems, Tongji University(同济大学上海智能无人系统研究院);School of Software and Engineering, Huazhong University of Science and Technology(华中科技大学软件学院)
Dual-Arm Hierarchical Planning for Laboratory Automation: Vibratory Sieve Shaker Operations
College of Intelligence Science and Technology, and the National Key Laboratory of Equipment State Sensing and Smart Support, National University of Defense Technology(智能科学与技术学院,装备状态感知与智能支持国家重点实验室,国防科技大学);College of Aerospace Science and Engineering, National University of Defense Technology(航空航天科学与工程学院,国防科技大学)
BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation
Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education, East China University of Science and Technology, Shanghai, CN(能源化工过程智能制造教育部重点实验室,东华大学,上海,中国);Department of Computer Science and Engineering, East China University of Science and Technology, Shanghai, CN(东华大学计算机科学与工程系,上海,中国);Department of Laboratory Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, CN(复旦大学附属瑞金医院检验医学科,上海,中国);School of Information Science and Technology, Shihezi University, Shihezi, CN(石河子大学信息科学与技术学院,石河子,中国)