AnyTouch 2: General Optical Tactile Representation Learning For Dynamic Tactile Perception
Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China(中国人民大学光明学院);Beijing Key Laboratory of Research on Large Models(北京大型模型研究关键实验室);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing Jiaotong University(北京交通大学);Shanghai AI Laboratory(上海人工智能实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing University of Posts(北京邮电大学);State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室)
Ruoxuan Feng, Yuxuan Zhou, Siyu Mei, Dongzhan Zhou, Pengwei Wang, Shaowei Cui, Bin Fang, Guocai Yao, Di Hu
Real-world contact-rich manipulation demands robots to perceive temporal tactile feedback, capture subtle surface deformations, and reason about object properties as well as force dynamics. Although optical tactile sensors are uniquely capable of providing such rich information, existing tactile datasets and models remain limited. These resources primarily focus on object-level attributes (e.g., material) while largely overlooking fine-grained tactile temporal dynamics during physical interactions. We consider that advancing dynamic tactile perception requires a systematic hierarchy of dynamic perception capabilities to guide both data collection and model design. To address the lack of tactile data with rich dynamic information, we present ToucHD, a large-scale hierarchical tactile dataset spanning tactile atomic actions, real-world manipulations, and touch-force paired data. Beyond scale, ToucHD establishes a comprehensive tactile dynamic data ecosystem that explicitly supports hierarchical perception capabilities from the data perspective. Building on it, we propose AnyTouch 2, a general tactile representation learning framework for diverse optical tactile sensors that unifies object-level understanding with fine-grained, force-aware dynamic perception. The framework captures both pixel-level and action-specific deformations across frames, while explicitly modeling physical force dynamics, thereby learning multi-level dynamic perception capabilities from the model perspective. We evaluate our model on benchmarks that covers static object properties and dynamic physical attributes, as well as real-world manipulation tasks spanning multiple tiers of dynamic perception capabilities-from basic object-level understanding to force-aware dexterous manipulation. Experimental results demonstrate consistent and strong performance across sensors and tasks.
Simultaneous Tactile-Visual Perception for Learning Multimodal Robot Manipulation
Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);School of Psychological and Cognitive Sciences, Peking University(北京大学心理与认知科学学院);Beijing Key Lab of Behavior and Mental Health, Peking University(北京大学行为与心理健康北京市重点实验室);Beijing Institute for General Artificial Intelligence(北京一般人工智能研究院);State Key Lab for General Artificial Intelligence(一般人工智能国家重点实验室);Embodied Intelligence Lab, PKU-Wuhan Institute for Artificial Intelligence(具身智能实验室,北京大学武汉人工智能研究院);Department of Computer Science and Technology, University of Cambridge(剑桥大学计算机科学与技术系)
Robotic Perception with a Large Tactile-Vision-Language Model for Physical Property Inference
College of Big Data and Internet, Shenzhen Technology University, China(大数据与互联网学院,深圳科技大学,中国);Sino-German College of Intelligent Manufacturing, Shenzhen Technology University, China(中德智能制造学院,深圳科技大学,中国);Robotics Department, Institute of Smart Systems and Artificial Intelligence (ISSAI), Nazarbayev University, Kazakhstan(机器人系,智能系统与人工智能研究所(ISSAI),纳扎尔巴耶夫大学,哈萨克斯坦);Foundation Robotics Labs, Germany(基础机器人实验室,德国)
Active Cross-Modal Visuo-Tactile Perception of Deformable Linear Objects
Dipartimento di Ingegneria, Università degli Studi della Campania Luigi Vanvitelli(工程学院,坎帕尼亚路易吉·范维蒂利大学);Dipartimento di Ingegneria dell’Informazione, Università degli Studi di Padova(信息工程学院,帕多瓦大学)
Look-to-Touch: A Vision-Enhanced Proximity and Tactile Sensor for Distance and Geometry Perception in Robotic Manipulation
State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University(上海交通大学机械系统与振动国家重点实验室);Robotics Institute, School of Mechanical Engineering, Shanghai Jiao Tong University(上海交通大学机械工程学院机器人研究所)
BMW Group AG(宝马集团);Imperial College of Science, Technology and Medicine(帝国理工学院);University of Crete(克里特大学);Institute of Molecular Biology and Biotechnology, Foundation for Research and Technology-Hellas(分子生物学与生物技术研究所,研究与技术基金会-希腊);Technical University of Munich(慕尼黑工业大学);Eötvös Loránd University(罗兰大学);Foundation Robotics Labs(基础机器人实验室);Eindhoven University of Technology(埃因霍温理工大学)
TacGNN:Learning Tactile-based In-hand Manipulation with a Blind Robot
Southern University of Science and Technology(南方科技大学);University of Hong Kong(香港大学);Tencent Robotics X(腾讯 Robotics X);University of Cambridge(剑桥大学);Imperial College London(帝国理工学院)
FingerEye: Learning Dexterous Manipulation with Continuous Vision-Tactile Sensing
National University of Singapore(新加坡国立大学);RoboScience(机器人科学);Huazhong University of Science and Technology(华中科技大学);South China University of Technology(华南理工大学)
VTD: Visual and Tactile Database for Driver State and Behavior Perception
College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Frontiers Science Center for Intelligent Autonomous Systems(智能自主系统前沿科学中心);Trinity College, University of Oxford(牛津大学三一学院);CATARC Automotive Technology (Shanghai) Co., LTD.(中汽研汽车技术(上海)有限公司);School of Automotive Studies, Tongji University(同济大学汽车学院)
SATac: A Thermoluminescence Enabled Tactile Sensor for Concurrent Perception of Temperature, Pressure, and Shear
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Shenzhen University(深圳大学);RISC-V International Open Source Laboratory(RISC-V国际开源实验室);Ryerson University(瑞尔森大学)
Elastic Interaction of Particles for Robotic Tactile Simulation
Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心(BNRist));State Key Lab on Intelligent Technology and Systems(智能技术与系统国家重点实验室);Tsinghua University(清华大学)
3D Vision-tactile Reconstruction from Infrared and Visible Images for Robotic Fine-grained Tactile Perception
State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology(数字制造装备与技术国家重点实验室,机械科学与工程学院,华中科技大学)
Representing Data in Robotic Tactile Perception -- A Review
Oxford Robotics Institute (ORI), University of Oxford, United Kingdom(牛津大学机器人研究所(ORI));Eindhoven University of Technology (TU/e), Netherlands(埃因霍温理工大学(TU/e));AI, Robotics, & Cognitive Vehicel Lab, BMW Group, Munich, Germany(人工智能、机器人与认知车辆实验室,宝马集团);Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy(信息学、生物工程、机器人与系统工程系(DIBRIS),热那亚大学)