Robots engaged in complex manipulation tasks require robust material property recognition to ensure adaptability and precision. Traditionally, visual data has been the primary source for object perception; however, it often proves insufficient in scenarios where visibility is obstructed or detailed observation is needed. This gap highlights the necessity of tactile sensing as a complementary or primary input for material recognition. Tactile data becomes particularly essential in contact-rich, small-scale manipulations where subtle deformations and surface interactions cannot be accurately captured by vision alone. This letter presents a novel approach leveraging a temporal binding foundation model for tactile sequence understanding to enhance material property recognition. By processing tactile sensor data with a temporal focus, the proposed system captures the sequential nature of tactile interactions, similar to human fingertip perception. Additionally, this letter demonstrates that, through tailored and specific design, the foundation model can more effectively capture temporal information embedded in tactile sequences, advancing material property understanding. Experimental results validate the model's capability to capture these temporal patterns, confirming its utility for material property recognition in visually restricted scenarios. This work underscores the necessity of embedding advanced tactile data processing frameworks within robotic systems to achieve truly embodied and responsive manipulation capabilities.
SATac: A Thermoluminescence Enabled Tactile Sensor for Concurrent Perception of Temperature, Pressure, and Shear
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Shenzhen University(深圳大学);RISC-V International Open Source Laboratory(RISC-V国际开源实验室);Ryerson University(瑞尔森大学)
3D Vision-tactile Reconstruction from Infrared and Visible Images for Robotic Fine-grained Tactile Perception
State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology(数字制造装备与技术国家重点实验室,机械科学与工程学院,华中科技大学)
Representing Data in Robotic Tactile Perception -- A Review
Oxford Robotics Institute (ORI), University of Oxford, United Kingdom(牛津大学机器人研究所(ORI));Eindhoven University of Technology (TU/e), Netherlands(埃因霍温理工大学(TU/e));AI, Robotics, & Cognitive Vehicel Lab, BMW Group, Munich, Germany(人工智能、机器人与认知车辆实验室,宝马集团);Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy(信息学、生物工程、机器人与系统工程系(DIBRIS),热那亚大学)
Design of a bioinspired robophysical antenna for insect-scale tactile perception and navigation
Department of Mechanical Engineering, University of Colorado Boulder(科罗拉多大学博尔德分校机械工程系);Department of Mechanical Engineering, Penn State University(宾夕法尼亚州立大学机械工程系)
A Novel Bioinspired Neuromorphic Vision-based Tactile Sensor for Fast Tactile Perception
Khalifa University(哈利法大学);University of Lincoln(林肯大学);Khalifa University Center of Autonomous Robotic Systems (KUCARS)(哈利法大学自主机器人系统中心);Healthcare Engineering and Innovation Group (HEIG)(医疗保健工程与创新集团);Advanced Research and Innovation Center (ARIC)(先进研究与创新中心)
Towards Interpretable Visuo-Tactile Predictive Models for Soft Robot Interactions
The BioRobotics Institute, Sant’Anna School of Advanced Studies(圣安娜高级研究院生物机器人研究所);Departement of Excellence in Robotics & AI, Sant’Anna School of Advanced Studies(圣安娜高级研究院机器人与人工智能卓越系);Department of Computer Science, University College London(伦敦大学学院计算机科学系)
A thin and soft optical tactile sensor for highly sensitive object perception
Graduate School of Natural Science and Technology, Kanazawa University(自然科学技术研究生院,金泽大学);Faculty of Mechanical Engineering, Institute of Science and Engineering, Kanazawa University(机械工程学部,科学工程研究所,金泽大学);Hamamatsu Photonics K.K.(Hamamatsu光子株式会社)
FasTac: A Curved Multispectral Vision-Based Tactile Sensor for High-Speed High-Precision 3D Shape and Force Perception
State Key Laboratory of Intelligent Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology(华中科技大学机械科学与工程学院智能制造装备与技术国家重点实验室);National Innovation Institute of Digital Design and Manufacturing(国家数字化设计与制造创新中心)
Elastic Interaction of Particles for Robotic Tactile Simulation
Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心(BNRist));State Key Lab on Intelligent Technology and Systems(智能技术与系统国家重点实验室);Tsinghua University(清华大学)
MagCilia: A Compact Magnetociliary Tactile Sensor with 3D Force Sensing for Robotic Contact Perception and Grasping Feedback
National University of Singapore(新加坡国立大学);University of California, Berkeley(加州大学伯克利分校);City University of Hong Kong(香港城市大学);City University of Hong Kong Shenzhen Research Institute(香港城市大学深圳研究院)
DTactive: A Vision-Based Tactile Sensor with Active Surface
Shanghai Qi Zhi Institute(上海期智研究院);Huazhong University of Science and Technology(华中科技大学);Carnegie Mellon University(卡内基梅隆大学);Tsinghua University(清华大学);Shanghai AI Laboratory(上海人工智能实验室)
MagicGel: A Novel Visual-Based Tactile Sensor Design with MagneticGel
School of Mechanical Engineering, Anhui University of Technology(安徽工业大学机械工程学院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院);College of Quality and Technical Supervision, Hebei University(河北大学质量技术监督学院);School of Engineering and Technology, China University of Geosciences (Beijing)(中国地质大学(北京)工程技术学院)
Soft Robotic Link with Controllable Transparency for Vision-based Tactile and Proximity Sensing
Japan Advanced Institute of Science and Technology (JAIST)(日本北陆先端科学技术大学院大学(JAIST));Hanoi University of Industry(河内工业大学);Japan Science and Technology Agency(日本科学技术振兴机构)
What Matters for Active Texture Recognition With Vision-Based Tactile Sensors
TU Darmstadt(达姆施塔特工业大学);German Research Center for AI (DFKI)(德国人工智能研究中心);University of Giessen(吉森大学);Centre for Cognitive Science, Technical University of Darmstadt(达姆施塔特工业大学认知科学中心);Hessian Center for Artificial Intelligence (Hessian.AI)(黑森人工智能中心)
AnyTouch 2: General Optical Tactile Representation Learning For Dynamic Tactile Perception
Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China(中国人民大学光明学院);Beijing Key Laboratory of Research on Large Models(北京大型模型研究关键实验室);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing Jiaotong University(北京交通大学);Shanghai AI Laboratory(上海人工智能实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing University of Posts(北京邮电大学);State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室)
VTD: Visual and Tactile Database for Driver State and Behavior Perception
College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Frontiers Science Center for Intelligent Autonomous Systems(智能自主系统前沿科学中心);Trinity College, University of Oxford(牛津大学三一学院);CATARC Automotive Technology (Shanghai) Co., LTD.(中汽研汽车技术(上海)有限公司);School of Automotive Studies, Tongji University(同济大学汽车学院)