Fiber-optic distributed acoustic sensing (DAS) has emerged as a critical Internet-of-Things (IoT) sensing technology with broad industrial applications. However, the two-dimensional spatial-temporal morphology of DAS signals presents analytical challenges where conventional methods prove suboptimal, while being well-suited for deep learning approaches. Although our previous work, DAS Masked Autoencoder (DAS-MAE), established state-of-the-art performance and generalization without labels, it is not satisfactory in frequency analysis in temporal-dominated DAS data. Moreover, the limitation of effective training data fails to address the substantial data requirements inherent to Transformer architectures in DAS-MAE. To overcome these limitations, we present an enhanced framework incorporating short-time Fourier transform (STFT) for explicit temporal-frequency feature extraction and pioneering video-to-DAS cross-modal pre-training to mitigate data constraints. This approach learns high-level representations (e.g., event classification) through label-free reconstruction tasks. Experimental results demonstrate transformative improvements: 0.1% error rate in few-shot classification (90.9% relative improvement over DAS-MAE) and 4.7% recognition error in external damage prevention applications (75.4% improvement over from-scratch training). As the first work to pioneer video-to-DAS cross-modal pre-training, available training resources are expanded by bridging computer vision and distributed sensing areas. The enhanced performance and generalization facilitate DAS deployment across diverse industrial scenarios while advancing cross-modal representation learning for industrial IoT sensing.
DAS-MAE: A self-supervised pre-training framework for universal and high-performance representation learning of distributed fiber-optic acoustic sensing
State Key Laboratory of Photonics and Communications, Shanghai Jiao Tong University(上海交通大学光子与通信国家重点实验室)
From Signals to Evidence: Interpretable Underwater Acoustic Target Sensing with Large Language Models - Part I: Framework and Recognition
School of Artificial Intelligence, Northwestern Polytechnical University(西北工业大学人工智能学院);School of Ocean Engineering and Technology, Sun Yat-sen University(中山大学海洋工程与技术学院);School of Marine Science and Technology, Northwestern Polytechnical University(西北工业大学海洋科学与技术学院);School of Electronic and Optical Engineering, Nanjing University of Science and Technology(南京理工大学电子与光学工程学院)
Automated Dysphagia Screening Using Noninvasive Neck Acoustic Sensing
Jacobs School of Engineering, University of California San Diego(加州大学圣地亚哥分校 Jacobs 工程学院);Department of Biomedical Engineering, Duke University(杜克大学生物医学工程系);Halıcıoğlu Data Science Institute, University of California San Diego(加州大学圣地亚哥分校 Halıcıoğlu 数据科学研究所);Department of Otolaryngology-Head and Neck Surgery, University of California San Diego(加州大学圣地亚哥分校耳鼻喉科与头颈外科系)
Training a Distributed Acoustic Sensing Traffic Monitoring Network With Video Inputs
School of Physics and Astronomy, Tel-Aviv University(物理与天文学院,特拉维夫大学);School of Electrical Engineering, Tel-Aviv University(电气工程学院,特拉维夫大学);Porter School of the Environment and Earth Sciences, Tel-Aviv University(环境与地球科学波特学院,特拉维夫大学)