This paper presents CLaSP, a novel model for retrieving time-series signals using natural language queries that describe signal characteristics. The ability to search time-series signals based on descriptive queries is essential in domains such as industrial diagnostics, where data scientists often need to find signals with specific characteristics. However, existing methods rely on sketch-based inputs, predefined synonym dictionaries, or domain-specific manual designs, limiting their scalability and adaptability. CLaSP addresses these challenges by employing contrastive learning to map time-series signals to natural language descriptions. Unlike prior approaches, it eliminates the need for predefined synonym dictionaries and leverages the rich contextual knowledge of large language models (LLMs). Using the TRUCE and SUSHI datasets, which pair time-series signals with natural language descriptions, we demonstrate that CLaSP achieves high accuracy in retrieving a variety of time series patterns based on natural language queries.
Enhancing the Comprehensibility of Text Explanations via Unsupervised Concept Discovery
University of Chinese Academy of Sciences(中国科学院大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Media Synthesis and Forensics Lab(媒体合成与取证实验室)
Learning a Model for Inferring a Spatial Road Lane Network Graph using Self-Supervision
Tier IV Inc.(Tier IV公司);Institute of Innovation for Future Society, Nagoya University(名古屋大学未来社会创新研究所);Graduate School of Informatics, Nagoya University(名古屋大学信息学研究科)
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision
MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);IIIS, Tsinghua University(清华大学交叉信息研究院);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);Deepmind(深度思考);MIT BCS(麻省理工学院脑与认知科学系);CBMM(脑、心智与机器中心)
Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervision
School of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);China Unicom (Guangdong) Industrial Internet Co., Ltd(中国联通(广东)工业互联网有限公司);Tsinghua University(清华大学)