Speech Super-Resolution (SSR) is a task of enhancing low-resolution speech signals by restoring missing high-frequency components. Conventional approaches typically reconstruct log-mel features, followed by a vocoder that generates high-resolution speech in the waveform domain. However, as mel features lack phase information, this can result in performance degradation during the reconstruction phase. Motivated by recent advances with Selective State Spaces Models (SSMs), we propose a method, referred to as Wave-U-Mamba that directly performs SSR in time domain. In our comparative study, including models such as WSRGlow, NU-Wave 2, and AudioSR, Wave-U-Mamba demonstrates superior performance, achieving the lowest Log-Spectral Distance (LSD) across various low-resolution sampling rates, ranging from 8 to 24 kHz. Additionally, subjective human evaluations, scored using Mean Opinion Score (MOS) reveal that our method produces SSR with natural and human-like quality. Furthermore, Wave-U-Mamba achieves these results while generating high-resolution speech over nine times faster than baseline models on a single A100 GPU, with parameter sizes less than 2\% of those in the baseline models.
Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);School of Electronic Information, Sichuan University(四川大学电子信息学院);Huiyan Technology (Tianjin) Co., Ltd(慧言科技(天津)有限公司);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
Mamba in Speech: Towards an Alternative to Self-Attention
School of Electrical Engineering and Telecommunications, The University of New South Wales (UNSW)(新南威尔士大学电子工程与电信学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院);School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院);Guangdong Provincial Key Laboratory of Big Data Computing, The Chinese University of Hong Kong (Shenzhen)(广东大数据计算省级重点实验室,香港中文大学(深圳));Shenzhen Research Institute of Big data, Shenzhen(深圳大数据研究 institute)
PARROT: Synergizing Mamba and Attention-based SSL Pre-Trained Models via Parallel Branch Hadamard Optimal Transport for Speech Emotion Recognition
IIIT-DelhiIndia(印度IIIT-德尔hi大学);V.B.S.P.UIndia(印度V.B.S.P.U大学);UPESIndia(印度UPES大学);Independent ResearcherIndia(印度独立研究者);University of TartuEstonia(爱沙尼亚塔尔图大学);Plaksha UniversityIndia(印度Plaksha大学)
Omni-directional attention mechanism based on Mamba for speech separation
School of Cyberspace Science and Technology, Beijing Institute of Technology(空客空间科学与技术学院,北京理工大学);School of Computer Science, Beijing University of Posts and Telecommunications(计算机学院,北京邮电大学);School of Information and Electronics, Beijing Institute of Technology(信息电子学院,北京理工大学)
Deep Active Speech Cancellation with Mamba-Masking Network
Blavatnik School of Computer Science Tel Aviv University(塔尔医学院计算机科学学院);School of Electrical and Computer Engineering Ben-Gurion University of the Negev(本·古里安大学电气与计算机工程学院)
Fake-Mamba: Real-Time Speech Deepfake Detection Using Bidirectional Mamba as Self-Attention's Alternative
School of Computing, University of Eastern Finland(计算机学院,东方芬兰大学);Department of Statistics and Applied Probability, University of California Santa Barbara(统计与应用概率系,加州大学圣芭芭拉分校);School of Computer Science and Technology, University of Chinese Academy of Sciences(计算机科学与技术学院,中国科学院大学);Department of Mathematics, University of Toronto(数学系,多伦多大学);Graduate Institute of Communication Engineering, National Taiwan University(通信工程研究生院,台湾大学)
TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms
Keyword Mamba: Spoken Keyword Spotting with State Space Models
School of Computer Science and Communication Engineering, Jiangsu University(江苏大学计算机科学与通信工程学院);Jiangsu Engineering Research Center of Big Data Ubiquitous Perception and Intelligent Agricultural Applications(江苏大数据普适感知与智能农业应用工程研究中心);Provincial Key Laboratory of Computational Intelligence and New Technologies in Low-Altitude Digital Agriculture(省级计算智能与低空数字农业新技术重点实验室)
CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning
Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology(电气工程、数学和计算机科学学院,代尔夫特理工大学);Leiden Institute of Advanced Computer Science (LIACS), Leiden University(先进计算机科学研究所(LIACS),莱顿大学)
DiM-Gestor: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2
School of Media Engineering, Communication University of Zhejiang(浙江传媒学院媒体工程学院);School of Broadcast Announcing Arts, Communication University of Zhejiang(浙江传媒学院播音主持艺术学院);Faculty of Humanities and Arts, Macau University of Science and Technology(澳门科技大学人文艺术学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Zhejiang Lab(之江实验室);Changjiang Academy of Art and Design, Shantou University(汕头大学长江艺术与设计学院)
State-Space Models in Efficient Whispered and Multi-dialect Speech Recognition
Department of Computational Linguistics(计算语言学系);Recognition Technologies(语音识别技术);Faculty of New Sciences and Technologies(新科学与技术学院);Faculty of New Sciences(新科学学院)
Temporal-Frequency State Space Duality: An Efficient Paradigm for Speech Emotion Recognition
School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院);School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);CCAI, Zhejiang University(浙江大学计算机辅助设计与图形学国家重点实验室(注:CCAI为Computer Aided Design and Computer Graphics的缩写,此处按机构关联翻译));Hefei Zhongjuyuan Intelligent Technology Co., Ltd.(合肥中聚源智能科技有限公司)