The short-time Fourier transform (STFT) provides the foundation of binary-mask based audio source separation approaches. In computing a spectrogram, the STFT window size parameterizes the trade-off between time and frequency resolution. However, it is not yet known how this parameter affects the operation of the binary mask in terms of separation quality for real-world signals such as speech or music. Here, we demonstrate that the trade-off between time and frequency in the STFT, used to perform ideal binary mask separation, depends upon the types of source that are to be separated. In particular, we demonstrate that different window sizes are optimal for separating different combinations of speech and musical signals. Our findings have broad implications for machine audition and machine learning in general.
Genuine-Focused Learning using Mask AutoEncoder for Generalized Fake Audio Detection
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Tsinghua University(清华大学);School of Information and Communication Engineering, Communication University of China(中国传媒大学信息与通信工程学院);Shanghai Polytechnic University(上海第二工业大学)
Purification Before Fusion: Toward Mask-Free Speech Enhancement for Robust Audio-Visual Speech Recognition
University of Electronic Science and Technology of China(电子科技大学);Defense Innovation Institute, Academy of Military Sciences(国防科技创新研究院);Peking University(北京大学);High-tech Institute(高新技术研究所)
FlowSep 2: Self-Supervised Flow Matching for Language-Queried Audio Source Separation
School of Computer Science and Electronic Engineering, University of Surrey(萨里大学计算机科学与电子工程学院);Meta Superintelligence Labs(元宇宙超级智能实验室);Department of Informatics, King’s College London(伦敦国王学院信息学系)
Motion-Aware Reasoning from Speech to Mask Tracks: Runner-up Solution for the MeViS-Audio Track of the 8th LSVOS Challenge 2026
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Anhui University of Science and Technology(安徽理工大学);National University of Singapore(新加坡国立大学);China Agricultural University(中国农业大学)
Analysis of Speaker Verification Performance Trade-offs with Neural Audio Codec Transmission
Indian Institute of Science Education and Research, Bhopal(印度科学教育与研究学院,博帕尔);Nanyang Technological University, Singapore(南洋理工大学,新加坡);Menlo Research(Menlo研究)
Audio-Visual Segmentation by Exploring Cross-Modal Mutual Semantics
University of Technology Sydney(悉尼科技大学);The University of Queensland(昆士兰大学);Futureverse;The Hong Kong University of Science and Technology(香港科技大学);CSIRO DATA61(联邦科学与工业研究组织数据61研究所);Netease Fuxi AI Lab(网易伏羲人工智能实验室)
CAV-MAE Sync: Improving Contrastive Audio-Visual Mask Autoencoders via Fine-Grained Alignment
Goethe University of Frankfurt(法兰克福歌德大学);MIT(麻省理工学院);IBM Research(IBM研究院);MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);Tuebingen AI Center/University of Tuebingen(图宾根人工智能中心/图宾根大学)