This paper introduces DashengTokenizer, a continuous audio tokenizer engineered for joint use in both understanding and generation tasks. Unlike conventional approaches, which train acoustic tokenizers and subsequently integrate frozen semantic knowledge, our method inverts this paradigm: we leverage frozen semantic features and inject acoustic information. In linear evaluation across 22 diverse tasks, our method outperforms previous audio codec and audio encoder baselines by a significant margin while maintaining competitive audio reconstruction quality. Notably, we demonstrate that this acoustic injection improves performance for tasks such as speech emotion recognition, music understanding, and acoustic scene classification. We further evaluate the tokenizer's generative performance on text-to-audio (TTA), text-to-music (TTM), and speech enhancement (SE). Our approach surpasses standard variational autoencoder (VAE)-based methods on TTA and TTM tasks, while its effectiveness on SE underscores its capabilities as a general-purpose audio encoder. Finally, our results challenge the prevailing assumption that VAE-based architectures are a prerequisite for audio synthesis. Checkpoints are available at https://huggingface.co/mispeech/dashengtokenizer.
Text Prompt is Not Enough: Sound Event Enhanced Prompt Adapter for Target Style Audio Generation
SDU-ANU Joint Science College, Shandong University（山东大学SDU-ANU联合科学学院）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Tsinghua University（清华大学）；AI Lab, Tencent（腾讯AI实验室）
Attention is All You Need? Good Embeddings with Statistics are enough:Large Scale Audio Understanding without Transformers/ Convolutions/ BERTs/ Mixers/ Attention/ RNNs or ....
When Fine-Tuning is Not Enough: Lessons from HSAD on Hybrid and Adversarial Audio Spoof Detection
Department of Computer Science and Technology, Kean University, USA（计算机科学与技术系，凯恩大学，美国）；Department of Computer Science and Technology, Wenzhou-Kean University, China（计算机科学与技术系，温州-凯恩大学，中国）
Urban Rhapsody: Large-scale exploration of urban soundscapes
New York University（纽约大学）；University of Illinois at Chicago（伊利诺伊大学芝加哥分校）；Universidade Federal Fluminense（弗鲁米嫩塞联邦大学）；New Jersey Institute of Technology（新泽西理工学院）
Is Semantics Enough for Speech Mean Opinion Score Prediction?
National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China（中国科学技术大学国家语音与语言信息处理工程研究中心）
