首页/论文/2012.08227

arXiv 2012.082272020-12-15eess.AS

F0-based Gammatone Filtering for Intelligibility Gain of Acoustic Noisy Signals

A. Queiroz, R. Coelho

DOI：: 10.1109/LSP.2021.3084561

英文摘要：

This paper proposes a time-domain method to improve speech intelligibility in noisy scenarios. In the proposed approach, a series of Gammatone filters are adopted to detect the harmonic components of speech. The filters outputs are amplified to emphasize the first harmonics, reducing the masking effects of acoustic noises. The proposed GTFF0 solution and two baseline techniques are examined considering four background noises with different non-stationarity degrees. Three intelligibility measures (ESTOI, ESII and ASIIST) are adopted for objective evaluation. The experiments results show that the proposed scheme leads to expressive speech intelligibility gain when compared to the competing approaches. Furthermore, the PESQ and WSS objective scores demonstrate that the proposed technique also provides interesting quality improvement.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

用于端到端构音障碍语音处理任务的Gammatonegram表示：语音识别、说话人识别和可懂度评估

Gammatonegram Representation for End-to-End Dysarthric Speech Processing Tasks: Speech Recognition, Speaker Identification, and Intelligibility Assessment

University of Zurich（苏黎世大学）；University of Tehran（德黑兰大学）

本文提出将gammatonegram表示与基于预训练Alexnet的CNN迁移学习方法结合，用于构音障碍语音的识别、说话人识别和可懂度评估，并设计了级联多网络架构提升自动化识别准确率。

2024-03-20cs.CLcs.SDeess.AS

面向语音可懂度预测的多层次听力损失建模

Modeling Multi-Level Hearing Loss for Speech Intelligibility Prediction

针对临床听力测定无法捕捉听力损失的频率与时间分辨率缺陷的问题，本研究提出一种模拟听觉退化、结合STM表示与NCC特征的Vision Transformer语音可懂度预测方法，在两类听力损失组上均优于HASPI v2基准。

2025-07-30eess.AS

IANS：用于双麦克风阵列的可懂度感知零陷波束形成

IANS: Intelligibility-aware Null-steering Beamforming for Dual-Microphone Arrays

本文提出IANS框架，结合零陷波束形成与STOI-Net可懂度预测模型，在无需DOA、RTF或协方差矩阵等先验知识的情况下，利用双麦克风阵列提升语音可懂度，实验效果与已知DOA的零陷波束形成器相当。

2023-07-09eess.ASeess.SP

GEDI: Gammachirp Envelope Distortion Index for Predicting Intelligibility of Enhanced Speech

Wakayama University（和歌山大学）；NTT Communication Science Laboratories（NTT通信科学基础研究所）

In this study, we propose a new concept, the gammachirp envelope distortion index (GEDI), based on the signal-to-distortion ratio in the auditory envelope, SDRenv to predict the intelligibility of speech enhanced by nonlinear algorithms. The objective of GEDI is to calculate the distortion between enhanced and clean-speech representations in the domain of a temporal envelope extracted by the gammachirp auditory filterbank and modulation filterbank. We also extend GEDI with multi-resolution analysis (mr-GEDI) to predict the speech intelligibility of sounds under non-stationary noise conditions.…

2020-07-19cs.SDeess.AS

GMM based multi-stage Wiener filtering for low SNR speech enhancement

The Australian National University（澳大利亚国立大学）

This paper proposes a single-channel speech enhancement method to reduce the noise and enhance speech at low signal-to-noise ratio (SNR) levels and non-stationary noise conditions. Specifically, we focus on modeling the noise using a Gaussian mixture model (GMM) based on a multi-stage process with a parametric Wiener filter. The proposed noise model estimates a more accurate noise power spectral density (PSD), and allows for better generalization under various noise conditions compared to traditional Wiener filtering methods. Simulations show that the proposed approach can achieve better perfo…

2022-07-14cs.ROcs.SDeess.AS

A deep complex multi-frame filtering network for stereophonic acoustic echo cancellation

Institute of Acoustics, Chinese Academy of Sciences（中国科学院声学研究所）；University of Chinese Academy of Sciences（中国科学院大学）

In hands-free communication system, the coupling between loudspeaker and microphone generates echo signal, which can severely influence the quality of communication. Meanwhile, various types of noise in communication environments further reduce speech quality and intelligibility. It is difficult to extract the near-end signal from the microphone signal within one step, especially in low signal-to-noise ratio scenarios. In this paper, we propose a deep complex network approach to address this issue. Specially, we decompose the stereophonic acoustic echo cancellation into two stages, including l…

2022-05-06cs.SDeess.AS

更多相关论文收起更多论文

Modulation-Domain Kalman Filtering for Monaural Blind Speech Denoising and Dereverberation

Imperial College London（帝国理工学院）

We describe a monaural speech enhancement algorithm based on modulation-domain Kalman filtering to blindly track the time-frequency log-magnitude spectra of speech and reverberation. We propose an adaptive algorithm that performs blind joint denoising and dereverberation, while accounting for the inter-frame speech dynamics, by estimating the posterior distribution of the speech log-magnitude spectrum given the log-magnitude spectrum of the noisy reverberant speech. The Kalman filter update step models the non-linear relations between the speech, noise and reverberation log-spectra. The Kalman…

2018-07-26cs.SDeess.AS

iSEGAN: Improved Speech Enhancement Generative Adversarial Networks

Idiap Research Institute（IDIAP研究所）

Popular neural network-based speech enhancement systems operate on the magnitude spectrogram and ignore the phase mismatch between the noisy and clean speech signals. Conditional generative adversarial networks (cGANs) show promise in addressing the phase mismatch problem by directly mapping the raw noisy speech waveform to the underlying clean speech signal. However, stabilizing and training cGAN systems is difficult and they still fall short of the performance achieved by the spectral enhancement approaches. This paper investigates whether different normalization strategies and one-sided lab…

2020-02-20cs.SDeess.ASeess.SP

Deep Multi-Frame MVDR Filtering for Binaural Noise Reduction

University of Oldenburg（奥尔登堡大学）

To improve speech intelligibility and speech quality in noisy environments, binaural noise reduction algorithms for head-mounted assistive listening devices are of crucial importance. Several binaural noise reduction algorithms such as the well-known binaural minimum variance distortionless response (MVDR) beamformer have been proposed, which exploit spatial correlations of both the target speech and the noise components. Furthermore, for single-microphone scenarios, multi-frame algorithms such as the multi-frame MVDR (MFMVDR) filter have been proposed, which exploit temporal instead of spatia…

2022-11-14cs.SDeess.AS

一种基于约束递归训练的轻量级混合声学回声消除与抑制框架

A Lightweight Hybrid Framework for Acoustic Echo Cancellation and Suppression via Constrained Recursive Training

Tencent AI Lab（腾讯人工智能实验室）

提出一种结合深度学习与自适应滤波的轻量级混合框架，通过可学习NLMS变体和约束递归训练实现声学回声消除与抑制，仅25.3万参数，在信号质量和语音可懂度上优于基线。

2026-10-08eess.AS

基于因果信号的DCCRN与重叠帧预测用于在线语音增强

Causal Signal-Based DCCRN with Overlapped-Frame Prediction for Online Speech Enhancement

AGH University of Science and Technology（AGH科技大学）

提出基于信号的因果DCCRN模型，通过引入重叠帧预测、因果卷积和损失函数修改，在保持或提升语音增强性能的同时，将延迟和网络参数减少约30%。

2023-09-07cs.SDeess.AS

助听器中的实时多通道深度语音增强：复杂声学场景下单耳与双耳处理的比较

Real-time multichannel deep speech enhancement in hearing aids: Comparing monaural and binaural processing in complex acoustic scenarios

Carl von Ossietzky Universität Oldenburg（卡尔·冯·奥西茨基奥尔登堡大学）；Hörzentrum Oldenburg gGmbH（奥尔登堡听力中心有限责任公司）

本研究针对助听器实时低延迟需求，探索深度语音增强方法，对比单耳与双耳深度算法及传统策略在复杂声学场景的表现，发现双耳深度学习方法在空间干扰场景下性能最优。

2024-10-30cs.SDeess.AS

基于流匹配的零样本语音合成中噪声鲁棒性研究

An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS

Microsoft Corporation（微软公司）

本文针对零样本TTS在含噪音频提示下性能下降的问题，提出结合掩码语音去噪预训练、DNSMOS数据过滤和随机噪声混合微调的训练策略，显著提升了生成语音的可懂度、说话人相似度和整体质量。

2024-06-09cs.AIeess.ASeess.SP

DNN driven Speaker Independent Audio-Visual Mask Estimation for Speech Separation

University of Stirling（斯特林大学）；Aix Marseille Univ（艾克斯-马赛大学）；CNRS（法国国家科学研究中心）；University of Sheffield（谢菲尔德大学）

Human auditory cortex excels at selectively suppressing background noise to focus on a target speaker. The process of selective attention in the brain is known to contextually exploit the available audio and visual cues to better focus on target speaker while filtering out other noises. In this study, we propose a novel deep neural network (DNN) based audiovisual (AV) mask estimation model. The proposed AV mask estimation model contextually integrates the temporal dynamics of both audio and noise-immune visual features for improved mask estimation and speech separation. For optimal AV features…

2018-07-31cs.CVcs.LGcs.SD