首页/论文/2001.07874

arXiv 2001.078742020-01-22cs.SDeess.AS

Non-Negative Matrix Factorization-Convolutional Neural Network (NMF-CNN) For Sound Event Detection

Newcastle University（纽卡斯尔大学）；Visenti Pte Ltd (A Brand of Xylem)（维森蒂私人有限公司（赛莱默旗下品牌））

Teck Kai Chan, Cheng Siong Chin, Ye Li

备注：: 5 pages, 1 figure, 2 tables

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

The main scientific question of this year DCASE challenge, Task 4 - Sound Event Detection in Domestic Environments, is to investigate the types of data (strongly labeled synthetic data, weakly labeled data, unlabeled in domain data) required to achieve the best performing system. In this paper, we proposed a deep learning model that integrates Non-Negative Matrix Factorization (NMF) with Convolutional Neural Network (CNN). The key idea of such integration is to use NMF to provide an approximate strong label to the weakly labeled data. Such integration was able to achieve a higher event-based F1-score as compared to the baseline system (Evaluation Dataset: 30.39% vs. 23.7%, Validation Dataset: 31% vs. 25.8%). By comparing the validation results with other participants, the proposed system was ranked 8th among 19 teams (inclusive of the baseline system) in this year Task 4 challenge.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Semi-Supervised NMF-CNN For Sound Event Detection

Newcastle University Singapore（新加坡纽卡斯尔大学）；Xylem Water Solution Singapore Pte Ltd（赛莱默新加坡水务解决方案私人有限公司）

In this paper, a combinative approach using Nonnegative Matrix Factorization (NMF) and Convolutional Neural Network (CNN) is proposed for audio clip Sound Event Detection (SED). The main idea begins with the use of NMF to approximate strong labels for the weakly labeled data. Subsequently, using the approximated strongly labeled data, two different CNNs are trained in a semi-supervised framework where one CNN is used for clip-level prediction and the other for frame-level prediction. Based on this idea, our model can achieve an event-based F1-score of 45.7% on the Detection and Classification …

2020-09-21cs.SDeess.AS

Non-negative matrix factorization-based subband decomposition for acoustic source localization

A novel non-negative matrix factorization (NMF) based subband decomposition in frequency spatial domain for acoustic source localization using a microphone array is introduced. The proposed method decomposes source and noise subband and emphasises source dominant frequency bins for more accurate source representation. By employing NMF, delay basis vectors and their subband information in frequency spatial domain for each frame is extracted. The proposed algorithm is evaluated in both simulated noise and real noise with a speech corpus database. Experimental results clearly indicate that the al…

2016-10-15cs.SD

Separation of Moving Sound Sources Using Multichannel NMF and Acoustic Tracking

Tampere University of Technology（坦佩雷理工大学）

In this paper we propose a method for separation of moving sound sources. The method is based on first tracking the sources and then estimation of source spectrograms using multichannel non-negative matrix factorization (NMF) and extracting the sources from the mixture by single-channel Wiener filtering. We propose a novel multichannel NMF model with time-varying mixing of the sources denoted by spatial covariance matrices (SCM) and provide update equations for optimizing model parameters minimizing squared Frobenius norm. The SCMs of the model are obtained based on estimated directions of arr…

2017-10-27cs.SDeess.AS

End-to-end Non-Negative Autoencoders for Sound Source Separation

University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Adobe Research（奥多比研究院）

Discriminative models for source separation have recently been shown to produce impressive results. However, when operating on sources outside of the training set, these models can not perform as well and are cumbersome to update. Classical methods like Non-negative Matrix Factorization (NMF) provide modular approaches to source separation that can be easily updated to adapt to new mixture scenarios. In this paper, we generalize NMF to develop end-to-end non-negative auto-encoders and demonstrate how they can be used for source separation. Our experiments indicate that these models deliver com…

2019-10-31cs.SDeess.AS

Minimum-volume Multichannel Nonnegative matrix factorization for blind source separation

Georgia Institute of Technology（佐治亚理工学院）；Anonymous University（匿名大学）

Multichannel blind audio source separation aims to recover the latent sources from their multichannel mixtures without supervised information. One state-of-the-art blind audio source separation method, named independent low-rank matrix analysis (ILRMA), unifies independent vector analysis (IVA) and nonnegative matrix factorization (NMF). However, the spectra matrix produced from NMF may not find a compact spectral basis. It may not guarantee the identifiability of each source as well. To address this problem, here we propose to enhance the identifiability of the source model by a minimum-volum…

2021-03-30cs.SDeess.AS

Blind Source Separation with Optimal Transport Non-negative Matrix Factorization

Kyoto University（京都大学）；NTT Communication Science Laboratories（NTT通信科学实验室）

Optimal transport as a loss for machine learning optimization problems has recently gained a lot of attention. Building upon recent advances in computational optimal transport, we develop an optimal transport non-negative matrix factorization (NMF) algorithm for supervised speech blind source separation (BSS). Optimal transport allows us to design and leverage a cost between short-time Fourier transform (STFT) spectrogram frequencies, which takes into account how humans perceive sound. We give empirical evidence that using our proposed optimal transport NMF leads to perceptually better results…

2018-02-15cs.SDeess.ASstat.ML

更多相关论文收起更多论文

Semi-Supervised Convolutive NMF for Automatic Piano Transcription

INSA-Lyon（里昂国立应用科学学院）；UCBL（里昂第一大学）；Univ Rennes（雷恩大学）；Inria（法国国家信息与自动化研究所）；CNRS（法国国家科学研究中心）；INSA Rennes（雷恩国立应用科学学院）；UJM-Saint Etienne（圣艾蒂安大学）；Inserm（法国国家健康与医学研究院）

Automatic Music Transcription, which consists in transforming an audio recording of a musical performance into symbolic format, remains a difficult Music Information Retrieval task. In this work, which focuses on piano transcription, we propose a semi-supervised approach using low-rank matrix factorization techniques, in particular Convolutive Nonnegative Matrix Factorization. In the semi-supervised setting, only a single recording of each individual notes is required. We show on the MAPS dataset that the proposed semi-supervised CNMF method performs better than state-of-the-art low-rank facto…

2022-04-14cs.LGcs.SDeess.AS

重新思考基于隐式神经表示的非负矩阵分解

Rethinking Non-Negative Matrix Factorization with Implicit Neural Representations

University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Apple（苹果公司）

本文提出将非负矩阵分解重新表述为可学习函数，使其能够处理不规则采样的时频表示，从而扩展NMF到更广泛的信号类别。

2025-07-09cs.LGcs.SDeess.AS

Semi-supervised multichannel speech enhancement with variational autoencoders and non-negative matrix factorization

Univ. Grenoble Alpes（格勒诺布尔阿尔卑斯大学）；Grenoble INP（格勒诺布尔国立理工学院）；GIPSA-lab（格勒诺布尔图像、语音、信号与自动化实验室）

In this paper we address speaker-independent multichannel speech enhancement in unknown noisy environments. Our work is based on a well-established multichannel local Gaussian modeling framework. We propose to use a neural network for modeling the speech spectro-temporal content. The parameters of this supervised model are learned using the framework of variational autoencoders. The noisy recording environment is supposed to be unknown, so the noise spectro-temporal modeling remains unsupervised and is based on non-negative matrix factorization (NMF). We develop a Monte Carlo expectation-maxim…

2019-04-30cs.SDeess.ASstat.ML

MemNMF：基于线性预测编码频谱的内存增强非负矩阵分解用于异常声音检测

MemNMF: Memory-Augmented NMF on LPC Spectra for Anomalous Sound Detection

Institute of Science Tokyo（东京理科大学）

研究针对基于自动编码器的异常声音检测问题，提出MemNMF方法，该方法基于线性预测编码频谱，通过初始化内存模块并进行注意力加权组合来重建输入，实验表明其能改进自动编码器基线，在复杂条件下鲁棒性强。

2026-07-27cs.LGcs.SD

基于多通道NMF预训练空间先验的音乐声源分离

Pre-trained Spatial Priors on Multichannel NMF for Music Source Separation

Universidad de Malaga（马拉加大学）

针对音乐声源分离问题，提出将利用独奏片段预训练的空间混合滤波器整合至多通道非负矩阵分解（MNMF）框架的方法，适配典型管弦乐录音搭建方案，在复调合奏场景下分离性能优于传统MNMF方法。

2023-10-09cs.LGcs.SDeess.AS

Interference Reduction in Music Recordings Combining Kernel Additive Modelling and Non-Negative Matrix Factorization

Queen Mary University of London（伦敦玛丽女王大学）；Cork Institute of Technology（科克理工学院）

In live and studio recordings unexpected sound events often lead to interferences in the signal. For non-stationary interferences, sound source separation techniques can be used to reduce the interference level in the recording. In this context, we present a novel approach combining the strengths of two algorithmic families: NMF and KAM. The recent KAM approach applies robust statistics on frames selected by a source-specific kernel to perform source separation. Based on semi-supervised NMF, we extend this approach in two ways. First, we locate the interference in the recording based on detect…

2017-02-08cs.SD

Wavelet speech enhancement based on nonnegative matrix factorization

National Taiwan University（台湾大学）；Academia Sinica（中央研究院）；National Institute of Information and Communications Technology（日本国立信息与通信技术研究所）；National Chi Nan University（暨南国际大学）

For most of the state-of-the-art speech enhancement techniques, a spectrogram is usually preferred than the respective time-domain raw data since it reveals more compact presentation together with conspicuous temporal information over a long time span. However, the short-time Fourier transform (STFT) that creates the spectrogram in general distorts the original signal and thereby limits the capability of the associated speech enhancement techniques. In this study, we propose a novel speech enhancement method that adopts the algorithms of discrete wavelet packet transform (DWPT) and nonnegative…

2016-01-11cs.SD

Joint Sound Source Separation and Speaker Recognition

KU Leuven（鲁汶大学）

Non-negative Matrix Factorization (NMF) has already been applied to learn speaker characterizations from single or non-simultaneous speech for speaker recognition applications. It is also known for its good performance in (blind) source separation for simultaneous speech. This paper explains how NMF can be used to jointly solve the two problems in a multichannel speaker recognizer for simultaneous speech. It is shown how state-of-the-art multichannel NMF for blind source separation can be easily extended to incorporate speaker recognition. Experiments on the CHiME corpus show that this method …

2016-04-29cs.LGcs.SD

Non-negative Matrix Factorization with Linear Constraints for Single-Channel Speech Enhancement

Moscow State University（莫斯科国立大学）；STEL - Computer Systems Ltd.（STEL计算机系统有限公司）

This paper investigates a non-negative matrix factorization (NMF)-based approach to the semi-supervised single-channel speech enhancement problem where only non-stationary additive noise signals are given. The proposed method relies on sinusoidal model of speech production which is integrated inside NMF framework using linear constraints on dictionary atoms. This method is further developed to regularize harmonic amplitudes. Simple multiplicative algorithms are presented. The experimental evaluation was made on TIMIT corpus mixed with various types of noise. It has been shown that the proposed…

2013-09-24cs.CLcs.SD