One of the key challenges in natural language processing (NLP) is to yield good performance across application domains and languages. In this work, we investigate the robustness of the mention detection systems, one of the fundamental tasks in information extraction, via recurrent neural networks (RNNs). The advantage of RNNs over the traditional approaches is their capacity to capture long ranges of context and implicitly adapt the word embeddings, trained on a large corpus, into a task-specific word representation, but still preserve the original semantic generalization to be helpful across domains. Our systematic evaluation for RNN architectures demonstrates that RNNs not only outperform the best reported systems (up to 9\% relative error reduction) in the general setting but also achieve the state-of-the-art performance in the cross-domain setting for English. Regarding other languages, RNNs are significantly better than the traditional methods on the similar task of named entity recognition for Dutch (up to 22\% relative error reduction).
Neural Collective Entity Linking Based on Recurrent Random Walk Network Learning
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Xiamen University(厦门大学);Rochester University(罗切斯特大学);Xiaomi AI Lab, Xiaomi Inc.(小米公司小米人工智能实验室)
Event Nugget Detection with Forward-Backward Recurrent Neural Networks
Oregon State University(俄勒冈州立大学)
传统的事件检测方法严重依赖于手动设计的丰富功能。最近的深度学习方法通过自动特征工程来缓解这个问题。但是,这些努力,像传统的方法,到目前为止只集中在单一的标记事件提到,而在实践中,事件也可以是一个短语。相反,我们使用前向-后向循环神经网络(FBRNN)来检测可能是单词或短语的事件。据我们所知,这是处理多词事件的首批努力之一,也是首次尝试使用RNN进行事件检测。实验结果表明,FBRNN在ACE 2005和Rich ERE 2015事件检测任务上与最先进的方法具有竞争力。
Improving Sequence Modeling Ability of Recurrent Neural Networks via Sememes
Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Beijing University of Posts and Telecommunications(北京邮电大学)
Waveform to Single Sinusoid Regression to Estimate the F0 Contour from Noisy Speech Using Recurrent Deep Neural Networks
University of Eastern Finland(东芬兰大学)
基频(F0)表示语音中的音高,其确定语音的韵律特征,并且在用于语音分析和合成的各种任务中是需要的。尽管对这一主题进行了数十年的研究,但在意外噪声条件下的低信噪比(SNR)下的F0估计仍然很困难。这项工作提出了一种新的方法,噪声鲁棒F0估计使用的递归神经网络(RNN)训练的监督方式。最近的研究采用深度神经网络(DNN)进行F0跟踪,作为量化频率状态的逐帧分类任务,但我们提出了波形到正弦曲线回归,以实现噪声鲁棒性和准确估计,同时提高频率分辨率。在加性噪声污染的PTDB-TUG语料库(NOISEX-92)上的实验结果表明,与著名的噪声鲁棒F0跟踪器PEFAC相比,该方法在信噪比为-10 dB ~+10 dB时,粗基音误差(GPE)率和细基音误差(FPE)率均提高了35%以上。此外,所提出的方法在先前SNR范围内的FPE和GPE速率方面也优于最先进的基于DNN的方法超过15%。