arXiv 1609.084092016-09-27cs.CLstat.ML

Modelling Radiological Language with Bidirectional Long Short-Term Memory Networks

Savelie Cornegruta, Robert Bakewell, Samuel Withey, Giovanni Montana

备注：: LOUHI 2016 conference proceedings

英文摘要：

Motivated by the need to automate medical information extraction from free-text radiological reports, we present a bi-directional long short-term memory (BiLSTM) neural network architecture for modelling radiological language. The model has been used to address two NLP tasks: medical named-entity recognition (NER) and negation detection. We investigate whether learning several types of word embeddings improves BiLSTM's performance on those tasks. Using a large dataset of chest x-ray reports, we compare the proposed model to a baseline dictionary-based NER system and a negation detection system that leverages the hand-crafted rules of the NegEx algorithm and the grammatical relations obtained from the Stanford Dependency Parser. Compared to these more traditional rule-based systems, we argue that BiLSTM offers a strong alternative for both our tasks.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

A Natural Language Processing Pipeline of Chinese Free-text Radiology Reports for Liver Cancer Diagnosis

School of Biomedical Engineering, Capital Medical University（首都医科大学生物医学工程学院）；Beijing Friendship Hospital, Capital Medical University（首都医科大学附属北京友谊医院）；Tsinghua University（清华大学）

Despite the rapid development of natural language processing (NLP) implementation in electronic medical records (EMRs), Chinese EMRs processing remains challenging due to the limited corpus and specific grammatical characteristics, especially for radiology reports. In this study, we designed an NLP pipeline for the direct extraction of clinically relevant features from Chinese radiology reports, which is the first key step in computer-aided radiologic diagnosis. The pipeline was comprised of named entity recognition, synonyms normalization, and relationship extraction to finally derive the rad…

2020-10-13cs.CL

Seq2Biseq: Bidirectional Output-wise Recurrent Neural Networks for Sequence Modelling

LIG（格勒诺布尔信息学实验室）；Lattice CNRS（法国国家科学研究中心Lattice实验室）；ALMAnaCH Inria（法国国家信息与自动化研究所ALMAnaCH）

During the last couple of years, Recurrent Neural Networks (RNN) have reached state-of-the-art performances on most of the sequence modelling problems. In particular, the "sequence to sequence" model and the neural CRF have proved to be very effective in this domain. In this article, we propose a new RNN architecture for sequence labelling, leveraging gated recurrent layers to take arbitrarily long contexts into account, and using two decoders operating forward and backward. We compare several variants of the proposed solution and their performances to the state-of-the-art. Most of our results…

2019-04-16cs.CLcs.LG

The Utility of General Domain Transfer Learning for Medical Language Tasks

Mount Sinai Health System（西奈山医疗系统）

The purpose of this study is to analyze the efficacy of transfer learning techniques and transformer-based models as applied to medical natural language processing (NLP) tasks, specifically radiological text classification. We used 1,977 labeled head CT reports, from a corpus of 96,303 total reports, to evaluate the efficacy of pretraining using general domain corpora and a combined general and medical domain corpus with a bidirectional representations from transformers (BERT) model for the purpose of radiological text classification. Model performance was benchmarked to a logistic regression …

2020-02-16cs.CLcs.LG

双向主题匹配：通过主题建模量化语料库间的主题重叠

Bidirectional Topic Matching: Quantifying Thematic Overlap Between Corpora Through Topic Modelling

University of Graz（格拉茨大学）；Department of Environmental Systems Sciences（环境系统科学系）

本文提出双向主题匹配（BTM）方法，通过双模型相互应用量化跨语料库主题重叠与分歧，验证显示其鲁棒且能处理异常主题，为多领域话语分析提供灵活精确的综合框架。

2024-12-24cs.CLcs.IR

Deep Recurrent Neural Networks for Acoustic Modelling

Carnegie Mellon University（卡内基梅隆大学）

We present a novel deep Recurrent Neural Network (RNN) model for acoustic modelling in Automatic Speech Recognition (ASR). We term our contribution as a TC-DNN-BLSTM-DNN model, the model combines a Deep Neural Network (DNN) with Time Convolution (TC), followed by a Bidirectional Long Short-Term Memory (BLSTM), and a final DNN. The first DNN acts as a feature processor to our model, the BLSTM then generates a context from the sequence acoustic signal, and the final DNN takes the context and models the posterior probabilities of the acoustic states. We achieve a 3.47 WER on the Wall Street Journ…

2015-04-07cs.CLcs.LGcs.NE

用于序列数据理解的双向长程解析器

Bidirectional Long-Range Parser for Sequential Data Understanding

Amazon Inc.（亚马逊公司）

本文提出通用注意力机制 BLRP，通过局部滑动窗口与全局双向潜在空间合成结合，提升长序列任务的性能与效率，并在 Long-Range-Arena 和 CIFAR 上验证其优势。

2024-04-08cs.CLcs.CVcs.LG

更多相关论文收起更多论文

Bidirectional Long-Short Term Memory for Video Description

University of Electronic Science and Technology（电子科技大学）；The University of Queensland（昆士兰大学）

Video captioning has been attracting broad research attention in multimedia community. However, most existing approaches either ignore temporal information among video frames or just employ local contextual temporal knowledge. In this work, we propose a novel video captioning framework, termed as \emph{Bidirectional Long-Short Term Memory} (BiLSTM), which deeply captures bidirectional global temporal structure in video. Specifically, we first devise a joint visual modelling approach to encode video data by combining a forward LSTM pass, a backward LSTM pass, together with visual features from …

2016-06-15cs.CLcs.MM

低资源口语语言理解的 bidirectional 表示

Bidirectional Representations for Low Resource Spoken Language Understanding

KU Leuven（鲁汶大学）

针对低资源口语语言理解，提出双向表示模型，利用掩码语言建模学习编码，通过类注意力模块提升意图预测性能，并在英语和荷兰语数据集上验证了有效性。

2023-10-14cs.CL

Syntax-Aware Aspect-Level Sentiment Classification with Proximity-Weighted Convolution Network

Beijing Institute of Technology（北京理工大学）；Zhejiang Lab（之江实验室）；University of Padua（帕多瓦大学）

It has been widely accepted that Long Short-Term Memory (LSTM) network, coupled with attention mechanism and memory module, is useful for aspect-level sentiment classification. However, existing approaches largely rely on the modelling of semantic relatedness of an aspect with its context words, while to some extent ignore their syntactic dependencies within sentences. Consequently, this may lead to an undesirable result that the aspect attends on contextual words that are descriptive of other aspects. In this paper, we propose a proximity-weighted convolution network to offer an aspect-specif…

2019-09-23cs.CL

BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

School of Computer Science, University of Sydney（悉尼大学计算机科学学院）；School of Information Technology, Deakin University（迪肯大学信息技术学院）

In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponentially. However, BioNER research is challenging as NER in the biomedical domain are: (i) often restricted due to limited amount of training data, (ii) an entity can refer to multiple types and concepts depending on its context and, (iii) heavy reliance on acronyms that are sub-domain specific. Existing BioNER approaches often neglect these issues and directly adopt the state-of-the…

2020-09-19cs.CL

RP-DNN: A Tweet level propagation context based deep neural networks for early rumor detection in Social Media

Early rumor detection (ERD) on social media platform is very challenging when limited, incomplete and noisy information is available. Most of the existing methods have largely worked on event-level detection that requires the collection of posts relevant to a specific event and relied only on user-generated content. They are not appropriate to detect rumor sources in the very early stages, before an event unfolds and becomes widespread. In this paper, we address the task of ERD at the message level. We present a novel hybrid neural network architecture, which combines a task-specific character…

2020-03-02cs.CLcs.IRcs.SI