arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.07112cs.CLcs.LG
收藏

生物医学文摘的分段:一个序列分类任务

Sectioning of Biomedical Abstracts: A Sequence of Sequence Classification Task

University of Delaware(特拉华大学)

Mehmet Efruz Karabulut, K. Vijay-Shanker

摘要:

生物医学文献的快速增长导致了生物医学文本挖掘领域的许多进展。在海量的信息中,生物医学文章摘要是最容易获取的信息来源。然而,以背景、目的、方法、结果和结论为分类的结构化摘要的数量仍然不多。序列句子分类任务的改进可以加快对生物医学摘要中有价值信息的探索。基于深度学习的模型在这项任务中取得重大成果方面具有很大的性能/潜力。然而,它们往往过于复杂,并过度拟合特定数据。在这个项目中,我们研究了一个最先进的深度学习模型,我们称之为SSN-4模型。我们调查的SSN-4模型的不同组成部分,研究性能和复杂性之间的权衡。我们探讨如何以及这个模型推广到一个新的数据集以外的随机对照试验(RCT)数据集。我们解决的问题是,词嵌入是否可以调整到任务,以提高性能。此外,我们开发了第二个模型,解决了第一个模型中的混淆对。结果表明,SSN-4模型似乎没有推广到RCT数据集之外。

英文摘要:

Rapid growth of the biomedical literature has led to many advances in the biomedical text mining field. Among the vast amount of information, biomedical article abstracts are the easily accessible sources. However, the number of the structured abstracts, describing the rhetorical sections with one of Background, Objective, Method, Result and Conclusion categories is still not considerable. Exploration of valuable information in the biomedical abstracts can be expedited with the improvements in the sequential sentence classification task. Deep learning based models has great performance/potential in achieving significant results in this task. However, they can often be overly complex and overfit to specific data. In this project, we study a state-of-the-art deep learning model, which we called SSN-4 model here. We investigate different components of the SSN-4 model to study the trade-off between the performance and complexity. We explore how well this model generalizes to a new data set beyond Randomized Controlled Trials (RCT) dataset. We address the question that whether word embeddings can be adjusted to the task to improve the performance. Furthermore, we develop a second model that addresses the confusion pairs in the first model. Results show that SSN-4 model does not appear to generalize well beyond RCT dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑