arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.13779cs.CLcs.LG
收藏

从生物医学文献中自动挖掘实验方法

Automated Text Mining of Experimental Methodologies from Biomedical Literature

School of Computing Science, University of Newcastle(纽卡斯尔大学计算科学学院)

Ziqing Guo

AI总结:

本工作提出微调的DistilBERT预训练生成式分类语言模型,用于从生物医学文献中挖掘实验方法,相比传统RNN或LSTM方法表现更优,模型尺寸减小40%且速度提升60%。

摘要:

生物医学是一个快速发展的科技领域。生物医学文本分类是生物医学研究的重要组成部分,尤其在生物学领域。本工作提出了微调的DistilBERT,这是一个特定于方法的预训练生成式分类语言模型,用于挖掘生物医学文本。该模型证明了其在语言理解能力方面的有效性,并将BERT模型的尺寸减少了40%,同时速度快了60%。本项目的主要目标是改进模型,并评估其与非微调模型相比的性能。我们使用DistilBert作为支持模型,并在包含32,000篇摘要和完整文本文章的语料库上进行预训练;我们的结果令人印象深刻,通过使用RNN或LSTM超越了传统的文献分类方法。我们的目标是将这个高度专业化和特定的模型整合到不同的研究行业中。

英文摘要:

Biomedical literature is a rapidly expanding field of science and technology. Classification of biomedical texts is an essential part of biomedicine research, especially in the field of biology. This work proposes the fine-tuned DistilBERT, a methodology-specific, pre-trained generative classification language model for mining biomedicine texts. The model has proven its effectiveness in linguistic understanding capabilities and has reduced the size of BERT models by 40\% but by 60\% faster. The main objective of this project is to improve the model and assess the performance of the model compared to the non-fine-tuned model. We used DistilBert as a support model and pre-trained on a corpus of 32,000 abstracts and complete text articles; our results were impressive and surpassed those of traditional literature classification methods by using RNN or LSTM. Our aim is to integrate this highly specialised and specific model into different research industries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑