arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.18472cs.LG
收藏

从临床记录中检测转移灶的参数高效方法

Parameter-Efficient Methods for Metastases Detection from Clinical Notes

Memorial Sloan Kettering Cancer Center(纪念斯隆凯特琳癌症中心)

Maede Ashofteh Barabadi, Xiaodan Zhu, Wai Yip Chan, Amber L. Simpson, Richard K. G. Do

AI总结:

本文提出利用自监督通用语言模型、半监督自动标注和多任务迁移学习三种参数高效方法,从CT报告中自动检测肝转移,最佳模型F1达73.8%。

摘要:

理解癌症进展对于确定患者治疗方案至关重要。本研究的目标是从自由格式的计算机断层扫描(CT)放射学报告中自动检测转移性肝病。我们的研究表明,使用三种方法进行知识迁移可以提升模型性能。首先,我们利用以自监督方式预训练的通用语言模型(LMs)。其次,我们采用半监督方法,通过自动标注大规模未标注数据集来训练模型;该方法显著增强了模型性能。最后,我们通过设计多任务迁移学习方法,从相关任务中迁移知识。我们利用参数高效的语言模型适配策略的最新进展来提升性能和训练效率。我们的数据集包含纪念斯隆凯特琳癌症中心(MSKCC)在12年间收集的CT报告。领域专家手动标注了2,641份报告;其中841份报告被标注了是否存在肝转移。我们最佳模型的F1分数达到73.8%,精确率为84%,召回率为65.8%。

英文摘要:

Understanding the progression of cancer is crucial for defining treatments for patients. The objective of this study is to automate the detection of metastatic liver disease from free-style computed tomography (CT) radiology reports. Our research demonstrates that transferring knowledge using three approaches can improve model performance. First, we utilize generic language models (LMs), pretrained in a self-supervised manner. Second, we use a semi-supervised approach to train our model by automatically annotating a large unlabeled dataset; this approach substantially enhances the model's performance. Finally, we transfer knowledge from related tasks by designing a multi-task transfer learning methodology. We leverage the recent advancement of parameter-efficient LM adaptation strategies to improve performance and training efficiency. Our dataset consists of CT reports collected at Memorial Sloan Kettering Cancer Center (MSKCC) over the course of 12 years. 2,641 reports were manually annotated by domain experts; among them, 841 reports have been annotated for the presence of liver metastases. Our best model achieved an F1-score of 73.8%, a precision of 84%, and a recall of 65.8%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑