arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.04372cs.CLcs.LGstat.ML
收藏

利用保形主动学习挖掘非结构化医学文本

Mining Unstructured Medical Texts With Conformal Active Learning

Juliano Genari, Guilherme Tegoni Goedert

AI总结:

本文提出一种基于保形主动学习的框架,用于从电子健康记录的非结构化文本中高效挖掘数据,仅需约200条人工标注即可取得强劲性能,并能以轻量级模型实现隐私友好、可扩展的实时流行病学监测。

摘要:

从电子健康记录(EHRs)中提取相关数据对于识别症状和自动化流行病学监测流程至关重要。通过利用EHRs中大量的非结构化文本,我们能够检测出指示疾病暴发初期的模式,从而实现更快、更有针对性的公共卫生响应。我们提出的框架为从非结构化文本中挖掘数据提供了一种灵活且高效的解决方案,显著减少了对专家进行大量人工标注的需求。实验表明,即使对于复杂的分类问题,我们的框架在仅使用200条人工标注文本的情况下也能取得强劲性能。此外,我们的方法可以与简单的轻量级模型配合使用,与资源密集型的深度学习模型相比,能够取得具有竞争力甚至偶尔更优的结果。这一能力不仅加快了处理速度,还保护了患者隐私,因为数据可以在较弱的本地硬件上处理,而无需传输到外部系统。因此,我们的方法为实时流行病学监测提供了一种实用、可扩展且注重隐私的途径,使卫生机构能够快速有效地应对新出现的健康威胁。

英文摘要:

The extraction of relevant data from Electronic Health Records (EHRs) is crucial to identifying symptoms and automating epidemiological surveillance processes. By harnessing the vast amount of unstructured text in EHRs, we can detect patterns that indicate the onset of disease outbreaks, enabling faster, more targeted public health responses. Our proposed framework provides a flexible and efficient solution for mining data from unstructured texts, significantly reducing the need for extensive manual labeling by specialists. Experiments show that our framework achieving strong performance with as few as 200 manually labeled texts, even for complex classification problems. Additionally, our approach can function with simple lightweight models, achieving competitive and occasionally even better results compared to more resource-intensive deep learning models. This capability not only accelerates processing times but also preserves patient privacy, as the data can be processed on weaker on-site hardware rather than being transferred to external systems. Our methodology, therefore, offers a practical, scalable, and privacy-conscious approach to real-time epidemiological monitoring, equipping health institutions to respond rapidly and effectively to emerging health threats.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑