The extraction of relevant data from Electronic Health Records (EHRs) is crucial to identifying symptoms and automating epidemiological surveillance processes. By harnessing the vast amount of unstructured text in EHRs, we can detect patterns that indicate the onset of disease outbreaks, enabling faster, more targeted public health responses. Our proposed framework provides a flexible and efficient solution for mining data from unstructured texts, significantly reducing the need for extensive manual labeling by specialists. Experiments show that our framework achieving strong performance with as few as 200 manually labeled texts, even for complex classification problems. Additionally, our approach can function with simple lightweight models, achieving competitive and occasionally even better results compared to more resource-intensive deep learning models. This capability not only accelerates processing times but also preserves patient privacy, as the data can be processed on weaker on-site hardware rather than being transferred to external systems. Our methodology, therefore, offers a practical, scalable, and privacy-conscious approach to real-time epidemiological monitoring, equipping health institutions to respond rapidly and effectively to emerging health threats.
A Hybrid Supervised-LLM Pipeline for Actionable Suggestion Mining in Unstructured Customer Reviews
Department of Computer Science & Information Systems, Birla Institute of Technology and Science, Pilani, India(印度比拉理工学院计算机科学与信息系统系);Birdeye Inc.(Birdeye公司)
Mining Reasons For And Against Vaccination From Unstructured Data Using Nichesourcing and AI Data Augmentation
Universidad de Buenos Aires(布宜诺斯艾利斯大学);Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET)(国家科学技术研究委员会(CONICET));Ludwig-Maximilians-Universität München(慕尼黑大学);Quantit;Universidad Torcuato Di Tella(托库阿托·迪·特拉大学)
Knowledge mining of unstructured information: application to cyber-domain
Aalto University School of Science(阿尔托大学理学院);University of Jyväskylä(于韦斯屈莱大学);Cyberwatch Finland Oy(芬兰Cyberwatch公司);The Alan Turing Institute(艾伦·图灵研究所)
Finding Hidden Relationships Between Medical Concepts by Leveraging Metamap and Text Mining Techniques
Department of Computer Science, North Dakota State University(北达科塔州立大学计算机科学系);Department of Computer Science and Engineering, Daffodil International University(达芙妮国际大学计算机科学与工程系);Department of Computer Science and Engineering, University of North Texas(德克萨斯大学诺丁汉分校计算机科学与工程系)
Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Data
University of California San Diego(加州大学圣迭戈分校);Columbia University(哥伦比亚大学);Brandeis University(布兰迪斯大学);New York University(纽约大学);North Carolina State University(北卡罗来纳州立大学)
A foundation model for human-AI collaboration in medical literature mining
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);National Library of Medicine, National Institutes of Health(美国国立卫生研究院国家医学图书馆);National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health(美国国立卫生研究院国家糖尿病、消化和肾脏疾病研究所);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);National Eye Institute, National Institutes of Health(美国国立卫生研究院国家眼科研究所);Northwestern University Feinberg School of Medicine(西北大学费恩伯格医学院);Chungbuk National University Hospital(忠北国立大学医院);Chungbuk National University College of Medicine(忠北国立大学医学院);University of Pittsburgh Medical Center(匹兹堡大学医学中心);Weill Cornell Medicine(威尔康奈尔医学院);UT Southwestern Medical Center(德克萨斯大学西南医学中心);University of Washington(华盛顿大学);NYU Langone Health(纽约大学朗格尼健康中心);OSF HealthCare Illinois Neurological Institute(OSF医疗保健伊利诺伊神经研究所)
MIRIAD: Augmenting LLMs with millions of medical query-response pairs
Department of Biosystems Science and Engineering, ETH Zurich(生物系统科学与工程系,苏黎世联邦理工学院);Department of Computer Science, Stanford University(计算机科学系,斯坦福大学);Department of Internal Medicine, Mayo Clinic(内科医学系,梅奥诊所);Hugging Face;Department of Radiology, Stanford University(放射学系,斯坦福大学);Hasso-Plattner-Institute for Digital Engineering, University of Potsdam(数字工程研究所,波茨坦大学);Center for Artificial Intelligence in Medicine and Imaging, Stanford, CA, USA(医学与成像人工智能中心,斯坦福,CA,美国);Scripps Translational Science Institute, San Diego, CA, USA(斯克里普斯转化科学研究所,圣地亚哥,CA,美国)
Convolutional Neural Networks for Medical Diagnosis from Admission Notes
Petuum Inc.(Petuum 公司);Department of Psychiatry, University of Pittsburgh Medical Center(匹兹堡大学医学中心精神科)
$\textbf{Objective}$开发一种自动诊断系统,该系统仅使用电子健康记录(EHR)中的文本入院信息,并通过及时且经统计学验证的决策工具协助临床医生。希望该工具可以用于减少误诊。$\textbf{Materials and Methods}$我们使用来自MIMIC-III的真实世界临床记录,这是一个免费提供的数据集,由2001年至2012年期间在贝斯以色列女执事医疗中心重症监护室住院的4万多名患者的临床数据组成。我们提出了一个卷积神经网络模型,从非结构化文本输入中学习语义特征,并自动预测初次出院诊断。$\textbf{Results}$提出的模型在10种最常见的疾病类别上实现了96.11%的总体准确性和80.48%的加权F1评分值,在加权F1评分方面显著优于4个强基线模型至少12.7%。$\textbf{Discussion}$实验结果表明,CNN模型适用于在存在复杂、噪声和非结构化临床数据的情况下支持诊断决策,同时使用比其他传统深度网络模型更少的层和参数。$\textbf{Conclusion}$我们的模型证明了从非结构化的临床笔记中代表复杂的医学有意义的特征的能力,以及对常见误诊的常见疾病的预测能力。它可以很容易地在临床环境中使用,以提供及时和统计证明的决策支持。$\textbf{Keywords}$卷积神经网络、文本分类、出院诊断预测、来自EHR的入院信息。
Exploring Diseases and Syndromes in Neurology Case Reports from 1955 to 2017 with Text Mining
Davis College(戴维斯学院);College of Information and Communications, University of South Carolina(南卡罗来纳大学信息与传播学院);Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);School of Medicine, University of South Carolina(南卡罗来纳大学医学院);University of South Carolina(南卡罗来纳大学)
Prediction Using Note Text: Synthetic Feature Creation with word2vec
Providence Health & Services(普罗维登斯健康与服务)
word2vec提供了一种从非结构化文本数据中提取定量变量的简单而强大的方法。超过一半的医疗数据是非结构化的,因此如果没有数据工程和自然语言处理方面的专业知识,就很难建模。word2vec可以作为一个桥梁,从这些数据源中快速收集情报。在这项研究中,我们通过word2vec运行了来自Providence Health & Services电子病历的650兆字节的非结构化医疗图表笔记。我们使用了两种不同的方法来创建预测变量,并对COPD(慢性阻塞性肺疾病)患者的再入院风险进行了测试。作为比较基准,我们使用LACE风险模型(基于住院时间、敏锐度、共病状况和急诊科就诊的单一评分)进行了相同的测试。仅使用自由文本和数学可能性,我们发现word2vec在预测COPD患者再入院风险方面与LACE相当。
P-Transformer: A Prompt-based Multimodal Transformer Architecture For Medical Tabular Data
Saw Swee Hock School of Public Health, National University of Singapore(新加坡国立大学苏瑞福公共卫生学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究院);Singapore General Hospital(新加坡综合医院)
Cross-institution text mining to uncover clinical associations: a case study relating social factors and code status in intensive care medicine
Bakar Computational Health Sciences Institute, University of California, San Francisco(加州大学旧金山分校巴卡尔计算健康科学研究所);Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University(乌得勒支大学医学中心尤利乌斯健康科学与初级保健中心)
Representation Learning of Structured Data for Medical Foundation Models
ASUS Intelligent Cloud Services (AICS)(华硕智能云服务(AICS));Imperial College London(伦敦帝国学院);University of Manchester(曼彻斯特大学);Cheng Hsin General Hospital(程新总医院);Crayon Software(克雷扬软件公司)
Exploring Optimal Granularity for Extractive Summarization of Unstructured Health Records: Analysis of the Largest Multi-Institutional Archive of Health Records in Japan
Tokyo Metropolitan University(东京都立大学);RIKEN(理化学研究所);National Hospital Organization(国立医院机构);Kitami Institute of Technology(北见工业大学)
An Empirical Analysis for Zero-Shot Multi-Label Classification on COVID-19 CT Scans and Uncurated Reports
ARTORG Center for Biomedical Engineering Research(ARTORG生物医学工程研究中心);University of Bern(伯尔尼大学);Bern University Hospital(伯尔尼大学医院);Lindenhofspital(林登霍夫医院);Campus Stiftung Lindenhof Bern(伯尔尼林登霍夫基金会校区)
Mining Social Determinants of Health for Heart Failure Patient 30-Day Readmission via Large Language Model
Department of Computer Science, Emory University(计算机科学系,埃默里大学);Nell Hodgson Woodruff School of Nursing, Emory University(Nell Hodgson Woodruff护理学院,埃默里大学)