Large Language Models (LLMs) have become a pivotal research area, potentially making beneficial contributions in fields like healthcare where they can streamline automated billing and decision support. However, the frequent use of specialized coded languages like ICD-10, which are regularly updated and deviate from natural language formats, presents potential challenges for LLMs in creating accurate and meaningful latent representations. This raises concerns among healthcare professionals about potential inaccuracies or ``hallucinations" that could result in the direct impact of a patient. Therefore, this study evaluates whether large language models (LLMs) are aware of medical code ontologies and can accurately generate names from these codes. We assess the capabilities and limitations of both general and biomedical-specific generative models, such as GPT, LLaMA-2, and Meditron, focusing on their proficiency with domain-specific terminologies. While the results indicate that LLMs struggle with coded language, we offer insights on how to adapt these models to reason more effectively.
Universal Abstraction: Harnessing Frontier Models to Structure Real-World Data at Scale
Microsoft Research(微软研究院);Johns Hopkins University School of Medicine(约翰霍普金斯大学医学院);Providence Portland Medical Center(普罗维德波特医疗中心);Earle A. Chiles Research Institute(埃勒·A·奇尔斯研究所);Providence Research Network(普罗维德研究网络);Providence Genomics(普罗维德基因组学);The Oregon Clinic(俄勒冈诊所)
Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoning
The University of Tokyo(东京大学);ETH Zürich(苏黎世联邦理工学院);National Institute of Informatics(日本信息处理学会);Siriraj Informatics and Data Innovation Center(Siriraj信息与数据创新中心);Yale University(耶鲁大学)
MedKGent: A Large Language Model Agent Framework for Constructing Temporally Evolving Medical Knowledge Graph
Mohamed bin Zayed University of Artificial Intelligence(莫扎德大学人工智能学院);University of Chinese Academy of Sciences(中国科学院大学);Kyoto University(京都大学);Tsinghua University(清华大学);East China Normal University(华东师范大学);Center for Excellence in Brain Science and Intelligence Technology(脑科学与智能技术卓越中心);Brigham and Women’s Hospital, Harvard Medical School(哈佛医学院布里特妇女医院);GenBio AI
Caught in the Web of Words: Do LLMs Fall for Spin in Medical Literature?
Northeastern University, Boston, MA, USA(东北大学,波士顿,马萨诸塞州,美国);The University of Texas MD Anderson Cancer Center, Houston, Texas, USA(德克萨斯大学MD安德森癌症中心,休斯顿,德克萨斯州,美国);King’s College London, London, UK(伦敦国王学院,伦敦,英国);The University of Texas at Austin, Austin, Texas, USA(德克萨斯大学奥斯汀分校,奥斯汀,德克萨斯州,美国)
Lightweight Baselines for Medical Abstract Classification: DistilBERT with Cross-Entropy as a Strong Default
Independent Researcher(独立研究者);Duke University(杜克大学);Georgia Institute of Technology(佐治亚理工学院);University of Michigan(密歇根大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of California, Irvine(加州大学尔湾分校)
该研究在预算受限下比较 BERT base 与 DistilBERT 及三种损失,发现 DistilBERT 配合交叉熵是强默认基线,校准阈值可进一步改善部署性能。
Moving Beyond Medical Exams: A Clinician-Annotated Fairness Dataset of Real-World Tasks and Ambiguity in Mental Healthcare
Stanford University(斯坦福大学);University of Colorado(科罗拉多大学);Northwestern University(西北大学);University of Wisconsin(威斯康星大学);Yale School of Medicine(耶鲁医学院);University of Chicago(芝加哥大学);Ohio State University(俄亥俄州立大学)
Enhancing Abnormality Grounding for Vision Language Models with Knowledge Descriptions
Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Helmholtz AI(亥姆霍兹人工智能研究所);Helmholtz Munich(亥姆霍兹慕尼黑中心);Imperial College London(伦敦帝国学院);King’s College London(伦敦国王学院)
Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training
Shenzhen Research Institute of Big Data(深圳大数据研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Sun Yat-sen University(中山大学);Pazhou Lab(琶洲实验室)
This Treatment Works, Right? Evaluating LLM Sensitivity to Patient Question Framing in Medical QA
Northeastern University(东北大学);UC Berkeley(加州大学伯克利分校);UT Austin(德克萨斯大学奥斯汀分校);UT MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心);Georgia Institute of Technology(佐治亚理工学院)