医学 AI

MTCMB: A Multi-Task Benchmark Framework for Evaluating LLMs on Knowledge, Reasoning, and Safety in Traditional Chinese Medicine

Shufeng Kong, Xingru Yang, Yuanyuan Wei, Zijie Wang, Hao Tang, Jiuqi Qin, Shuting Lan, Yingheng Wang, Junwen Bai, Zhuangbin Chen, Zibin Zheng, Caihua Liu, Hao Liang

机构 * School of Software Engineering, Sun Yat-sen University（中山大学软件学院） ； Institute of TCM Diagnostics, Hunan University of Chinese Medicine（湖南中医药大学中医诊断研究所） ； School of Artificial Intelligence, Guilin University of Electronic Technology（桂林电子科技大学人工智能学院） ； Department of Computer Science, Cornell University（康奈尔大学计算机科学系） 纠错

专题命中 医学数据与评测 ：medical AI(abstract)

Robust Privacy Amidst Innovation with Large Language Models Through a Critical Assessment of the Risks

Yao-Shun Chuang, Atiquer Rahman Sarkar, Yu-Chun Hsu, Noman Mohammed, Xiaoqian Jiang

专题命中 医学数据与评测 ：biomedical(abstract)

Comments 13 pages, 4 figures, 1 table, 1 supplementary, under review

Journal ref Journal of the American Medical Informatics Association, Volume 32, Issue 5, May 2025, Pages 885-892

SkillVerse : Assessing and Enhancing LLMs with Tree Evaluation

Yufei Tian, Jiao Sun, Nanyun Peng, Zizhao Zhang

机构 * University of California, Los Angeles（加州大学洛杉矶分校） ； Google DeepMind（谷歌DeepMind） ； Google Cloud AI（谷歌云AI） 纠错

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments Accepted to ACL 2025

Large Language Model-Based Agents for Automated Research Reproducibility: An Exploratory Study in Alzheimer's Disease

Nic Dobbins, Christelle Xiong, Kristine Lan, Meliha Yetisgen

机构 * Biomedical Informatics & Data Science, Johns Hopkins University（约翰霍普金斯大学生物医学信息学与数据科学） ； Biomedical & Health Informatics, University of Washington（华盛顿大学生物医学与健康信息学） 纠错

专题命中 医学数据与评测 ：biomedical(abstract)

Subtle Risks, Critical Failures: A Framework for Diagnosing Physical Safety of LLMs for Embodied Decision Making

Yejin Son, Minseo Kim, Sungwoong Kim, Seungju Han, Jian Kim, Dongju Jang, Youngjae Yu, Chanyoung Park

机构 * Yonsei University（延世大学） ； Stanford University（斯坦福大学） ； University of Washington, Seattle WA（华盛顿大学） 纠错

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments 37 pages, 13 tables, 6 figures

Architectural Vulnerability and Reliability Challenges in AI Text Annotation: A Survey-Inspired Framework with Independent Probability Assessment

Linzhuo li

专题命中 医学数据与评测 ：biomedical(abstract)

Comments 7 figures

Tianyi: A Traditional Chinese Medicine all-rounder language model and its Real-World Clinical Practice

Zhi Liu, Tao Yang, Jing Wang, Yexin Chen, Zhan Gao, Jiaxi Yang, Kui Chen, Bingji Lu, Xiaochen Li, Changyong Luo, Yan Li, Xiaohong Gu, Peng Cao

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments 23 pages, 4 figures, and 1 tables

CorBenchX: Large-Scale Chest X-Ray Error Dataset and Vision-Language Model Benchmark for Report Error Correction

Jing Zou, Qingqiu Li, Chenyu Lian, Lihao Liu, Xiaohan Yan, Shujun Wang, Jing Qin

机构 * Center for Smart Health, The Hong Kong Polytechnic University（智能健康中心，香港理工大学） ； School of Computer Science, Fudan University（复旦大学计算机科学学院） ； Amazon（亚马逊） ； Tongji University（同济大学） ； Department of Biomedical Engineering, The Hong Kong Polytechnic University（生物医学工程系，香港理工大学） ； Research Institute for Smart Ageing, The Hong Kong Polytechnic University（智能老龄化研究 institute，香港理工大学） 纠错

专题命中 医学数据与评测 ：radiology(abstract)

Comments 12 pages, 5figures

Protecting Privacy in Software Logs: What Should Be Anonymized?

Roozbeh Aghili, Heng Li, Foutse Khomh

专题命中 医学数据与评测 ：diagnosis(abstract)

Privacy Challenges In Image Processing Applications

Maneesha, Bharat Gupta, Rishabh Sethi, Charvi Adita Das

专题命中 医学数据与评测 ：medical image(abstract)

Comments 19 pages, 3 figures

Towards Better Multi-task Learning: A Framework for Optimizing Dataset Combinations in Large Language Models

Zaifu Zhan, Rui Zhang

机构 * Department of Electrical and Computer Engineering, University of Minnesota（电气与计算机工程系，明尼苏达大学） ； Division of Computational Health Sciences, Department of Surgery, University of Minnesota（计算健康科学部，外科系，明尼苏达大学） 纠错

专题命中 医学数据与评测 ：biomedical(abstract)

Comments 14 pages, 5 figures, 4 tables

Journal ref Findings of the Association for Computational Linguistics: NAACL 2025

HRScene: How Far Are VLMs from Effective High-Resolution Image Understanding?

Yusen Zhang, Wenliang Zheng, Aashrith Madasu, Peng Shi, Ryo Kamoi, Hao Zhou, Zhuoyang Zou, Shu Zhao, Sarkar Snigdha Sarathi Das, Vipul Gupta, Xiaoxin Lu, Nan Zhang, Ranran Haoran Zhang, Avitej Iyer, Renze Lou, Wenpeng Yin, Rui Zhang

机构 * Penn State University（宾夕法尼亚州立大学） 纠错

专题命中 医学数据与评测 ：radiology(abstract)

Comments 22 pages, 8 figures

EMRModel: A Large Language Model for Extracting Medical Consultation Dialogues into Structured Medical Records

Shuguang Zhao, Qiangzhong Feng, Zhiyang He, Peipei Sun, Yingying Wang, Xiaodong Tao, Xiaoliang Lu, Mei Cheng, Xinyue Wu, Yanyan Wang, Wei Liang

机构 * Taihe County People’s Hospital（太和县人民医院） ； Innovation + Research Institute（创新+研究院） ； GuoChuang Cloud Technology Ltd（国创云科技有限公司） ； Xunfei Healthcare Technology Ltd（讯飞医疗科技有限公司） ； University of Southern California（南加州大学） ； The First Affiliated Hospital of Anhui Medical University（安徽医科大学第一附属医院） 纠错

专题命中 医学数据与评测 ：diagnosis(abstract)

Automatically Detecting Numerical Instability in Machine Learning Applications via Soft Assertions

Shaila Sharmin, Anwar Hossain Zahid, Subhankar Bhattacharjee, Chiamaka Igwilo, Miryung Kim, Wei Le

专题命中 医学数据与评测 ：MRI(abstract)

Comments 22 pages, 5 figures. Accepted at FSE 2025

Benchmarking Next-Generation Reasoning-Focused Large Language Models in Ophthalmology: A Head-to-Head Evaluation on 5,888 Items

Minjie Zou, Sahana Srinivasan, Thaddaeus Wai Soon Lo, Ke Zou, Gabriel Dawei Yang, Xuguang Ai, Hyunjae Kim, Maxwell Singer, Fares Antaki, Kelvin Li, Robert Chang, Marcus Tan, David Ziyou Chen, Dianbo Liu, Qingyu Chen, Yih Chung Tham

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments 83 pages, 6 figures, 3 tables, 9 supplementary figures, 7 supplementary tables

Comparative Analysis of Quantum Support Vector Machines and Variational Quantum Classifiers for B-cell Epitope Prediction in Vaccine Design

Chi-Chuan Hwang, Cheng-Fang Su, Yi-Ang Hong

专题命中 医学数据与评测 ：biomedical(abstract)

Comments 16 pages, 6 figures, 13 tables

MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs

Juncheng Wu, Wenlong Deng, Xingxuan Li, Sheng Liu, Taomian Mi, Yifan Peng, Ziyang Xu, Yi Liu, Hyunjin Cho, Chang-In Choi, Yihan Cao, Hui Ren, Xiang Li, Xiaoxiao Li, Yuyin Zhou

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments 18 pages, 11 figures, 6 tables. Project page: https://github.com/UCSC-VLAA/MedReason

TheBlueScrubs-v1, a comprehensive curated medical dataset derived from the internet

Luis Felipe, Carlos Garcia, Issam El Naqa, Monique Shotande, Aakash Tripathi, Vivek Rudrapatna, Ghulam Rasool, Danielle Bitterman, Gilmer Valdes

专题命中 医学数据与评测 ：medical AI(abstract)

Comments 22 pages, 8 figures, 10 tables

Pareto-Optimized Open-Source LLMs for Healthcare via Context Retrieval

Jordi Bayarri-Planas, Ashwin Kumar Gururajan, Dario Garcia-Gasulla

专题命中 医学数据与评测 ：healthcare AI(abstract)

Comments 14 pages, 3 figures, 5 tables, Accepted for publication at the 21st International Conference on Artificial Intelligence Applications and Innovations (AIAI 2025)

Privacy-Preserving Edge Computing from Pairing-Based Inner Product Functional Encryption

Utsav Banerjee

专题命中 医学数据与评测 ：biomedical(abstract)

Comments Published in 2023 IEEE Global Communications Conference (GLOBECOM)

Journal ref IEEE GLOBECOM (2023) 2184-2189

RECKON: Large-scale Reference-based Efficient Knowledge Evaluation for Large Language Model

Lin Zhang, Zhouhong Gu, Xiaoran Shi, Hongwei Feng, Yanghua Xiao

专题命中 医学数据与评测 ：biomedical(abstract)

AlpaCare:Instruction-tuned Large Language Models for Medical Application

Xinlu Zhang, Chenxin Tian, Xianjun Yang, Lichang Chen, Zekun Li, Linda Ruth Petzold

专题命中 医学数据与评测 ：biomedical(abstract)

Is Journal Citation Indicator a good metric for Art & Humanities Journals currently?

Yu Liao, Li Li, Zhesi Shen

专题命中 医学数据与评测 ：CT(abstract)

Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judge

Heegyu Kim, Taeyang Jeon, Seungtaek Choi, Ji Hoon Hong, Dong Won Jeon, Ga-Yeon Baek, Gyeong-Won Kwak, Dong-Hee Lee, Jisu Bae, Chihoon Lee, Yunseo Kim, Seon-Jin Choi, Jin-Seong Park, Sung Beom Cho, Hyunsouk Cho

专题命中 医学数据与评测 ：biomedical(abstract)

Comments under review

FlakeRanker: Automated Identification and Prioritization of Flaky Job Failure Categories

Henri Aïdasso

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments Artifact awarded the Reusable badge at the 47th International Conference on Software Engineering - ICSE 2025 Artifact Evaluation Track

Secure On-Device Video OOD Detection Without Backpropagation

Shawn Li, Peilin Cai, Yuxiao Zhou, Zhiyu Ni, Renjie Liang, You Qin, Yi Nian, Zhengzhong Tu, Xiyang Hu, Yue Zhao

专题命中 医学数据与评测 ：diagnosis(abstract)

Evaluating Large Language Models on the Spanish Medical Intern Resident (MIR) Examination 2024/2025:A Comparative Analysis of Clinical Reasoning and Knowledge Application

Carlos Luengo Vera, Ignacio Ferro Picon, M. Teresa del Val Nunez, Jose Andres Gomez Gandia, Antonio de Lucas Ancillo, Victor Ramos Arroyo, Carlos Milan Figueredo

专题命中 医学数据与评测 ：medical AI(abstract)

Comments 26 pages, 1 table, 7 figures

An Evaluation Benchmark for Adverse Drug Event Prediction from Clinical Trial Results

Anthony Yazdani, Alban Bornet, Philipp Khlebnikov, Boya Zhang, Hossein Rouhizadeh, Poorya Amini, Douglas Teodoro

专题命中 医学数据与评测 ：CT(abstract)

Tgea: An error-annotated dataset and benchmark tasks for text generation from pretrained language models

Jie He, Bo Peng, Yi Liao, Qun Liu, Deyi Xiong

专题命中 医学数据与评测 ：diagnosis(abstract)

Comments ACL 2021

EchoQA: A Large Collection of Instruction Tuning Data for Echocardiogram Reports

Lama Moukheiber, Mira Moukheiber, Dana Moukheiiber, Jae-Woo Ju, Hyung-Chul Lee

专题命中 医学数据与评测 ：biomedical(abstract)

Comments NeurIPS SafeGenAI 2024