Why Text Prevails: Vision May Undermine Multimodal Medical Decision Making
为何文本占上风:视觉可能损害多模态医疗决策制定
Siyuan Dai, Lunxiao Li, Kun Zhao, Eardi Lila, Paul K. Crane, Heng Huang, Dongkuan Xu, Haoteng Tang, Liang Zhan
机构
*
University of Texas Rio Grande Valley(德克萨斯大学里奥格兰德谷大学)
;
University of Pittsburgh(匹兹堡大学)
;
NC State University(北卡罗来纳州立大学)
;
University of Washington(华盛顿大学)
;
University of Maryland(马里兰大学)
专题命中
领域大模型
:large language model(abstract);language model(abstract);分类 cs.AI
TomoGraphView: 3D Medical Image Classification with Omnidirectional Slice Representations and Graph Neural Networks
TomoGraphView: 基于全方位切片表示和图神经网络的3D医学图像分类
Johannes Kiechle, Stefan M. Fischer, Daniel M. Lang, Cosmin I. Bercea, Matthew J. Nyflot, Lina Felsner, Julia A. Schnabel, Jan C. Peeken
机构
*
School of Computation, Information and Technology, Technical University of Munich(计算信息技术学院,慕尼黑技术大学)
;
Department of Radiation Oncology, TUM School of Medicine, TUM University Hospital rechts der Isar, Technical University of Munich(放射肿瘤学系,TUM医学院,TUM大学医院rechts der Isar,慕尼黑技术大学)
;
Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich(生物医学影像机器学习研究所,海德堡慕尼黑)
;
Institute of Radiation Medicine, Helmholtz Munich(放射医学研究所,海德堡慕尼黑)
;
School of Biomedical Engineering and Imaging Sciences, King's College London(生物医学工程与成像科学学院,伦敦国王学院)
;
Department of Radiation Oncology, University of Washington(放射肿瘤学系,华盛顿大学)
;
Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML))
机构
*
University of Michigan Computer Science and Engineering(密歇根大学计算机科学与工程系)
;
University of Michigan Neurosugery(密歇根大学神经外科)
;
University of Cologne Neurosugery(科隆大学神经外科)
;
University of Michigan Radiology(密歇根大学放射学)
;
University of Michigan Neurology(密歇根大学神经病学)
;
University of Michigan Computational Medicine and Bioinformatics(密歇根大学计算医学与生物信息学)
Dynamic Prompt Generation for Interactive 3D Medical Image Segmentation Training
动态提示生成用于交互式3D医学图像分割训练
Tidiane Camaret Ndir, Alexander Pfefferle, Robin Tibor Schirrmeister
机构
*
Medical Physics, Department of Diagnostic and Interventional Radiology, Medical Center—University of Freiburg, Faculty of Medicine, University of Freiburg(医学物理,诊断与介入放射科,弗赖堡大学医学中心,医学院,弗赖堡大学)
;
University of Freiburg(弗赖堡大学)
;
ELLIS Institute Tübingen(图宾根ELLIS研究所)
Multimodal Deep Learning for Stroke Prediction and Detection using Retinal Imaging and Clinical Data
基于视网膜成像和临床数据的多模态深度学习用于中风预测与检测
Saeed Shurrab, Aadim Nepal, Terrence J. Lee-St. John, Nicola G. Ghazi, Bartlomiej Piechowski-Jozwiak, Farah E. Shamout
机构
*
Division of Engineering, New York University Abu Dhabi(纽约大学阿布扎赫尔分校工程系)
;
Institute for Healthier Living Abu Dhabi(阿布扎赫尔健康生活研究所)
;
Eye Institute at Cleveland Clinic Abu Dhabi(阿布扎赫尔克利夫兰医学中心眼科研究所)
;
Canberra Hospital(堪培拉医院)
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness
MIMIR:基于互信息的对抗鲁棒性图像建模
Xiaoyun Xu, Shujian Yu, Zhuoran Liu, Stjepan Picek
机构
*
Radboud University Nijmegen(拉德博德大学尼姆维根分校)
;
Vrije Universiteit Amsterdam(自由大学阿姆斯特丹)
;
University of Zagreb Faculty of Electrical Engineering and Computing(Zagreb大学电子工程与计算学院)
Large language models are not about natural language
大语言模型并非关于自然语言
Johan J. Bolhuis, Andrea Moro, Stephen Crain, Sandiway Fong
机构
*
University of Cambridge, Department of Psychology(剑桥大学心理学系)
;
University School for Advanced Studies(高级研究大学)
;
Scuola Normale Superiore(规范大学)
;
Macquarie University, Department of Linguistics(麦考瑞大学语言学系)
;
University of Arizona, Department of Linguistics(亚利桑那大学语言学系)
专题命中
其他LLM
:large language model(title,abstract);language model(title,abstract);分类 cs.CL
SIGMMA: Hierarchical Graph-Based Multi-Scale Multi-modal Contrastive Alignment of Histopathology Image and Spatial Transcriptome
SIGMMA:基于层次图的多尺度多模态对比对齐:组织病理图像与空间转录组
Dabin Jeong, Amirhossein Vahidi, Ciro Ramírez-Suástegui, Marie Moullet, Kevin Ly, Mohammad Vali Sanian, Sebastian Birk, Yinshui Chang, Adam Boxall, Daniyal Jafree, Lloyd Steele, Vijaya Baskar MS, Muzlifah Haniffa, Mohammad Lotfollahi
机构
*
Wellcome Sanger Institute(沃森桑格研究所)
;
Cambridge Centre for AI in Medicine(剑桥人工智能医学中心)
;
Institute of AI for Health(人工智能与健康研究所)
;
Cambridge Stem Cell Institute(剑桥干细胞研究所)