arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.12880cs.AIcs.MM
收藏

多模态学习是否在医疗领域实现了通用智能?一项全面的综述

Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey

Saw Swee Hock School of Public Health, National University of Singapore(新加坡国立大学公共健康学院);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院)

Qika Lin, Yifan Zhu, Xin Mei, Ling Huang, Jingying Ma, Kai He, Zhen Peng, Erik Cambria, Mengling Feng

AI总结:

本文通过全面调查,指出当前多模态学习在医疗领域尚未实现通用智能,并提出十个潜在研究方向。

摘要:

人工智能的快速发展不断重塑智能医疗和医学领域。作为一种关键技术,多模态学习由于数据互补性、全面的建模形式和巨大的应用潜力,越来越受到关注。目前,众多研究者致力于该领域,进行了广泛的研究并构建了丰富的智能系统。自然地,一个开放性问题浮现:多模态学习是否在医疗领域实现了通用智能?为回答这个问题,我们采用三个独特的视角进行整体分析。首先,我们从数据集、任务导向方法和通用基础模型的角度对当前医学多模态学习的进展进行全面调查。基于这些,我们进一步从五个问题探讨先进技术在医疗领域的实际影响,从数据和技术到性能和伦理。结论是当前技术尚未实现通用智能,仍有显著的旅程需要完成。最后,基于上述综述和讨论,我们指出了十个潜在的研究方向,以实现医疗领域的通用智能。

英文摘要:

The rapid development of artificial intelligence has constantly reshaped the field of intelligent healthcare and medicine. As a vital technology, multimodal learning has increasingly garnered interest due to data complementarity, comprehensive modeling form, and great application potential. Currently, numerous researchers are dedicating their attention to this field, conducting extensive studies and constructing abundant intelligent systems. Naturally, an open question arises that has multimodal learning delivered universal intelligence in healthcare? To answer the question, we adopt three unique viewpoints for a holistic analysis. Firstly, we conduct a comprehensive survey of the current progress of medical multimodal learning from the perspectives of datasets, task-oriented methods, and universal foundation models. Based on them, we further discuss the proposed question from five issues to explore the real impacts of advanced techniques in healthcare, from data and technologies to performance and ethics. The answer is that current technologies have NOT achieved universal intelligence and there remains a significant journey to undertake. Finally, in light of the above reviews and discussions, we point out ten potential directions for exploration towards the goal of universal intelligence in healthcare.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑