Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey
Saw Swee Hock School of Public Health, National University of Singapore(新加坡国立大学公共健康学院);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院)
Qika Lin, Yifan Zhu, Xin Mei, Ling Huang, Jingying Ma, Kai He, Zhen Peng, Erik Cambria, Mengling Feng
The rapid development of artificial intelligence has constantly reshaped the field of intelligent healthcare and medicine. As a vital technology, multimodal learning has increasingly garnered interest due to data complementarity, comprehensive modeling form, and great application potential. Currently, numerous researchers are dedicating their attention to this field, conducting extensive studies and constructing abundant intelligent systems. Naturally, an open question arises that has multimodal learning delivered universal intelligence in healthcare? To answer the question, we adopt three unique viewpoints for a holistic analysis. Firstly, we conduct a comprehensive survey of the current progress of medical multimodal learning from the perspectives of datasets, task-oriented methods, and universal foundation models. Based on them, we further discuss the proposed question from five issues to explore the real impacts of advanced techniques in healthcare, from data and technologies to performance and ethics. The answer is that current technologies have NOT achieved universal intelligence and there remains a significant journey to undertake. Finally, in light of the above reviews and discussions, we point out ten potential directions for exploration towards the goal of universal intelligence in healthcare.
Artificial Intelligence in Healthcare: Lost In Translation?
QUEST-Center for Transforming Biomedical Research, Berlin Institute of Health(柏林卫生研究所QUEST转化生物医学研究中心);Charité Universitätsmedizin Berlin(柏林夏里特医学院);CLAIM - Charité Lab for AI in Medicine(夏里特医学人工智能实验室(CLAIM));School of Computing and Digital Technology, Faculty of Computing, Engineering and the Built Environment, Birmingham City University(伯明翰城市大学计算、工程与建筑环境学院计算与数字技术系)
Data Ethics in the Era of Healthcare Artificial Intelligence in Africa: An Ubuntu Philosophy Perspective
Stanford Center for Biomedical Ethics, Stanford University(斯坦福大学生物医学伦理中心);Department of Bioethics and Interdisciplinary Studies, Brody School of Medicine, East Carolina University(东卡罗来纳大学布罗迪医学院生物伦理与跨学科研究系);Department of Biomedical Data Science, Stanford University(斯坦福大学生物医学数据科学系);Department of Bioengineering, Stanford University(斯坦福大学生物工程系);Department of Genetics, Stanford University(斯坦福大学遗传学系);Department of Medicine, Stanford University(斯坦福大学医学系)
本文针对西方医疗 AI 数据伦理框架忽视非洲文化与殖民历史的问题,从 Ubuntu 哲学出发比较个人主义与社群主义路径,提出面向非洲的医疗数据伦理框架。
Can Artificial Intelligence Support Healthcare and Mental Health Through Early Cyberbullying Detection ? The Impact of Emotion-Aware AI on Proactive Online Safety
Faculty of Computer Science, University of New Brunswick(新不伦瑞克大学计算机科学学院);Khoury College of Computer Sciences, Northeastern University(东北大学库里计算机科学学院)
Measuring Outcomes in Healthcare Economics using Artificial Intelligence: with Application to Resource Management
George Mason University(乔治梅森大学);Virginia Polytechnic Institute and State University(弗吉尼亚理工学院暨州立大学);Brigham and Women’s Hospital, Harvard Medical School(哈佛医学院布莱根妇女医院)
"We'll have to see how it works": An interview study to understand collaborative practices in interdisciplinary artificial intelligence and healthcare research
William Harvey Research Institute(威廉·哈维研究所);Queen Mary University of London(伦敦玛丽女王大学);Wolfson Institute of Population Health(沃尔夫森人口健康研究所)
MedBuild AI: An Agent-Based Hybrid Intelligence Framework for Reshaping Agency in Healthcare Infrastructure Planning through Generative Design for Medical Architecture
School of Architecture and Urban Planning, Beijing University of Civil Engineering and Architecture(北京建筑大学建筑与城市规划学院)
A Brief Review of Explainable Artificial Intelligence in Healthcare
Dalhousie University(达尔豪斯大学);Deakin University(迪肯大学);TU Wien University(维也纳技术大学);University of Kotli Azad Jammu and Kashmir(科特利阿扎德查谟和克什米尔大学);Dibrugarh University(迪布鲁格尔大学);Al-Balqa Applied University(巴尔卡应用大学);The University of Jordan(约旦大学);University of Granada(格拉纳达大学);Jan Evangelista Purkyně University in Ústí nad Labem(拉贝河畔乌斯季扬·埃万杰利斯塔·普尔基涅大学);Charles University(查理大学);Harvard University(哈佛大学);University of Florida(佛罗里达大学)
Privacy-Preserving SAM Quantization for Efficient Edge Intelligence in Healthcare
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Integrated multimodal artificial intelligence framework for healthcare applications
Abdul Latif Jameel Clinic for Machine Learning in Health, MIT(麻省理工学院阿卜杜勒·拉蒂夫·贾米勒健康机器学习诊所);Wyss Institute for Biologically Inspired Engineering, Harvard University(哈佛大学怀斯生物启发工程研究所);Operations Research Center, Massachusetts Institute of Technology (MIT)(麻省理工学院运筹学研究中心);Sloan School of Management, MIT(麻省理工学院斯隆管理学院)
From Military to Healthcare: Adopting and Expanding Ethical Principles for Generative Artificial Intelligence
University of Pittsburgh(匹兹堡大学);Weill Cornell Medicine(威尔康奈尔医学院);Telemedicine & Advanced Technology Research Center, US Army(美国陆军远程医疗与先进技术研究中心);Uniformed Services University(美国卫生与公众服务部统一服务大学);Brooke Army Medical Center(布鲁克陆军医学中心);University of Pittsburgh Medical Center Hillman Cancer Center(匹兹堡大学医学中心希尔曼癌症中心)
Generative Artificial Intelligence in Healthcare: Ethical Considerations and Assessment Checklist
Duke-NUS Medical School(杜克-新加坡国立大学医学院);National University of Singapore(新加坡国立大学);University of Oxford(牛津大学);Imperial College London(帝国理工学院);University of Antwerp(安特卫普大学);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Centre(新加坡全国眼科中心);Singapore Health Services(新加坡保健服务);Singapore General Hospital(新加坡中央医院);Hangzhou Dianzi University(杭州电子科技大学);Nanyang Technological University(南洋理工大学);The Chinese University of Hong Kong(香港中文大学);Scripps Research(斯克里普斯研究所)
A Design Framework for operationalizing Trustworthy Artificial Intelligence in Healthcare: Requirements, Tradeoffs and Challenges for its Clinical Adoption
organization= Faculty of Medicine;Health Technology, Tampere University , city= Tampere , postcode= 33100 , country= Finland;organization= TECNALIA, Basque Research \& Technology Alliance (BRTA) , city= Derio , postcode= 48160 , country= Spain;organization= Department of Mathematics, University of the Basque Country (UPV/EHU) , city= Leioa , postcode= 48940 , country= Spain;organization= Tampere Heart Hospital, Tampere University Hospital , city= Tampere , postcode= 33520 , country= Finland
Artificial Intelligence in Rural Healthcare Delivery: Bridging Gaps and Enhancing Equity through Innovation
University of Illinois College of Medicine Rockford(伊利诺伊大学罗克福德医学院);National Center for Rural Health Professions(农村健康专业中心);Sri Sivasubramaniya Nadar College of Engineering(塞维萨布拉曼尼亚那德尔工程学院);M. Kumarasamy College of Engineering(M. Kumarasamy 工程学院);The Ohio State University Wexner Medical Center(俄亥俄州立大学韦克斯纳医疗中心);iWorks Corporation(iWorks 公司);Central South University(中南大学);Bacha Khan University(巴哈汗大学)
Towards Blockchain-Assisted Privacy-Aware Data Sharing For Edge Intelligence: A Smart Healthcare Perspective
Data61, CSIRO(联邦科学与工业研究组织数据61研究所);Victoria University(维多利亚大学);University of Electronic Science and Technology of China(电子科技大学);University of Technology Sydney(悉尼科技大学);CNPIEC KEXIN LTD(中国图书进出口科信有限公司);Xidian University(西安电子科技大学)
On Curating Responsible and Representative Healthcare Video Recommendations for Patient Education and Health Literacy: An Augmented Intelligence Approach
研究表明,三分之一的美国成年人使用互联网来诊断或了解健康问题。然而,在线获取保健信息可能会加剧保健信息提供和使用方面的差距。健康信息寻求行为(Health Information Seeking Behavior,HISB)是指个体寻求有关其健康、风险、疾病和健康保护行为的信息的方式。对于在数字媒体平台上搜索健康信息的患者来说,健康素养的鸿沟可能会因为他们自己缺乏知识和算法建议而加剧,结果会对弱势群体,少数民族和低健康素养用户产生不成比例的影响。这项研究报告了对上述挑战的探索性调查,通过研究是否可以使用先进的分析方法生成负责任和有代表性的建议,这些方法适用于YouTube社交媒体平台上的慢性疾病(糖尿病)的大型视频及其元数据。该文件的重点是与使用糖尿病视频的演员的人口特征相关的偏见,这些视频是根据多个标准检索和策划的,例如编码的医疗内容及其可理解性,以满足患者教育和人口健康素养需求。这种方法通过将卫生专业人员和患者的观点结合到一个可扩展和可推广的机器学习框架中,为患者赋权和改善健康结果,为人类在环,增强智能,偏见意识和负责任的算法建议的创新提供了巨大的机会。
Explainable AI meets Healthcare: A Study on Heart Disease Dataset
Pandit Deendayal Petroleum University(潘迪特·迪恩达亚尔石油大学);Confirm SFI Centre for Smart Manufacturing(Confirm SFI智能制造中心);Data Science Institute(数据科学研究所);National University of Ireland Galway(爱尔兰国立大学戈尔韦分校)
Artificial intelligence in medicine and healthcare: a review and classification of current and near-future applications and their ethical and social Impact
Universidad de Sevilla(塞维利亚大学);Institute of Biomedicine of Seville (IBIS)(塞维利亚生物医学研究所);Royal Academy of Medicine and Surgery of Seville(塞维利亚皇家医学与外科学院);Joint Research Center, European Commission(欧盟委员会联合研究中心);Universitat Pompeu Fabra(庞培法布拉大学);Hospital Universitario “Virgen del Rocio”(“罗西圣母”大学医院);Center for Advanced Neurology (CNA)(高级神经病学中心);Hospital Universitario “Virgen Macarena”(“马卡雷纳圣母”大学医院);Instituto de Salud Carlos III (ISCIII)(卡洛斯三世卫生研究所);College of Medicine, Universidad de Sevilla(塞维利亚大学医学院);Hospital “VITHAS-NISA Sevilla”(塞维利亚VITHAS-NISA医院);DINAC Foundation(DINAC基金会)
Hierarchical Dual-Strategy Unlearning for Biomedical and Healthcare Intelligence Using Imperfect and Privacy-Sensitive Medical Data
Department of Neurosurgery, Qilu Hospital of Shandong University and Institute of Brain and Brain-Inspired Science(齐鲁医院山东大学神经外科和脑科学与脑启发科学研究院);Department of Neurosurgery, The Affiliated Hospital of Qingdao University(青岛大学附属医院神经外科);Department of Neurosurgery, Peking Union Medical College Hospital(北京地坛医院神经外科);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);College of Artificial Intelligence, Dalian Maritime University(大连海事大学人工智能学院);University of Colorado Boulder(科罗拉多大学波尔德分校);Zhengzhou University(郑州大学);The University of Hong Kong(香港大学);Georgia Institute of Technology(佐治亚理工学院)
MCP-AI: Protocol-Driven Intelligence Framework for Autonomous Reasoning in Healthcare
School of Information Technology University of Cincinnati Ohio, USA(信息科技学院 俄亥俄州立大学 奥哈伊俄州);Adolescent Psychiatry Cincinnati Children’s Hospital Medical Center Ohio, USA(青少年精神病学 奥克兰儿童医院医疗中心 奥哈伊俄州)
Artificial Intelligence Framework for Simulating Clinical Decision-Making: A Markov Decision Process Approach
Centerstone Research Institute(森特斯顿研究所);Indiana University(印第安纳大学)
在现代医疗保健系统中,快速增长的成本/复杂性,越来越多的治疗方案,以及爆炸式的信息流,往往不能有效地到达前线,阻碍了随着时间的推移选择最佳治疗决策的能力。本文的目标是开发一个通用(非疾病特异性)计算/人工智能(AI)框架来应对这些挑战。这提供了两个潜在的功能:1)用于探索各种医疗保健政策、支付方法等的模拟环境,2)临床人工智能的基础--一种可以像医生一样思考的人工智能。这种方法结合了马尔可夫决策过程和动态决策网络,从临床数据中学习,并通过模拟替代顺序决策路径来制定复杂的计划,同时捕捉医疗系统中各种组件之间有时相互冲突,有时相互协同的相互作用。它可以在部分可观察的环境中(在缺少观察或数据的情况下)通过维护关于患者健康状况的信念状态来操作,并作为计划和重新计划的在线代理。使用来自电子健康记录的真实患者数据对该框架进行了评估。这样的AI框架很容易超越当前的常规治疗(TAU)病例率/医疗保健服务收费模型(单位变化成本:$189 vs. $ 497),同时获得30-35%的患者结局增加。调整某些模型参数进一步增强了这一优势,以大约一半的成本获得大约50%的改进。在精心设计和问题制定的情况下,人工智能仿真框架即使在复杂和不确定的环境中也可以近似最优决策。未来的工作进行了描述,概述了潜在的线的研究和集成的机器学习算法的个性化医疗。
Easydiagnos: a framework for accurate feature selection for automatic diagnosis in smart healthcare
Dr. B. C. Roy Engineering College(B.C.罗伊工程学院);Bengal College of Engg. and Tech.(孟加拉工程技术学院);National Institute of Technology(印度国家理工学院);University of North Texas(北得克萨斯大学)
本文提出 Easydiagnos 框架,通过融合遗传算法、可解释 AI 和排列组合技术的 AFE 算法优化医疗特征选择,并在多个数据集上验证其可提升临床决策的准确性与可解释性。
Prepared Or Unprepared? Evaluating Healthcare Workforce Readiness for Clinical Adoption of Artificial Intelligence in Nigeria
College of Health Sciences, Bayero University Kano(贝耶罗大学卡诺分校健康科学学院);Federal University of Health Sciences, Azare(阿扎雷联邦健康科学大学);African Institute for Research Advancement & Innovation(非洲研究促进与创新研究所);Medical Artificial Intelligence Laboratory (MAI Lab)(医学人工智能实验室);Aminu Kano Teaching Hospital(阿米努·卡诺教学医院);Nnamdi Azikiwe University Teaching Hospital(纳姆迪·阿齐基韦大学教学医院);Lagos State Teaching Hospital(拉各斯州立教学医院)
A Proposed Biomedical Data Policy Framework to Reduce Fragmentation, Improve Quality, and Incentivize Sharing in Indian Healthcare in the era of Artificial Intelligence and Digital Health
Post Graduate Institute of Medical Sciences(医学研究生院);Amrita School of Medicine, Amrita Vishwa Vidyapeetham(阿姆里塔医学院,阿姆里塔大学);All India Institute of Medical Sciences(全印医学科学研究所)
Metaverse for Healthcare: A Survey on Potential Applications, Challenges and Future Directions
Vellore Institute of Technology(韦洛尔理工学院);Ho Chi Minh City University of Technology and Education(胡志明市工业与教育大学);Pandit Deendayal Energy University(潘迪特·迪恩达亚尔能源大学);Charles Darwin University(查尔斯达尔文大学)
AI Readiness in Healthcare through Storytelling XAI
Center for Artificial Intelligence in Public Health Research (ZKI-PH) at Robert Koch Institute(罗伯特·科赫研究所公共卫生研究人工智能中心);Free University of Berlin(柏林自由大学)
针对医疗 AI 落地中的信任与差异化解释需求,本文提出结合多任务蒸馏和可解释性技术的叙事式 XAI,以支持复杂深度模型并提升专家信任。
Breaking Bad News in the Era of Artificial Intelligence and Algorithmic Medicine: An Exploration of Disclosure and its Ethical Justification using the Hedonic Calculus
Imperial College London(帝国理工学院);University of Bayreuth(拜罗伊特大学)