Telemedicine utilization was accelerated during the COVID-19 pandemic, and skin conditions were a common use case. However, the quality of photographs sent by patients remains a major limitation. To address this issue, we developed TrueImage 2.0, an artificial intelligence (AI) model for assessing patient photo quality for telemedicine and providing real-time feedback to patients for photo quality improvement. TrueImage 2.0 was trained on 1700 telemedicine images annotated by clinicians for photo quality. On a retrospective dataset of 357 telemedicine images, TrueImage 2.0 effectively identified poor quality images (Receiver operator curve area under the curve (ROC-AUC) =0.78) and the reason for poor quality (Blurry ROC-AUC=0.84, Lighting issues ROC-AUC=0.70). The performance is consistent across age, gender, and skin tone. Next, we assessed whether patient-TrueImage 2.0 interaction led to an improvement in submitted photo quality through a prospective clinical pilot study with 98 patients. TrueImage 2.0 reduced the number of patients with a poor-quality image by 68.0%.
Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modeling
Johns Hopkins University(约翰霍普金斯大学);University of California, San Francisco(加州大学旧金山分校);Harvard Medical School(哈佛医学院);Emory University(埃默里大学);Nvidia(英伟达);Johns Hopkins Medicine(约翰霍普金斯医学)
Toward an Automatic System for Computer-Aided Assessment in Facial Palsy
Toronto Rehabilitation Institute – University Health Network(多伦多康复研究所 - 大学健康网络);Massachusetts Eye and Ear Infirmary(麻省眼耳医院);Harvard Medical School(哈佛医学院);University of Toronto(多伦多大学);Sunnybrook Research Institute(桑尼布鲁克研究所);Royal Australasian College of Surgeons(澳大利亚皇家外科医师学院);University of Sydney(悉尼大学);Brasilia University(巴西利亚大学)
重要性:用于面部标志定位的机器学习(ML)方法对于面部功能的定量评估具有巨大的临床潜力,因为它们能够从照片中高通量地自动量化相关面部指标。然而,从研究环境到临床应用的转化需要重大的改进。目的:开发一种ML算法,用于精确定位面瘫患者照片中的面部标志,并将其用作自动计算机辅助诊断系统的一部分。设计,设置,和参与者:面部标志被手动定位在肖像照片的八个表情,从200名面瘫患者和10名对照。使用该疾病特异性数据库训练用于自动面部标志定位的新型ML模型。将模型输出与手动注释和使用仅由健康受试者组成的较大数据库训练的模型的输出进行比较。模型精度通过算法预测值与人工标注值之间的归一化均方根误差(NRMSE)进行评价。结果如下:与健康对照相比,公开可用的算法在应用于患者时提供较差的结果(NRMSE,8.56 +/- 2.16 vs. 7.09 +/- 2.34,p << 0.01)。我们发现,与使用数千张健康面部图像训练的模型相比,使用相对较少数量的患者照片(1440)训练的模型在临床人群中面部标志定位准确性方面有显着提高(NRMSE,6.03 +/- 2.43 vs. 8.56 +/- 2.16,p << 0.01)。结论:用少量临床图像重新训练界标检测模型显著提高了临床人群正面视图照片中的界标检测性能。这些结果代表了第一步走向自动化系统的计算机辅助评估面瘫。
M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Beijing Anzhen Hospital, Capital Medical University(首都医科大学北京安贞医院);Agency for Science, Technology and Research(科技研究局)
Automated Perceptually-Motivated Assessment of Photographic Consistency in Paired Clinical Photographs: Pipeline Development and Internal Evaluation
David Geffen School of Medicine at UCLA(加州大学洛杉矶分校大卫·格芬医学院);Cornell University(康奈尔大学);Tulane University(杜兰大学);University of Pittsburgh School of Medicine(匹兹堡大学医学院)
A Multimodal Vision Foundation Model for Clinical Dermatology
Monash University(莫纳什大学);The University of Queensland(昆士兰大学);Medical University of Vienna(维也纳医科大学);Alfred Hospital(阿尔弗雷德医院);Princess Alexandra Hospital(亚历山德拉公主医院);NVIDIA AI Technology Center(英伟达人工智能技术中心);University of Florence(佛罗伦萨大学);Melanoma Institute Australia(澳大利亚黑色素瘤研究所);Royal Prince Alfred Hospital(阿尔弗雷德王子医院);Hospital General Universitario de Alicante(阿利坎特大学综合医院)
Hybrid Ensemble of Segmentation-Assisted Classification and GBDT for Skin Cancer Detection with Engineered Metadata and Synthetic Lesions from ISIC 2024 Non-Dermoscopic 3D-TBP Images
RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports
Beijing Institute of Technology(北京理工大学);Beijing Tongren Hospital(北京同仁医院);Capital Medical University(首都医科大学);Beijing Institute of Ophthalmology(北京眼科研究所)