Confidence assessments of semantic segmentation algorithms are important. Ideally, deep learning models should have the ability to predict in advance whether their output is likely to be incorrect. Assessing the confidence levels of model predictions in Earth Observation (EO) classification is essential, as it can enhance semantic segmentation performance and help prevent further exploitation of the results in case of erroneous prediction. The model we developed, Confidence Assessment for enhanced Semantic segmentation (CAS), evaluates confidence at both the segment and pixel levels, providing both labels and confidence scores as output. Our model, CAS, identifies segments with incorrect predicted labels using the proposed combined confidence metric, refines the model, and enhances its performance. This work has significant applications, particularly in evaluating EO Foundation Models on semantic segmentation downstream tasks, such as land cover classification using Sentinel-2 satellite data. The evaluation results show that this strategy is effective and that the proposed model CAS outperforms other baseline models.
Generalizable Disaster Damage Assessment via Change Detection with Vision Foundation Model
School of Computing, Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院计算学院);College of Business, Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院商学院);Graduate School of Data Science, Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院数据科学研究生院);Division of Social Science, Hong Kong University of Science and Technology (HKUST)(香港科技大学社会科学部);Max Planck Institute for Security and Privacy (MPI-SP)(马克斯·普朗克安全与隐私研究所)
YOLO with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection with trustworthy multimodal AI in computer vision perception
University of Bath(巴斯大学);Zhejiang University(浙江大学)
Bridging Classification and Segmentation in Osteosarcoma Assessment via Foundation and Discrete Diffusion Models
Hanoi University of Science and Technology(河内科学技术大学);Vinmec Times City International Hospital(Vinmec Times City国际医院);Vinmec Healthcare System(Vinmec医疗系统);VinUni-Illinois Smart Health Center(VinUni-伊利诺伊智能健康中心);College of Health Sciences, VinUniversity(VinUniversity健康科学学院)
PainFormer: a Vision Foundation Model for Automatic Pain Assessment
Hellenic Mediterranean University, Department of Electrical and Computer Engineering(希腊地中海大学电子与计算机工程系);Institute of Computer Science, Foundation for Research & Technology-Hellas(希腊研究所计算机科学研究所);University of Canberra, Faculty of Science and Technology(堪培拉大学科学与技术学院)
MedIQA: A Scalable Foundation Model for Prompt-Driven Medical Image Quality Assessment
Faculty of Applied Sciences, Macao Polytechnic University, Macao, China(澳门理工学院);Department of Engineer Science, University of Oxford, Oxford, UK(牛津大学工程科学系);Great Bay University, Dongguan, China(东莞大湾大学);College of Physics and Information Engineering, Fuzhou University, Fuzhou, China(福州大学物理与信息工程学院);Shanghai Jiao Tong University, Shanghai, China(上海交通大学);Department of Radiology, Shenzhen People’s Hospital, Shenzhen, China(深圳人民医院放射科)
Towards a vision foundation model for comprehensive assessment of Cardiac MRI
Siemens Healthineers(西门子医疗);Klinikum rechts der Isar, Technical University of Munich(慕尼黑工业大学 rechts der Isar 医院);Siemens Healthineers AG(西门子医疗股份公司);Imperial College London(伦敦帝国学院)
Assessment of a new GeoAI foundation model for flood inundation mapping
School of Geographical Sciences and Urban Planning, Arizona State University(亚利桑那州立大学地理科学与城市规划学院);School of Computing and Augmented Intelligence, Arizona State University(亚利桑那州立大学计算与增强智能学院);United States Geological Survey(美国地质调查局)
Towards Cellular-Scale Interpretability in Pathology Foundation Models for Biomarker Assessment
Institute of Pathology, Technical University of Munich(慕尼黑技术大学病理学研究所);School of Computation, Information and Technology, Technical University of Munich(慕尼黑技术大学计算、信息与技术学院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Computer Aided Medical Procedures (CAMP), Technical University of Munich(慕尼黑技术大学计算机辅助医疗程序中心);School of Biomedical Engineering, Faculty of Medicine, Dalian University of Technology(大连理工大学医学院生物医学工程学院);Affiliated Hospital of Chifeng University(赤峰大学附属医院);Center for Medical Imaging, Robotics, and Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou, China(苏州先进研究院医学影像、机器人与分析计算与学习中心);Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系);The First Hospital and the College of Basic Medical Sciences of China Medical University(中国医科大学第一医院及基础医学科学学院);Munich Data Science Institute (MDSI)(慕尼黑数据科学研究所)
Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond
School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院);School of Medicine, Klinikum Rechts der Isar, Technical University of Munich(慕尼黑工业大学伊萨尔河畔右岸医院医学院);Data Science Institute, Imperial College London(帝国理工学院数据科学研究所);Department of Computing, Imperial College London(帝国理工学院计算系);Department of Computer Science, University of Sheffield(谢菲尔德大学计算机科学系);Department of Quantitative Biomedicine, University of Zurich(苏黎世大学定量生物医学系)