This study presents a new approach for estimating confidence in machine learning model predictions, specifically in regression tasks utilizing Earth Observation (EO) data, with a particular focus on mosquito abundance (MA) estimation. We take advantage of a Variational AutoEncoder architecture, to derive a confidence metric by the latent space representations of EO datasets. This methodology is pivotal in establishing a correlation between the Euclidean distance in latent representations and the Absolute Error (AE) in individual MA predictions. Our research focuses on EO datasets from the Veneto region in Italy and the Upper Rhine Valley in Germany, targeting areas significantly affected by mosquito populations. A key finding is a notable correlation of 0.46 between the AE of MA predictions and the proposed confidence metric. This correlation signifies a robust, new metric for quantifying the reliability and enhancing the trustworthiness of the AI model's predictions in the context of both EO data analysis and mosquito abundance studies.
Beyond Correctness: Confidence-Aware Reward Modeling for Enhancing Large Language Model Reasoning
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University(上海数据科学关键实验室,计算机科学学院,复旦大学)
Enhancing Profitability and Investor Confidence through Interpretable AI Models for Investment Decisions
School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST)(国家科技大学电气工程与计算机科学学院);Department of Computer Science, Bahria University(巴里亚大学计算机科学系);College of Computer and Information Sciences (CCIS), Prince Sultan University(苏丹王子大学计算机与信息科学学院)
Multi-modal Co-learning for Earth Observation: Enhancing single-modality models via modality collaboration
Department of Computer Science, University of Kaiserslautern-Landau (RPTU)(科斯拉尔特伦大学计算机科学系);SDS, German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));INRAE, UMR TETIS, University of Montpellier(蒙彼利埃大学UMR TETIS);CIRAD, UMR TETIS, University of Montpellier(蒙彼利埃大学UMR TETIS);INRIA, EVERGREEN, University of Montpellier(蒙彼利埃大学)
Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications
National Center for Atmospheric Research(国家大气研究中心);Cooperative Institute for Severe and High-Impact Weather Research and Operations(恶劣与高影响天气研究与合作研究所);National Severe Storms Laboratory(国家强风暴实验室);University Corporation for Atmospheric Research(大学大气研究公司);University of Maryland(马里兰大学);University at Albany, State University of New York(纽约州立大学奥尔巴尼分校);Colorado State University(科罗拉多州立大学);The Pennsylvania State University(宾夕法尼亚州立大学)
Overcoming "Physics Shock" in Earth Observation A Heteroscedastic Uncertainty Framework for PINN-based Flood Inference
Built Environment Department, College of Science and Technology, North Carolina A&T State University(北卡罗来纳A&T州立大学科学与技术学院建筑环境系);United Nations University Institute for Water, Environment and Health(联合国大学水、环境与健康研究所)
Enhancing Continual Learning for Software Vulnerability Prediction: Addressing Catastrophic Forgetting via Hybrid-Confidence-Aware Selective Replay for Temporal LLM Fine-Tuning
School of Computer Science, University of Nottingham, Nottingham, United Kingdom(诺丁汉大学计算机科学学院);School of Informatics and Computing, Northern Arizona University, Flagstaff, United States of America(北亚利桑那大学信息学院);School of Computer Science, University of Nottingham, Ningbo, China(诺丁汉大学宁波校区)
Enhancing Federated Learning Through Secure Cluster-Weighted Client Aggregation
School of Engineering and Built Environment, Deakin University(迪肯大学工程与建筑环境学院);School of Electrical Engineering and Computer Science, The University of Queensland(昆士兰大学电气工程与计算机科学学院);School of Information Technology, Deakin University(迪肯大学信息技术学院)