光谱学中的运行范围界定：机器学习模型的安全笼框架
Operational Range Bounding in Spectroscopy: A Safety Cage Framework for Machine Learning Models
- ML Analytics
- Delft University of Technology（代尔夫特理工大学）
- European Space Agency (ESA)（欧洲航天局）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
本研究提出一种安全笼框架，通过融合不确定性、域外检测和影响函数等指标，约束机器学习模型在光谱分析中的运行范围，在仅减少20%数据覆盖率下将误差降低45%-65%。
AI中文摘要：
确保黑盒机器学习模型在安全关键型太空任务中的可靠性仍然是一个重大挑战，尤其是在无法获得地面真值进行验证的情况下。尽管机器学习模型通过从复杂的系外行星光变曲线中提取透射光谱，为标准流程提供了强大的增强手段，但它们对未建模的仪器异常、恒星活动以及域偏移的敏感性引入了未量化的风险。本研究评估了一种模块化安全笼架构，该架构作为并行监控层运行，在不修改底层估计器的情况下评估预测的有效性。通过监控不同的运行时指标，包括不确定性量化、域外检测和影响函数，该框架将模型的操作域限制在已验证区域内。在域内和跨域条件下进行了受控评估，使用了2019年和2021年Ariel数据挑战的数据集。结果表明，模型失败是多方面的，没有任何单一指标能捕获所有失败模式，这证明了指标融合的必要性。应用安全驱动的拒绝策略表明，数据覆盖率仅减少20%，即可在不同域和评估指标下将误差降低45%至65%。利用形式化的覆盖率-风险框架，对指标组合进行了系统分析，以确定最大化风险排序准确性并优化数据覆盖率与科学性能之间权衡的配置。安全笼为检测不可靠预测提供了一种透明机制，并代表了在科学应用（如天体物理学）中安全部署数据驱动模型的关键一步，在这些应用中，地面真值很少可用。
英文摘要：
Ensuring the reliability of black-box machine learning models in safety-critical space missions remains a significant challenge, particularly when ground-truth is unavailable for validation. Although machine learning models offer a powerful means to augment standard pipelines by extracting transmission spectra from complex exoplanetary light curves, their susceptibility to unmodelled instrument anomalies, stellar activity, and domain shifts introduces unquantified risks. This study evaluates a modular safety cage architecture that operates as a parallel monitoring layer to assess the validity of a prediction without modifying the underlying estimator. By monitoring different runtime indicators, including uncertainty quantification, out-of-domain detection, and influence functions, the framework constrains the model's operational domain to a verified region. A controlled evaluation is conducted under both in-domain and cross-domain conditions, using datasets from the 2019 and 2021 editions of the Ariel Data Challenges. The results reveal that model failure is multifaceted and that no single indicator captures all failure modes, demonstrating the need for indicator fusion. The application of safety-driven rejection strategies shows that a modest 20% reduction in data coverage results in error reductions between 45% and 65% across different domains and evaluation metrics. Using a formalised coverage-risk framework, a systematic analysis of indicator combinations is performed to identify configurations that maximise risk-ranking accuracy and optimise the trade-off between data coverage and scientific performance. Safety cages provide a transparent mechanism for detecting unreliable predictions and represent a critical step towards the safe deployment of data-driven models in scientific applications, such as astrophysics, where ground truth is seldom available.
