机器学习用于新的次要物种的自动识别
Machine Learning for automatic identification of new minor species
摘要:
分析现代光谱数据集的主要困难之一是由于大量的数据。例如,在大气透射光谱学中,自2018年4月任务开始至2020年1月15日,欧空局ExoMars 2016卫星上名为痕量气体轨道器(TGO)的NOMAD仪器的太阳掩星通道(SO)在20000个采集序列中产生了$\sim$ 1000万个光谱。其他数据集甚至更大,包括火星快车上OMEGA或火星侦察轨道器上CRISM的$\sim$数十亿光谱。通常,在模型拟合和手动残差分析的长时间迭代过程之后发现新的线。在这里,我们提出了一种基于无监督机器学习的新方法,自动检测新的次要物种。虽然精确的量化超出了范围,但该工具也可以用于快速总结数据集,通过给出几个端元(“源”)及其丰度。我们近似数据集的非线性丰度和源光谱(端元)的线性混合物。我们使用非负矩阵分解形式的无监督源分离来估计这些数量。几种方法进行了测试合成和模拟数据。我们的方法致力于检测次要物种光谱,而不是精确量化它们。在合成实例中,该方法能够以1.5倍的噪声水平检测出$10^4$中以100个隐藏光谱形式存在的化合物。对NOMAD-SO靶向CH $_{4}$的模拟光谱的结果表明,在有利的条件下,检测限在100-500 ppt范围内。NOMAD-SO的真实火星数据显示,正如预期的那样,CO $_{2}$和H $_{2}$ O存在,但CH $_{4}$不存在。然而,我们确认了一组新的意外线在数据库中,归因于ACS仪器团队的CO $_{2}$磁偶极子。
英文摘要:
One of the main difficulties to analyze modern spectroscopic datasets is due to the large amount of data. For example, in atmospheric transmittance spectroscopy, the solar occultation channel (SO) of the NOMAD instrument onboard the ESA ExoMars2016 satellite called Trace Gas Orbiter (TGO) had produced $\sim$10 millions of spectra in 20000 acquisition sequences since the beginning of the mission in April 2018 until 15 January 2020. Other datasets are even larger with $\sim$billions of spectra for OMEGA onboard Mars Express or CRISM onboard Mars Reconnaissance Orbiter. Usually, new lines are discovered after a long iterative process of model fitting and manual residual analysis. Here we propose a new method based on unsupervised machine learning, to automatically detect new minor species. Although precise quantification is out of scope, this tool can also be used to quickly summarize the dataset, by giving few endmembers ("source") and their abundances. We approximate the dataset non-linearity by a linear mixture of abundance and source spectra (endmembers). We used unsupervised source separation in form of non-negative matrix factorization to estimate those quantities. Several methods are tested on synthetic and simulation data. Our approach is dedicated to detect minor species spectra rather than precisely quantifying them. On synthetic example, this approach is able to detect chemical compounds present in form of 100 hidden spectra out of $10^4$, at 1.5 times the noise level. Results on simulated spectra of NOMAD-SO targeting CH$_{4}$ show that detection limits goes in the range of 100-500 ppt in favorable conditions. Results on real martian data from NOMAD-SO show that CO$_{2}$ and H$_{2}$O are present, as expected, but CH$_{4}$ is absent. Nevertheless, we confirm a set of new unexpected lines in the database, attributed by ACS instrument Team to the CO$_{2}$ magnetic dipole.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。