将预处理选择重新定义为近红外光谱学中的模型内部校准:一种大规模的运算符自适应PLS和岭模型基准测试
Reframing preprocessing selection as model-internal calibration in near-infrared spectroscopy: A large-scale benchmark of operator-adaptive PLS and Ridge models
AI总结:
本文研究了在近红外光谱学中,将预处理选择重新定义为模型内部校准的方法,通过大规模基准测试比较运算符自适应PLS和岭模型的性能和效率。
摘要:
预处理筛选通常是近红外光谱学校准工作流程中最昂贵的部分。其有效性在于平滑、导数、去趋势及相关滤波器会改变PLS或岭回归所看到的光谱方向,但完整的外部搜索会反复拟合几乎相同的线性模型。本文研究了将该搜索折叠成一个校准步骤的情况。对于严格的线性预处理运算符,变换后的PLS交叉协方差满足(XA^T)^T Y = AX^T Y,而岭回归依赖于运算符诱导的核X A^T A X^T。这些恒等式允许在模型内部筛选有限的运算符银行,同时保留原始波长系数。样本自适应或拟合的校正如SNV、MSC、EMSC和ASLS仍保持为折叠局部分支,而不是被吸收进代数中。本研究使用AOM基准队列:在显式中包含61个回归行和17个分类行。在主回归分母(N=32)上,普通的紧凑银行AOM-PLS记录了与PLS默认值相比的中位RMSEP比为0.991,与PLS-HPO相比为0.990;所选的ASLS-AOM-compact-cv5分支在相同的两个参考上记录为0.985和1.002。普通的AOMRidge-global-compact-none基线记录了与Ridge默认值相比的0.974,与Ridge-HPO相比为0.984,而所选的AOMRidge-Blender-headline-spxy3记录为0.918和0.966。所选分类器AOM-PLS-DA-global-simpls-covariance在13个数据集上将平衡精度提高了0.159,其中12/13胜出。运行时间差距是实际结果:PLS-HPO每次运行的中位总时间是710.81秒,而所选的AOM-PLS分支仅为1.63秒。线性运算符自适应校准因此在预测质量上与彻底的预处理筛选相当,对于PLS来说,拟合时间减少了多个数量级。
英文摘要:
Preprocessing screening is often the most expensive part of a near-infrared spectroscopy calibration workflow. It works because smoothing, derivatives, detrending and related filters change the spectral directions seen by partial least squares (PLS) or Ridge regression, but a full external search repeatedly refits nearly the same linear model. This paper studies the case where that search can be collapsed into one calibration step. For a strict linear preprocessing operator A acting on row spectra as XA^T, the transformed PLS cross-covariance satisfies (XA^T)^T Y = A X^T Y, and Ridge regression depends on the operator-induced kernel X A^T A X^T. These identities let a finite operator bank be screened inside the model while retaining original-wavelength coefficients, and the same identity extends to cheaply evaluated linear operator chains. Sample-adaptive or fitted corrections such as SNV, MSC, EMSC and ASLS are not strict linear; we prove the boundary and keep them as fold-local branches. The cohort has 61 regression and 17 classification rows, with a strict paired regression denominator of N=32 for the eight paper variants. There, AOM-PLS reaches median RMSEP ratios of 0.991/0.990 (simple) and 0.985/1.002 (best) against PLS-default/PLS-HPO, and AOM-Ridge reaches 0.974/0.984 (simple) and 0.918/0.966 (best) against Ridge-default/Ridge-HPO. The operator-adaptive classifier AOM-PLS-DA improves balanced accuracy by a median 0.159 on N=13 datasets (12/13 wins). The practical result is the runtime gap: PLS-HPO takes a median 710.81 s per run, whereas AOM-PLS takes 1.18-1.63 s -- 436 to 602 times less PLS fitting time. Linear operator-adaptive calibration thus gives prediction quality comparable to exhaustive preprocessing screening, with orders-of-magnitude less fitting time for PLS.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。