在生物和技术分布偏移下鲁棒的机器学习用于调控序列建模
Robust Machine Learning for Regulatory Sequence Modeling under Biological and Technical Distribution Shifts
AI总结:
本研究提出了一种鲁棒性框架,通过结合模拟和真实数据分析,评估机器学习模型在生物和技术分布偏移下的性能,发现传统i.i.d.评估无法察觉的鲁棒性缺口,并通过引入生物先验特征和不确定性感知预测提升模型的鲁棒性。
摘要:
在生物和技术引起的分布偏移下研究鲁棒的机器学习用于调控基因组学。深度卷积和注意力模型在DNA调控序列预测任务中表现出强大的分布内性能,但通常在i.i.d.假设下进行评估,尽管实际应用涉及细胞类型特异性程序、进化替换、实验协议变化和测序伪影。我们引入了一个鲁棒性框架,结合机制模拟基准与大规模并行报告实验(MPRA)数据集上的真实数据分析,以量化性能退化、校准失败和不确定性基于的可靠性。在模拟中,通过细胞类型特异性程序、PWM扰动、GC偏差、深度变化、批次效应和异方差噪声生成由动机驱动的调控输出,并评估CNN、BiLSTM和Transformer模型。模型在轻微的GC含量偏移下仍能保持准确且合理的校准,但在动机效应重排和噪声主导的领域中表现出更高的误差、严重的方差校准错误和覆盖崩溃,揭示了标准i.i.d.评估无法察觉的鲁棒性缺口。在模拟中添加简单的生物结构先验动机衍生特征和全局GC含量可减少分布外误差,并在生物意义的基因组偏移下产生一致的鲁棒性收益,尽管对强实验噪声的保护有限。不确定性感知的选择性预测提供了一个额外的安全层,对模拟和MPRA数据的风险覆盖分析显示,过滤低置信度输入可恢复低风险子集,包括在基于GC的分布外条件下,尽管当噪声主导时可靠性收益会减少。
英文摘要:
Robust machine learning for regulatory genomics is studied under biologically and technically induced distribution shifts. Deep convolutional and attention-based models achieve strong in-distribution performance on DNA regulatory sequence prediction tasks but are usually evaluated under i.i.d. assumptions, even though real applications involve cell type-specific programs, evolutionary turnover, assay protocol changes, and sequencing artifacts. We introduce a robustness framework that combines a mechanistic simulation benchmark with real data analysis on an MPRA dataset to quantify performance degradation, calibration failures, and uncertainty-based reliability. In simulation, motif-driven regulatory outputs are generated with cell type-specific programs, PWM perturbations, GC bias, depth variation, batch effects, and heteroscedastic noise, and CNN, BiLSTM, and transformer models are evaluated. Models remain accurate and reasonably calibrated under mild GC content shifts but show higher error, severe variance miscalibration, and coverage collapse under motif effect rewiring and noise-dominated regimes, revealing robustness gaps invisible to standard i.i.d. evaluation. Adding simple biological structural priors, motif-derived features in simulation, and global GC content in MPRA improves distribution error and yields consistent robustness gains under biologically meaningful genomic shifts, while providing only limited protection against strong assay noise. Uncertainty-aware selective prediction offers an additional safety layer, and risk coverage analyses on simulated and MPRA data show that filtering low-confidence inputs recovers low-risk subsets, including under GC-based OOD conditions, although reliability gains diminish when noise dominates.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。