arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09297cond-mat.mtrl-scics.LG
收藏

基于对抗学习微调的分布外材料属性预测

Out-of-distribution materials property prediction using adversarial learning based fine-tuning

University of South Carolina(南卡罗来纳大学)

Qinyang Li, Nicholas Miklaucic, Jianjun Hu

AI总结:

针对材料属性预测模型在分布外样本上泛化能力不足的问题,提出CAL算法及基于对抗学习的定向微调方法,有效提升了小样本下的预测效果,为分布外材料属性预测提供了新方向。

摘要:

材料属性的准确预测在众多科学与工程学科中至关重要。机器学习(ML)已推动该领域取得前沿进展,助力科研人员发现新型材料并设计具备特定目标属性的材料。然而,材料属性预测领域仍存在一大核心挑战:模型对分布外(OOD)样本的泛化能力不足,这类样本与训练期间接触的样本存在显著差异。本文探究了将分布外学习领域的前沿进展应用于提升材料属性预测模型鲁棒性与可靠性的可行性。我们提出并应用Crystal Adversarial Learning(晶体对抗学习,CAL)算法用于分布外材料属性预测,该算法在训练过程中生成合成数据,使训练向预测不确定性较高的样本倾斜。我们进一步提出一种基于对抗学习的定向微调方法,作为传统微调的替代方案,使模型适配特定的分布外数据集。实验表明,我们的CAL算法在样本有限的机器学习场景中具备极高有效性,而这类场景在材料科学中十分常见。本研究为实现更优的分布外学习与材料属性预测提供了一条颇具前景的方向。

英文摘要:

The accurate prediction of material properties is crucial in a wide range of scientific and engineering disciplines. Machine learning (ML) has advanced the state of the art in this field, enabling scientists to discover novel materials and design materials with specific desired properties. However, one major challenge that persists in material property prediction is the generalization of models to out-of-distribution (OOD) samples,i.e., samples that differ significantly from those encountered during training. In this paper, we explore the application of advancements in OOD learning approaches to enhance the robustness and reliability of material property prediction models. We propose and apply the Crystal Adversarial Learning (CAL) algorithm for OOD materials property prediction,which generates synthetic data during training to bias the training towards those samples with high prediction uncertainty. We further propose an adversarial learning based targeting finetuning approach to make the model adapted to a particular OOD dataset, as an alternative to traditional fine-tuning. Our experiments demonstrate the success of our CAL algorithm with its high effectiveness in ML with limited samples which commonly occurs in materials science. Our work represents a promising direction toward better OOD learning and materials property prediction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑