arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.07044cond-mat.mtrl-sci
收藏

计算材料科学中的可重复性:来自《预测无机材料性质的通用机器学习框架》的教训

Reproducibility in Computational Materials Science: Lessons from 'A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials'

University of Toronto(多伦多大学);Argonne National Laboratory(阿贡国家实验室)

Daniel Persaud, Logan Ward, Jason Hattrick-Simpers

AI总结:

研究尝试复现一篇机器学习预测无机材料性质的论文时遇到的挑战,提出改进可重复性的具体行动项。

摘要:

机器学习技术在材料发现中的集成已成为材料科学研究的重要部分,并伴随着开源数据和工具推动该领域的趋势。尽管这些工具的有用性和能力不断增强,但开发者忽视遵循可重复性实践,为希望使用或在其基础上开展工作的研究人员设置了重大障碍。在本研究中,我们调查了尝试复现《预测无机材料性质的通用机器学习框架》中部分结果时遇到的挑战。我们的分析识别出四大类挑战:(1) 报告计算依赖项,(2) 记录和共享版本日志,(3) 顺序代码组织,以及(4) 在手稿中澄清代码引用。结果是为那些旨在使代码对社区可访问且有用的人提出了一套具体的行动项。

英文摘要:

The integration of machine learning techniques in materials discovery has become prominent in materials science research and has been accompanied by an increasing trend towards open-source data and tools to propel the field. Despite the increasing usefulness and capabilities of these tools, developers neglecting to follow reproducible practices creates a significant barrier for researchers looking to use or build upon their work. In this study, we investigate the challenges encountered while attempting to reproduce a section of the results presented in "A general-purpose machine learning framework for predicting properties of inorganic materials." Our analysis identifies four major categories of challenges: (1) reporting computational dependencies, (2) recording and sharing version logs, (3) sequential code organization, and (4) clarifying code references within the manuscript. The result is a proposed set of tangible action items for those aiming to make code accessible to, and useful for the community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑