聪明材料:当模型为错误原因识别好的材料
Clever Materials: When Models Identify Good Materials for the Wrong Reasons
AI总结:
该研究发现机器学习模型在材料预测中可能受文献元数据影响,而非化学特征,强调需通过严格测试验证模型有效性。
摘要:
机器学习可以加速材料发现。模型在许多基准测试中表现优异。然而,强大的基准表现并不意味着模型学到了化学。我测试了一个具体的替代假设:性质预测可能由文献性混淆驱动。在五个任务中,涵盖MOFs(热稳定性和溶剂稳定性)、钙钛矿太阳能电池(效率)、电池(容量)和TADF发射体(发射波长),模型在标准化学描述符上预测作者、期刊和出版年份均显著超过偶然水平。当这些预测的元数据(
英文摘要:
Machine learning can accelerate materials discovery. Models perform impressively on many benchmarks. However, strong benchmark performance does not imply that a model learned chemistry. I test a concrete alternative hypothesis: that property prediction can be driven by bibliographic confounding. Across five tasks spanning MOFs (thermal and solvent stability), perovskite solar cells (efficiency), batteries (capacity), and TADF emitters (emission wavelength), models trained on standard chemical descriptors predict author, journal, and publication year well above chance. When these predicted metadata ("bibliographic fingerprints") are used as the sole input to a second model, performance is sometimes competitive with conventional descriptor-based predictors. These results show that many datasets do not rule out non-chemical explanations of success. Progress requires routine falsification tests (e.g., group/time splits and metadata ablations), datasets designed to resist spurious correlations, and explicit separation of two goals: predictive utility versus evidence of chemical understanding.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。