arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.20512physics.chem-phcond-mat.mtrl-sci
收藏

通过语言模型进行不确定性信息筛选以实现钙钛矿合成中更安全溶剂的使用

Uncertainty-Informed Screening for Safer Solvents Used in the Synthesis of Perovskite via Language Models

Arpan Mukherjee, Deepesh Giri, Krishna Rajan

AI总结:

本文提出结合语言模型自动提取与不确定性信息预测的框架,用于填补钙钛矿合成溶剂毒性数据空白并提升预测置信度,最终构建结构化数据集并识别高风险溶剂相互作用。

摘要:

准确预测钙钛矿合成中所用工业溶剂毒性的挑战是一项必要的工作,但受到缺乏有针对性和结构化的毒性数据的限制。本文提出了一个新颖的框架,该框架结合了使用语言模型的自动化数据提取和不确定性信息预测模型,以填补数据空白并提高预测置信度。首先,我们利用并比较了两种从钙钛矿合成溶剂科学文献语料库中自动提取相关数据的方法:较小的双向语言模型(如BERT和ELMo)因其可重复性和确定性输出而被使用,而自回归大语言模型(LLM)(如GPT-3.5)则用于利用其更大的训练语料库和更好的响应生成能力。我们新颖的“提示与验证”技术与LLM集成,旨在实现有针对性的提取和细化,从而减少幻觉并提高使用LLM提取数据的质量。接下来,提取的数据被输入到我们预训练的多任务二元分类深度学习模型中,以预测所提取溶剂的ED性质。我们使用了基于Shannon熵的不确定性量化方法,利用从分类模型获得的类别概率来量化不确定性并识别预测中的数据空白。该方法促成了一个用于钙钛矿合成溶剂的结构化数据集及其不确定性信息虚拟毒性评估的构建。此外,弦图已被用于可视化溶剂相互作用并优先考虑具有潜在危害的溶剂,揭示70%的溶剂相互作用主要与两种特定的钙钛矿相关。

英文摘要:

The challenge of accurately predicting toxicity of industrial solvents used in perovskite synthesis is a necessary undertaking but is limited by a lack of a targeted and structured toxicity data. This paper presents a novel framework that combines an automated data extraction using language models, and an uncertainty-informed prediction model to fill data gaps and improve prediction confidence. First, we have utilized and compared two approaches to automatically extract relevant data from a corpus of scientific literature on solvents used in perovskite synthesis: smaller bidirectional language models like BERT and ELMo are used for their repeatability and deterministic outputs, while autoregressive large language model (LLM) such as GPT-3.5 is used to leverage its larger training corpus and better response generation. Our novel 'prompting and verification' technique integrated with an LLM aims at targeted extraction and refinement, thereby reducing hallucination and improving the quality of the extracted data using the LLM. Next, the extracted data is fed into our pre-trained multi-task binary classification deep learning to predict the ED nature of extracted solvents. We have used a Shannon entropy-based uncertainty quantification utilizing the class probabilities obtained from the classification model to quantify uncertainty and identify data gaps in our predictions. This approach leads to the curation of a structured dataset for solvents used in perovskite synthesis and their uncertainty-informed virtual toxicity assessment. Additionally, chord diagrams have been used to visualize solvent interactions and prioritize those with potential hazards, revealing that 70% of the solvent interactions were primarily associated with two specific perovskites.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑