GIAT: 一种地质导向的注意力变换器用于岩性识别
GIAT: A Geologically-Informed Attention Transformer for Lithology Identification
AI总结:
GIAT通过融合地质先验知识与注意力机制,提升井孔资料中岩性识别的准确性与可解释性。
摘要:
从井孔资料中准确识别岩性对于地下资源评估至关重要。尽管基于变换器的模型在序列建模方面表现出色,但其“黑箱”性质和缺乏地质指导限制了其性能和可信度。为克服这些限制,本文提出了地质导向的注意力变换器(GIAT),一种新的框架,深入融合数据驱动的地质先验知识与变换器的注意力机制。GIAT的核心是一种新的注意力偏置机制。我们重新利用类别序列相关性(CSC)滤波器生成一个地质导向的关系矩阵,将其注入到自注意力计算中,以明确引导模型朝着地质一致的模式发展。在两个具有挑战性的数据集上,GIAT实现了最先进的性能,准确率高达95.4%,显著优于现有模型。更重要的是,GIAT在输入扰动下表现出卓越的解释忠实性,并生成地质一致的预测。我们的工作为构建更准确、可靠和可解释的深度学习模型提供了新的范式,用于地质学应用。
英文摘要:
Accurate lithology identification from well logs is crucial for subsurface resource evaluation. Although Transformer-based models excel at sequence modeling, their "black-box" nature and lack of geological guidance limit their performance and trustworthiness. To overcome these limitations, this letter proposes the Geologically-Informed Attention Transformer (GIAT), a novel framework that deeply fuses data-driven geological priors with the Transformer's attention mechanism. The core of GIAT is a new attention-biasing mechanism. We repurpose Category-Wise Sequence Correlation (CSC) filters to generate a geologically-informed relational matrix, which is injected into the self-attention calculation to explicitly guide the model toward geologically coherent patterns. On two challenging datasets, GIAT achieves state-of-the-art performance with an accuracy of up to 95.4%, significantly outperforming existing models. More importantly, GIAT demonstrates exceptional interpretation faithfulness under input perturbations and generates geologically coherent predictions. Our work presents a new paradigm for building more accurate, reliable, and interpretable deep learning models for geoscience applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。