具有增强可解释性的潜在突破性技术早期筛选:一种专利特定的分层注意力网络模型
Early screening of potential breakthrough technologies with enhanced interpretability: A patent-specific hierarchical attention network model
AI总结:
提出可解释的专利特定分层注意力网络(PatentHAN)模型,通过预训练语言模型、分层结构和自注意力机制从专利文本预测引用计数,在制药专利案例中有效实现突破性技术早期筛选并增强人机协作。
摘要:
尽管机器学习方法对于潜在突破性技术的早期筛选十分有用,但其实用性常常受到模型不透明的阻碍。为了解决这一问题,我们提出了一种可解释的机器学习方法,使用专利特定的分层注意力网络(PatentHAN)模型从专利文本中预测未来引用计数。该方法的核心是:(1)一个专利特定的预训练语言模型,用于捕捉专利权利要求中技术词汇的含义;(2)一个分层网络结构,能够在权利要求层面进行详细分析;(3)一个逐权利要求的自注意力机制,可在筛选过程中揭示关键权利要求。一项包含 35,376 项制药专利的案例研究证明了我们的方法在潜在突破性技术早期筛选中的有效性,同时确保了可解释性。此外,我们使用不同的语言模型和权利要求类型进行了额外分析,以检验该方法的稳健性。预计所提出的方法将增强人机协作以识别突破性技术,为技术价值提供源自文本挖掘的新见解。
英文摘要:
Despite the usefulness of machine learning approaches for the early screening of potential breakthrough technologies, their practicality is often hindered by opaque models. To address this, we propose an interpretable machine learning approach to predicting future citation counts from patent texts using a patent-specific hierarchical attention network (PatentHAN) model. Central to this approach are (1) a patent-specific pre-trained language model, capturing the meanings of technical words in patent claims, (2) a hierarchical network structure, enabling detailed analysis at the claim level, and (3) a claim-wise self-attention mechanism, revealing pivotal claims during the screening process. A case study of 35,376 pharmaceutical patents demonstrates the effectiveness of our approach in early screening of potential breakthrough technologies while ensuring interpretability. Furthermore, we conduct additional analyses using different language models and claim types to examine the robustness of the approach. It is expected that the proposed approach will enhance expert-machine collaboration in identifying breakthrough technologies, providing new insight derived from text mining into technological value.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。