利用大型语言模型生成带标签的矿点记录链接数据
Leveraging Large Language Models for Generating Labeled Mineral Site Record Linkage Data
AI总结:
针对矿点空间记录链接缺乏真实训练数据的问题,提出利用LLM生成训练数据并微调PLM的方法,F1分数提升超45%,推理时间缩短近18倍,还提供自动化流程。
摘要:
记录链接通过识别指向同一实体的记录来整合不同数据源。在矿点记录语境下,准确的记录链接对识别和绘制矿藏分布图至关重要。正确链接指向同一矿藏的记录有助于确定矿区的空间覆盖范围,有利于资源识别和矿点数据存档。矿点记录链接属于空间记录链接类别,因为这些记录包含表格形式的物理位置信息和非空间属性。由于数据的异质性和庞大规模,该任务极具挑战性。虽然此前研究在空间实体链接中使用预训练判别式语言模型(PLMs),但它们通常需要大量精心整理的真实数据进行微调。收集和创建真实数据既耗时又昂贵,因此在缺乏黄金标准数据的实际场景中,这类方法并不总是可行的。尽管大型生成式语言模型(LLMs)在包括记录链接在内的多种自然语言处理任务中表现出良好前景,但其高推理时间和资源需求带来了挑战。我们提出一种利用LLM生成训练数据并微调PLM的方法,以解决训练数据缺口,同时保留PLM的效率。与使用真实数据的传统PLM方法相比,我们的方法在记录链接F1分数上实现了超过45%的提升,且推理时间比依赖LLMs缩短近18倍。此外,我们提供了一个无需人工干预的自动化流程,凸显了该方法克服记录链接挑战的潜力。
英文摘要:
Record linkage integrates diverse data sources by identifying records that refer to the same entity. In the context of mineral site records, accurate record linkage is crucial for identifying and mapping mineral deposits. Properly linking records that refer to the same mineral deposit helps define the spatial coverage of mineral areas, benefiting resource identification and site data archiving. Mineral site record linkage falls under the spatial record linkage category since the records contain information about the physical locations and non-spatial attributes in a tabular format. The task is particularly challenging due to the heterogeneity and vast scale of the data. While prior research employs pre-trained discriminative language models (PLMs) on spatial entity linkage, they often require substantial amounts of curated ground-truth data for fine-tuning. Gathering and creating ground truth data is both time-consuming and costly. Therefore, such approaches are not always feasible in real-world scenarios where gold-standard data are unavailable. Although large generative language models (LLMs) have shown promising results in various natural language processing tasks, including record linkage, their high inference time and resource demand present challenges. We propose a method that leverages an LLM to generate training data and fine-tune a PLM to address the training data gap while preserving the efficiency of PLMs. Our approach achieves over 45\% improvement in F1 score for record linkage compared to traditional PLM-based methods using ground truth data while reducing the inference time by nearly 18 times compared to relying on LLMs. Additionally, we offer an automated pipeline that eliminates the need for human intervention, highlighting this approach's potential to overcome record linkage challenges.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。