arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2402.13623cs.CLcs.SI
收藏

FLAME:利用大语言模型的自监督低资源分类体系扩展

FLAME: Self-Supervised Low-Resource Taxonomy Expansion using Large Language Models

Indian Institute of Technology Delhi(印度德里理工学院);Samsung Research and Development Institute(三星研发研究院)

Sahil Mishra, Ujjwal Sudev, Tanmoy Chakraborty

AI总结:

本文提出FLAME,一种利用大语言模型和强化学习在低资源场景下自动扩展分类体系的方法,在三个基准上相比八个基线准确率提升18.5%、Wu & Palmer指标提升12.3%。

摘要:

分类体系表示一种树状层级结构,用于建立实体之间的关系,以在特定领域内传递知识。分类体系中的每条边表示上位词-下位词关系。分类体系在电子商务搜索引擎和推荐系统等多种实际应用中具有重要价值。因此,随着时间推移,有必要对这些分类体系进行扩充。然而,由于可用人力资源有限且数据呈指数级增长,利用新数据人工维护分类体系面临挑战。因此,开发自动分类体系扩展方法变得至关重要。传统的监督式分类体系扩展方法由于现有分类体系规模较小,面临资源有限的困难。训练数据的稀缺往往导致过拟合。在本文中,我们提出了FLAME,这是一种在低资源环境下利用大语言模型能力进行分类体系扩展的新方法,这些大语言模型在海量现实世界知识上进行了训练。大语言模型有助于弥补领域特定知识的不足。具体而言,FLAME在少样本设置下利用提示来提取大语言模型中的内在知识,确定分类体系中的上位词实体。此外,它采用强化学习对大语言模型进行微调,从而获得更准确的预测。在三个真实世界基准数据集上的实验证明了FLAME在真实场景中的有效性,与八个基线相比,准确率显著提高了18.5%,Wu & Palmer指标提高了12.3%。此外,我们通过在基准上的广泛案例研究、错误分析和消融研究,阐明了FLAME的优势与不足。

英文摘要:

Taxonomies represent an arborescence hierarchical structure that establishes relationships among entities to convey knowledge within a specific domain. Each edge in the taxonomy signifies a hypernym-hyponym relationship. Taxonomies find utility in various real-world applications, such as e-commerce search engines and recommendation systems. Consequently, there arises a necessity to enhance these taxonomies over time. However, manually curating taxonomies with neoteric data presents challenges due to limitations in available human resources and the exponential growth of data. Therefore, it becomes imperative to develop automatic taxonomy expansion methods. Traditional supervised taxonomy expansion approaches encounter difficulties stemming from limited resources, primarily due to the small size of existing taxonomies. This scarcity of training data often leads to overfitting. In this paper, we propose FLAME, a novel approach for taxonomy expansion in low-resource environments by harnessing the capabilities of large language models that are trained on extensive real-world knowledge. LLMs help compensate for the scarcity of domain-specific knowledge. Specifically, FLAME leverages prompting in few-shot settings to extract the inherent knowledge within the LLMs, ascertaining the hypernym entities within the taxonomy. Furthermore, it employs reinforcement learning to fine-tune the large language models, resulting in more accurate predictions. Experiments on three real-world benchmark datasets demonstrate the effectiveness of FLAME in real-world scenarios, achieving a remarkable improvement of 18.5% in accuracy and 12.3% in Wu & Palmer metric over eight baselines. Furthermore, we elucidate the strengths and weaknesses of FLAME through an extensive case study, error analysis and ablation studies on the benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑