arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.22913cs.CLcs.AI

主题分析混合框架:融合基于嵌入的回归模型与大语言模型

A Hybrid Framework for Subject Analysis: Integrating Embedding-Based Regression Models with Large Language Models

University of North Texas(北卡罗来纳大学达顿分校);University of Pittsburgh(匹兹堡大学)

Jinyu Liu, Xiaoying Song, Diana Zhang, Jason Thomale, Daqing He, Lingzi Hong

AI总结:

针对传统机器学习主题分析难处理未见过案例、大语言模型易过度生成和幻觉的问题,提出融合基于嵌入的机器学习模型与大语言模型的混合框架,通过预测标签数量引导生成、后编辑对齐词表,提升了图书主题术语预测的可控性与一致性。

摘要:

为信息资源提供主题检索途径是任何图书馆管理系统的核心功能。大语言模型(LLMs)已被广泛应用于分类和摘要任务,但其执行主题分析的能力尚未得到充分探索。传统机器学习(ML)模型的多标签分类方法已被用于主题分析,但难以处理未见过的案例。LLMs提供了另一种选择,但往往会过度生成内容并产生幻觉。因此,我们提出一种融合基于嵌入的ML模型与LLMs的混合框架。该方法利用ML模型:(1)预测最优的LCSH标签数量以指导LLM的预测;(2)用实际的LCSH术语对预测的术语进行后编辑,以减轻幻觉问题。我们使用LLMs和该混合框架开展实验,基于美国国会图书馆主题标目(LCSH)预测图书的主题术语。实验结果表明,提供初始预测来引导LLM生成并施加后编辑,能得到更可控、与词表更一致的输出结果。

英文摘要:

Providing subject access to information resources is an essential function of any library management system. Large language models (LLMs) have been widely used in classification and summarization tasks, but their capability to perform subject analysis is underexplored. Multi-label classification with traditional machine learning (ML) models has been used for subject analysis but struggles with unseen cases. LLMs offer an alternative but often over-generate and hallucinate. Therefore, we propose a hybrid framework that integrates embedding-based ML models with LLMs. This approach uses ML models to (1) predict the optimal number of LCSH labels to guide LLM predictions and (2) post-edit the predicted terms with actual LCSH terms to mitigate hallucinations. We experimented with LLMs and the hybrid framework to predict the subject terms of books using the Library of Congress Subject Headings (LCSH). Experiment results show that providing initial predictions to guide LLM generations and imposing post-edits result in more controlled and vocabulary-aligned outputs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑