arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.06177cs.IR
收藏

HierLLM:用于问题推荐的分层大语言模型

HierLLM: Hierarchical Large Language Model for Question Recommendation

Yuxuan Liu, Haipeng Liu, Ting Long

AI总结:

针对问题推荐中的冷启动与题库规模过大问题,本文提出基于 LLM 的分层模型 HierLLM,先识别相关概念再选择问题,并通过实验验证其优越性能。

摘要:

问题推荐是一项为学生按顺序推荐问题以提升其学习效率的任务。也就是说,给定一名学生的学习历史和学习目标,问题推荐器应当选择能够为学生带来最大提升的问题。以往方法通常将问题推荐建模为一个序列决策问题,利用学习历史估计学生的学习状态,并将学习状态与学习目标一起输入神经网络,以从问题集中选择推荐问题。然而,以往方法面临两个挑战:(1)在冷启动场景中学习历史不可用,这会使推荐器产生不合适的推荐;(2)问题集规模非常大,使推荐器难以精确选择最佳问题。为应对这些挑战,我们提出了一种称为用于问题推荐的分层大语言模型(HierLLM)的方法,它是一种基于 LLM 的分层结构。基于 LLM 的结构使 HierLLM 能够借助 LLM 强大的推理能力解决冷启动问题。分层结构利用了概念数量显著少于问题数量这一事实,通过首先识别待推荐问题的相关概念,然后基于该概念选择推荐问题,来缩小可选问题的范围。这种分层结构降低了推荐难度。为研究 HierLLM 的性能,我们开展了大量实验,结果证明了 HierLLM 的出色性能。

英文摘要:

Question recommendation is a task that sequentially recommends questions for students to enhance their learning efficiency. That is, given the learning history and learning target of a student, a question recommender is supposed to select the question that will bring the most improvement for students. Previous methods typically model the question recommendation as a sequential decision-making problem, estimating students' learning state with the learning history, and feeding the learning state with the learning target to a neural network to select the recommended question from a question set. However, previous methods are faced with two challenges: (1) learning history is unavailable in the cold start scenario, which makes the recommender generate inappropriate recommendations; (2) the size of the question set is much large, which makes it difficult for the recommender to select the best question precisely. To address the challenges, we propose a method called hierarchical large language model for question recommendation (HierLLM), which is a LLM-based hierarchical structure. The LLM-based structure enables HierLLM to tackle the cold start issue with the strong reasoning abilities of LLM. The hierarchical structure takes advantage of the fact that the number of concepts is significantly smaller than the number of questions, narrowing the range of selectable questions by first identifying the relevant concept for the to-recommend question, and then selecting the recommended question based on that concept. This hierarchical structure reduces the difficulty of the recommendation.To investigate the performance of HierLLM, we conduct extensive experiments, and the results demonstrate the outstanding performance of HierLLM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑