arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.06186cs.CLcs.AI
收藏

Clue-Instruct:面向教育类填字游戏的基于文本的线索生成

Clue-Instruct: Text-Based Clue Generation for Educational Crossword Puzzles

University of Siena(锡耶纳大学)

Andrea Zugarini, Kamyar Zeinalipour, Surya Sai Kadali, Marco Maggini, Marco Gori, Leonardo Rigutini

AI总结:

针对教育类填字游戏线索数据缺失问题,提出基于 Wikipedia 文本与 LLM 自动生成教学线索的方法,构建含 44,075 个样本的 clue-instruct 数据集,并通过人工与自动评估验证其有效性。

摘要:

填字游戏是广受欢迎的语言游戏,常被用作吸引学生参与学习的工具。教育类填字游戏的特点是线索不那么隐晦,而更偏重事实,这使其区别于传统填字游戏。尽管已经存在若干公开可用的传统填字游戏线索-答案对数据库,但教育类线索-答案对数据集仍然缺失。本文中,我们提出了一种构建教育类线索生成数据集的方法,该数据集可用于指导大语言模型(LLM)。通过从 Wikipedia 页面收集与相关关键词关联的信息性内容,我们利用大语言模型自动生成与给定输入关键词及其上下文相关的教学线索。借助这种方法,我们创建了 clue-instruct,这是一个包含 44,075 个唯一样本的数据集,其中文本-关键词对关联了三条不同的填字游戏线索。我们使用 clue-instruct 指导不同的 LLM 根据给定输入内容和关键词生成教育类线索。人工评估与自动评估均证实了所生成线索的质量,从而验证了我们方法的有效性。

英文摘要:

Crossword puzzles are popular linguistic games often used as tools to engage students in learning. Educational crosswords are characterized by less cryptic and more factual clues that distinguish them from traditional crossword puzzles. Despite there exist several publicly available clue-answer pair databases for traditional crosswords, educational clue-answer pairs datasets are missing. In this article, we propose a methodology to build educational clue generation datasets that can be used to instruct Large Language Models (LLMs). By gathering from Wikipedia pages informative content associated with relevant keywords, we use Large Language Models to automatically generate pedagogical clues related to the given input keyword and its context. With such an approach, we created clue-instruct, a dataset containing 44,075 unique examples with text-keyword pairs associated with three distinct crossword clues. We used clue-instruct to instruct different LLMs to generate educational clues from a given input content and keyword. Both human and automatic evaluations confirmed the quality of the generated clues, thus validating the effectiveness of our approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑