arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.13952cs.CLcs.HC
收藏

通过过度生成与排序探索利用大型语言模型自动生成关键词助记法

Exploring Automated Keyword Mnemonics Generation with Large Language Models via Overgenerate-and-Rank

University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校)

Jaewook Lee, Hunter McNichols, Andrew Lan

AI总结:

本文提出了一种基于大型语言模型的过度生成与排序方法,用于自动生成关键词助记法的言语线索,实验表明其在意象性、连贯性和有用性上与人类生成的助记法相当。

摘要:

在本文中,我们研究了语言与词汇学习中一个探索不足的领域:关键词助记法,这是一种通过与目标词建立易于记忆的联想,并借助言语线索来记忆词汇的技术。通常,创建言语线索需要大量的人力且相当耗时,因此需要一种更具可扩展性的自动化方法。我们提出了一种新颖的过度生成与排序方法,通过提示大型语言模型(LLMs)生成言语线索,然后根据心理语言学指标和一项初步用户研究的启示对它们进行排序。为了评估线索质量,我们进行了关于意象性和连贯性的自动评估,以及涉及英语教师和学习者的人工评估。结果显示,LLM生成的助记法在意象性、连贯性和感知有用性方面与人类生成的助记法相当,但由于语言学习者背景和偏好的多样性,仍有很大的改进空间。

英文摘要:

In this paper, we study an under-explored area of language and vocabulary learning: keyword mnemonics, a technique for memorizing vocabulary through memorable associations with a target word via a verbal cue. Typically, creating verbal cues requires extensive human effort and is quite time-consuming, necessitating an automated method that is more scalable. We propose a novel overgenerate-and-rank method via prompting large language models (LLMs) to generate verbal cues and then ranking them according to psycholinguistic measures and takeaways from a pilot user study. To assess cue quality, we conduct both an automated evaluation of imageability and coherence, as well as a human evaluation involving English teachers and learners. Results show that LLM-generated mnemonics are comparable to human-generated ones in terms of imageability, coherence, and perceived usefulness, but there remains plenty of room for improvement due to the diversity in background and preference among language learners.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑