使用关键词法的文本到图像生成用于词汇学习
Text-to-Image Generation for Vocabulary Learning Using the Keyword Method
AI总结:
本文将关键词法与文本到图像生成结合,经初步研究和多生成器比较后选用DALL-E2,实验证明外化的视觉联系图像可显著提升外语词汇记忆保持。
摘要:
“关键词法”是一种学习外语词汇的有效技术。它涉及在单词的含义与其外语发音在学习者母语中的听感之间,建立令人难忘的视觉联系。然而,这些令人难忘的视觉联系仍隐含在人们的脑海中,面对大量词汇时并不容易记住。为了增强词汇的记忆和回忆,我们开发了一款应用程序,将关键词法与文本到图像生成器相结合,把令人难忘的视觉联系外化为视觉内容。这些视觉内容在记忆过程中代表额外的刺激。为探索该方法的有效性,我们首先开展了一项初步研究,要求参与者写下难忘联系的心理可视化描述,以调查将这些描述外化有多困难。我们将这些描述作为文本到图像生成器(DALL-E2)的提示,将其转换为图像,并要求参与者选择他们最喜欢的图像。接下来,我们比较了不同的文本到图像生成器(DALL-E2、Midjourney、Stable Diffusion和Latent Diffusion),以评估每个生成器所生成图像的感知质量。尽管结果存在差异,但参与者大多更喜欢DALL-E2生成的图像,因此最终研究也使用了该模型。在这项研究中,我们调查了与仅使用关键词法相比,提供此类图像是否能增强所学词汇的保持效果。我们的结果表明,人们在描述其对难忘联系的可视化时并未遇到困难,并且提供相应图像显著提高了记忆保持。
英文摘要:
The 'keyword method' is an effective technique for learning vocabulary of a foreign language. It involves creating a memorable visual link between what a word means and what its pronunciation in a foreign language sounds like in the learner's native language. However, these memorable visual links remain implicit in the people's mind and are not easy to remember for a large set of words. To enhance the memorisation and recall of the vocabulary, we developed an application that combines the keyword method with text-to-image generators to externalise the memorable visual links into visuals. These visuals represent additional stimuli during the memorisation process. To explore the effectiveness of this approach we first run a pilot study to investigate how difficult it is to externalise the descriptions of mental visualisations of memorable links, by asking participants to write them down. We used these descriptions as prompts for text-to-image generator (DALL-E2) to convert them into images and asked participants to select their favourites. Next, we compared different text-to-image generators (DALL-E2, Midjourney, Stable and Latent Diffusion) to evaluate the perceived quality of the generated images by each. Despite heterogeneous results, participants mostly preferred images generated by DALL-E2, which was used also for the final study. In this study, we investigated whether providing such images enhances the retention of vocabulary being learned, compared to the keyword method only. Our results indicate that people did not encounter difficulties describing their visualisations of memorable links and that providing corresponding images significantly improves memory retention.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。