arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.02065cs.CLcs.AI
收藏

了解你的受众:大语言模型能否适应不同年龄和教育水平?

Know Your Audience: Do LLMs Adapt to Different Age and Education Levels?

Bocconi University(博科尼大学)

Donya Rooein, Amanda Cercas Curry, Dirk Hovy

AI总结:

本文评估了四种大语言模型在面向不同年龄和教育水平受众回答科学问题时的可读性适应性,发现其可读性范围固定、适配能力不足,并指出需增强教育场景下的受众适应能力。

摘要:

大语言模型(LLMs)提供了一系列新的可能性,包括将文本适配给不同受众及其阅读需求。但它们适配得有多好?我们评估了四个最先进的大语言模型(商业和开源)在回答科学问题时,被提示面向不同年龄组和教育水平时所生成答案的可读性。为了评估大语言模型对不同受众的适应性,我们将生成回答的可读性分数与每个年龄和教育群体推荐的理解水平进行比较。我们发现不同大语言模型生成答案的可读性存在很大差异。我们的结果表明,大语言模型的回答需要更好地适配目标受众的人口特征,才能更容易被理解。这强调了在教育环境中增强大语言模型适应性的重要性,以服务于不同年龄和教育水平的人群。总体而言,当前的大语言模型具有固定的可读性范围,即使在提示下也不能很好地适应不同受众。这限制了它们在教育用途上的潜力。

英文摘要:

Large language models (LLMs) offer a range of new possibilities, including adapting the text to different audiences and their reading needs. But how well do they adapt? We evaluate the readability of answers generated by four state-of-the-art LLMs (commercial and open-source) to science questions when prompted to target different age groups and education levels. To assess the adaptability of LLMs to diverse audiences, we compare the readability scores of the generated responses against the recommended comprehension level of each age and education group. We find large variations in the readability of the answers by different LLMs. Our results suggest LLM answers need to be better adapted to the intended audience demographics to be more comprehensible. They underline the importance of enhancing the adaptability of LLMs in education settings to cater to diverse age and education levels. Overall, current LLMs have set readability ranges and do not adapt well to different audiences, even when prompted. That limits their potential for educational purposes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑