arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2407.16891cs.CYcs.CL

LLM的文化价值差异:提示、语言与模型规模

Cultural Value Differences of LLMs: Prompt, Language, and Model Size

Nanyang Technological University(南洋理工大学)

Qishuai Zhong, Yike Yun, Aixin Sun

AI总结:

本研究探究了提示语言、问题顺序和模型规模对LLM文化价值行为的影响,发现查询语言和模型规模是导致文化价值差异的主要因素。

摘要:

我们的研究旨在识别大型语言模型(LLM)展现的文化价值行为模式。研究的变体包括问题顺序、提示语言和模型规模。实验表明,每个受测LLM都能有效表现出不同的文化价值。更有趣的是:(i)当使用单一语言提示时,LLM展现出相对一致的文化价值。(ii)提示语言(如中文或英文)会影响文化价值的表达。同一问题在不同语言下查询同一LLM时,会引发不同的文化价值。(iii)同一模型不同规模(如Llama2-7B vs 13B vs 70B)的差异,比不同模型(如Llama2 vs Mixtral)的差异对文化价值的影响更显著。实验揭示,查询语言和模型规模是导致LLM文化价值差异的主要因素。

英文摘要:

Our study aims to identify behavior patterns in cultural values exhibited by large language models (LLMs). The studied variants include question ordering, prompting language, and model size. Our experiments reveal that each tested LLM can efficiently behave with different cultural values. More interestingly: (i) LLMs exhibit relatively consistent cultural values when presented with prompts in a single language. (ii) The prompting language e.g., Chinese or English, can influence the expression of cultural values. The same question can elicit divergent cultural values when the same LLM is queried in a different language. (iii) Differences in sizes of the same model (e.g., Llama2-7B vs 13B vs 70B) have a more significant impact on their demonstrated cultural values than model differences (e.g., Llama2 vs Mixtral). Our experiments reveal that query language and model size of LLM are the main factors resulting in cultural value differences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑