检验和解决大语言模型生成想法中的多样性障碍
Examining and Addressing Barriers to Diversity in LLM-Generated Ideas
AI总结:
本文研究了LLM生成想法的多样性问题,通过四种研究发现,通过链式推理提示和普通人物提示可分别减少固定现象和改善知识分区,从而提升想法多样性。
摘要:
人类独立样本生成的想法通常比独立LLM样本生成的想法更加多样,这引发了对广泛依赖LLM可能使想法同质化并损害社会层面创新的担忧。基于认知心理学,我们识别(理论和实证上)两种削弱LLM想法多样性的机制。首先,在个体层面,LLM表现出与人类相同的固定现象,早期输出会限制后续的想法生成。其次,在集体层面,LLM将知识整合为统一分布,而不是像人类群体那样表现出知识分区,每个个体占据知识空间的不同区域。通过四项研究,我们证明有针对性的提示干预可以独立解决每种机制:链式推理(CoT)提示通过鼓励结构化推理(仅在LLM中有效,而非人类)减少固定现象,而普通人物(而非“创意企业家”如史蒂夫·乔布斯)通过作为多样采样提示改善知识分区,将生成锚定在语义空间的不同区域。结合两种方法产生最高想法多样性,优于人类。这些发现提供了一个理论基础的框架来理解LLM想法多样性,并为利用AI效率而不牺牲健康创新生态系统中多样性的重要策略。
英文摘要:
Ideas generated by independent samples of humans tend to be more diverse than ideas generated from independent LLM samples, raising concerns that widespread reliance on LLMs could homogenize ideation and undermine innovation at a societal level. Drawing on cognitive psychology, we identify (both theoretically and empirically) two mechanisms undermining LLM idea diversity. First, at the individual level, LLMs exhibit fixation just as humans do, where early outputs constrain subsequent ideation. Second, at the collective level, LLMs aggregate knowledge into a unified distribution rather than exhibiting the knowledge partitioning inherent to human populations, where each person occupies a distinct region of the knowledge space. Through four studies, we demonstrate that targeted prompting interventions can address each mechanism independently: Chain-of-Thought (CoT) prompting reduces fixation by encouraging structured reasoning (only in LLMs, not humans), while ordinary personas (versus "creative entrepreneurs" such as Steve Jobs) improve knowledge partitioning by serving as diverse sampling cues, anchoring generation in distinct regions of the semantic space. Combining both approaches produces the highest idea diversity, outperforming humans. These findings offer a theoretically grounded framework for understanding LLM idea diversity and practical strategies for human-AI collaborations that leverage AI's efficiency without compromising the diversity essential to a healthy innovation ecosystem.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。