Epistemic Diversity and Knowledge Collapse in Large Language Models
知识多样性与大语言模型中的知识崩溃
Dustin Wright, Sarah Masud, Jared Moore, Srishti Yadav, Maria Antoniak, Peter Ebert Christensen, Chan Young Park, Isabelle Augenstein
机构
*
University of Copenhagen(哥本哈根大学)
;
Aalborg University Copenhagen(奥胡斯大学哥本哈根分校)
;
Stanford University(斯坦福大学)
;
University of Colorado Boulder(科罗拉多大学波德分校)
;
Microsoft Research(微软研究院)
Comments16 pages; 8 figures, 4 tables; v2 changelog: Fixed the modeling for table 3, random effect is the model version; v3 changelog: Fixed minor formatting issues in tables 2 and 3; v4 changelog: Fixed some typos and model description; v5 changelog: Updated metadata; v6 changelog: Improved search baseline, writing revisions, added comparisons to semantic similarity only approaches