PrimeX:一个包含世界观、观点与解释的数据集
PrimeX: A Dataset of Worldview, Opinion, and Explanation
AI总结:
本研究构建了包含858名美国居民观点、观点解释及世界观信息的PrimeX数据集,验证了信念相关信息对语言模型个性化的价值,可为NLP与心理学研究提供支持。
摘要:
随着语言模型的应用不断推进,向模型更好地刻画个体用户的需求也日益增长。个体信念系统中是否存在语言模型可用于提升对齐效果的维度?沿用先前研究的思路,我们在观点预测领域探究这一问题,构建了PrimeX数据集——该数据集收录了858名美国居民的民意调查数据,并额外包含两类信念信息来源:受访者针对自身持有特定观点的原因撰写的解释,以及用于评估受访者世界观的Primal World Belief(原始世界信念)调查。我们对数据开展了全面的初步分析,证明了信念解释与世界观对语言模型个性化的价值。结果表明,PrimeX中的额外信念信息能够为NLP和心理学研究领域提供助力,为后续研究开辟了方向。
英文摘要:
As the adoption of language models advances, so does the need to better represent individual users to the model. Are there aspects of an individual's belief system that a language model can utilize for improved alignment? Following prior research, we investigate this question in the domain of opinion prediction by developing PrimeX, a dataset of public opinion survey data from 858 US residents with two additional sources of belief information: written explanations from the respondents for why they hold specific opinions, and the Primal World Belief survey for assessing respondent worldview. We provide an extensive initial analysis of our data and show the value of belief explanations and worldview for personalizing language models. Our results demonstrate how the additional belief information in PrimeX can benefit both the NLP and psychological research communities, opening up avenues for further study.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。