arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.05080cs.HCcs.AI
收藏

关于大型语言模型在创建合成人物角色时偏见问题的担忧

Concerns on Bias in Large Language Models when Creating Synthetic Personae

Università Di Trento(特伦托大学)

Helena A. Haxvig

AI总结:

本文基于使用情景短文的子研究,揭示黑盒LLM存在偏见且可被操纵,主张在HCI研究中用其生成合成人物角色前必须充分测试并重视伦理与定制挑战。

摘要:

本立场论文探讨了在HCI研究中纳入合成人物角色的益处、弊端与伦理考量,尤其关注超越当前大型语言模型(LLM)局限性之外的定制化挑战。这些观点源自一项子研究的初步结果;该研究采用情景短文来展示黑盒LLM中偏见的存在,并探索操纵这些偏见的方法。本研究旨在为理解与这些模型相关的挑战奠定基础,强调在利用它们为HCI研究创建合成人物角色之前进行充分测试的必要性。

英文摘要:

This position paper explores the benefits, drawbacks, and ethical considerations of incorporating synthetic personae in HCI research, particularly focusing on the customization challenges beyond the limitations of current Large Language Models (LLMs). These perspectives are derived from the initial results of a sub-study employing vignettes to showcase the existence of bias within black-box LLMs and explore methods for manipulating them. The study aims to establish a foundation for understanding the challenges associated with these models, emphasizing the necessity of thorough testing before utilizing them to create synthetic personae for HCI research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑