arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.14523cs.CYcs.AIcs.CL
收藏

共情与成为例外的权利:大语言模型能做什么、不能做什么

Empathy and the Right to Be an Exception: What LLMs Can and Cannot Do

Status Labs;University at Albany, State University of New York(纽约州立大学奥尔巴尼分校);IBM Research – Thomas J. Watson Research Center(IBM研究院 – 托马斯·J·沃森研究中心)

William Kidder, Jason D'Cruz, Kush R. Varshney

AI总结:

该研究围绕大语言模型的共情能力展开,探讨其因依赖语言模式而非人类共情机制,是否无法尊重个体成为例外的权利,明确共情在此场景下的独特价值,并提出后续研究方向。

摘要:

大语言模型(LLMs)的性能提升促使部分研究者提出人工智能(AI)中已出现心智理论(ToM)的观点。LLMs能够归因信念、欲望、意图与情绪,且其准确性还将不断提升。但它们并未采用人类特有的共情方式,而是通过识别数据集中的语言模式来学习归因心理状态,这类数据集通常并不包含对应的个体本身。我们提出疑问:LLMs无法共情的特性,是否会阻碍它们尊重个体“成为例外的权利”,即是否无法做出能恰当体现对个体独特性敏感度的品格评估与行为预测。LLMs能否认真考量个体基于信念、欲望、意图等内在心理状态提出的“自身情况与众不同”的主张,还是说它们只能基于该案例与其他案例的相似性来作出判断?我们提出,共情方法对于尊重“成为例外的权利”具有特殊意义,这一意义有别于LLMs所擅长的预测准确性的价值。我们最后探讨了运用共情感知例外案例是具有内在价值还是仅具有实用价值,并介绍了推进这一研究的概念性与实证性路径。

英文摘要:

Advances in the performance of large language models (LLMs) have led some researchers to propose the emergence of theory of mind (ToM) in artificial intelligence (AI). LLMs can attribute beliefs, desires, intentions, and emotions, and they will improve in their accuracy. Rather than employing the characteristically human method of empathy, they learn to attribute mental states by recognizing linguistic patterns in a dataset that typically do not include that individual. We ask whether LLMs' inability to empathize precludes them from honoring an individual's right to be an exception, that is, from making assessments of character and predictions of behavior that reflect appropriate sensitivity to a person's individuality. Can LLMs seriously consider an individual's claim that their case is different based on internal mental states like beliefs, desires, and intentions, or are they limited to judging that case based on its similarities to others? We propose that the method of empathy has special significance for honoring the right to be an exception that is distinct from the value of predictive accuracy, at which LLMs excel. We conclude by considering whether using empathy to consider exceptional cases has intrinsic or merely practical value and we introduce conceptual and empirical avenues for advancing this investigation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑