arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.04239cs.CL

面向在线辩论的人格知识对齐提示调优方法

Persona Knowledge-Aligned Prompt Tuning Method for Online Debate

The Hong Kong University of Science and Technology(香港科技大学);NVIDIA AI Technology Center (NVAITC)(英伟达人工智能技术中心)

Chunkit Chan, Cheng Jiayang, Xin Liu, Yauwai Yim, Yuxin Jiang, Zheye Deng, Haoran Li, Yangqiu Song, Ginny Y. Wong, Simon See

AI总结:

该研究针对在线辩论中论证质量评估未结合受众社会人格的问题,提出人格知识对齐框架,借助ChatGPT的涌现能力通过提示调优将受众人格知识注入小模型,实现了性能的显著持续提升。

摘要:

辩论是就特定问题交换观点或说服他人的过程。近期研究已提供实证证据,表明论证的说服力不仅取决于语言使用,还与传播者特征相关。研究者们已对语言层面的诸多方面(如语言特征、语篇结构)投入大量关注,但由于难度与复杂性,尚未有研究将论证说服力与影响力和受众的社会人格相结合。我们观察到ChatGPT具备出色的模拟与拟人能力,这表明大型预训练语言模型可作为个体提供人格特质,并基于不同背景知识发挥独特影响。因此,我们提出一种面向受众侧论证质量评估任务的人格知识对齐框架。这是首个利用ChatGPT的涌现能力、并通过提示调优将此类受众人格知识注入更小语言模型的研究。与同类主流架构相比,我们的流水线性能展现出显著且持续的提升。

英文摘要:

Debate is the process of exchanging viewpoints or convincing others on a particular issue. Recent research has provided empirical evidence that the persuasiveness of an argument is determined not only by language usage but also by communicator characteristics. Researchers have paid much attention to aspects of languages, such as linguistic features and discourse structures, but combining argument persuasiveness and impact with the social personae of the audience has not been explored due to the difficulty and complexity. We have observed the impressive simulation and personification capability of ChatGPT, indicating a giant pre-trained language model may function as an individual to provide personae and exert unique influences based on diverse background knowledge. Therefore, we propose a persona knowledge-aligned framework for argument quality assessment tasks from the audience side. This is the first work that leverages the emergence of ChatGPT and injects such audience personae knowledge into smaller language models via prompt tuning. The performance of our pipeline demonstrates significant and consistent improvement compared to competitive architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑