arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.13382cs.CLcs.HC
收藏

人工智能中介交流中句子级建议与消息级建议的比较

Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication

Cornell University(康奈尔大学);Thomson Reuters Labs(汤森路透实验室);Allen Institute for Artificial Intelligence(艾伦人工智能研究所)

Liye Fu, Benjamin Newman, Maurice Jakesch, Sarah Kreps

摘要:

传统上,写作辅助系统专注于简短甚至单个单词的建议。最近,像GPT-3这样的大语言模型已经可以生成更长的自然建议,提供更高级的帮助机会。本研究探讨了句子与消息级别的建议之间的权衡人工智能介导的通信。我们招募了120名参与者,作为立法者办公室的工作人员,他们经常需要对大量的选民关注做出回应。参与者被要求回复电子邮件,提供不同类型的帮助。结果表明,收到消息级别建议的参与者响应更快,对体验更满意,因为他们主要编辑建议的草稿。此外,他们写的文章被其他人评价为更有帮助。相比之下,接受中级援助的参与者保留了更高的代理感,但需要更长的时间完成任务,因为他们需要计划他们的回应流程并决定何时使用建议。我们的研究结果对设计适合任务的沟通辅助系统具有一定的意义。

英文摘要:

Traditionally, writing assistance systems have focused on short or even single-word suggestions. Recently, large language models like GPT-3 have made it possible to generate significantly longer natural-sounding suggestions, offering more advanced assistance opportunities. This study explores the trade-offs between sentence- vs. message-level suggestions for AI-mediated communication. We recruited 120 participants to act as staffers from legislators' offices who often need to respond to large volumes of constituent concerns. Participants were asked to reply to emails with different types of assistance. The results show that participants receiving message-level suggestions responded faster and were more satisfied with the experience, as they mainly edited the suggested drafts. In addition, the texts they wrote were evaluated as more helpful by others. In comparison, participants receiving sentence-level assistance retained a higher sense of agency, but took longer for the task as they needed to plan the flow of their responses and decide when to use suggestions. Our findings have implications for designing task-appropriate communication assistance systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑