Collecting high quality conversational data can be very expensive for most applications and infeasible for others due to privacy, ethical, or similar concerns. A promising direction to tackle this problem is to generate synthetic dialogues by prompting large language models. In this work, we use a small set of expert-written conversations as in-context examples to synthesize a social conversation dataset using prompting. We perform several thorough evaluations of our synthetic conversations compared to human-collected conversations. This includes various dimensions of conversation quality with human evaluation directly on the synthesized conversations, and interactive human evaluation of chatbots fine-tuned on the synthetically generated dataset. We additionally demonstrate that this prompting approach is generalizable to multi-party conversations, providing potential to create new synthetic data for multi-party tasks. Our synthetic multi-party conversations were rated more favorably across all measured dimensions compared to conversation excerpts sampled from a human-collected multi-party dataset.
AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptation
School of Computer Science and Engineering, Key Laboratory of Computer Network and Information Integration, Ministry of Education, Southeast University(计算机科学与工程学院、计算机网络与信息集成重点实验室、教育部、东南大学)
Detecting Conversational Mental Manipulation with Intent-Aware Prompting
The University of Sydney(悉尼大学);University of Technology Sydney(悉尼科技大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Harvard University(哈佛大学);University of New South Wales(新南威尔士大学)
Reading Between the Lines: The One-Sided Conversation Problem
Paul G. Allen School of Computer Science & Engineering, University of Washington(保罗·G·阿伦计算机科学与工程学院,华盛顿大学);Allen Institute for Artificial Intelligence(阿伦人工智能研究所);Hearvana AI
Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration
National University of Singapore(新加坡国立大学);Singapore Management University(新加坡管理大学);The Chinese University of Hong Kong(香港中文大学);Sichuan University(四川大学)
The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QA
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);CAS Key Lab of Network Data Science and Technology, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所网络数据科学与技术重点实验室)
本文提出 WSDM Cup 2024 对话式多文档问答冠军方案,通过 LLM 适配、混合训练、文档过滤与模型集成取得第一名。
A Personalized Conversational Benchmark: Towards Simulating Personalized Conversations
University of Southern California(南加州大学);Adobe Research(Adobe研究院);University of California, San Diego(加州大学圣地亚哥分校);Intel AI Research(英特尔人工智能研究);University of Maryland, College Park(马里兰大学学院市分校);Vanderbilt University(范德比大学);Virginia Polytechnic Institute and State University(弗吉尼亚理工学院和州立大学);University of Notre Dame(诺特丹大学);University of Oregon(俄勒冈大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);Arizona State University(亚利桑那州立大学)
Contextual Dynamic Prompting for Response Generation in Task-oriented Dialog Systems
AWS AI Labs(AWS人工智能实验室);University of Chicago(芝加哥大学)
响应生成是面向任务的对话系统的关键组成部分之一。现有的研究表明,大型预训练的语言模型可以适应这项任务。适应这种极其大的大语言模型的典型范例是通过对下游任务进行微调,这不仅耗时,而且涉及大量资源和对微调数据的访问。修正(Schick and Schütze,2020)已经成为许多NLP任务中微调的替代方案。在我们的工作中,我们探索的想法,使用提示响应生成面向任务的对话系统。具体来说,我们提出了一种方法,执行上下文动态提示的提示是从对话上下文学习。我们的目标是从对话上下文中提取有用的提示信号。在使用MultiWOZ 2.2数据集的实验中(Zang等人,2020),我们表明,上下文动态提示改善反应生成的综合得分(Mehri等人,2019年)由3个绝对点,和一个巨大的20点时,对话状态的合并。此外,这些对话的人类注释发现,结合上下文的代理人比香草前缀调整的代理人更受欢迎。