首页/论文/2006.14767

arXiv 2006.147672020-06-26cs.CL

Dialog as a Vehicle for Lifelong Learning

University of Texas at Austin（德克萨斯大学奥斯汀分校）

Aishwarya Padmakumar, Raymond J. Mooney

备注：: Position Paper Track at the SIGDIAL Special Session on Physically Situated Dialogue (RoboDial 2.0) - Camera Ready Version

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

Dialog systems research has primarily been focused around two main types of applications - task-oriented dialog systems that learn to use clarification to aid in understanding a goal, and open-ended dialog systems that are expected to carry out unconstrained "chit chat" conversations. However, dialog interactions can also be used to obtain various types of knowledge that can be used to improve an underlying language understanding system, or other machine learning systems that the dialog acts over. In this position paper, we present the problem of designing dialog systems that enable lifelong learning as an important challenge problem, in particular for applications involving physically situated robots. We include examples of prior work in this direction, and discuss challenges that remain to be addressed.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Lifelong and Interactive Learning of Factual Knowledge in Dialogues

University of Illinois at Chicago（伊利诺伊大学芝加哥分校）

Dialogue systems are increasingly using knowledge bases (KBs) storing real-world facts to help generate quality responses. However, as the KBs are inherently incomplete and remain fixed during conversation, it limits dialogue systems' ability to answer questions and to handle questions involving entities or relations that are not in the KB. In this paper, we make an attempt to propose an engine for Continuous and Interactive Learning of Knowledge (CILK) for dialogue systems to give them the ability to continuously and interactively learn and infer new knowledge during conversations. With more …

2019-12-21cs.AIcs.CLcs.HC

Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue

The Hong Kong University of Science and Technology（香港科技大学）；Alibaba Group（阿里巴巴集团）；The Chinese University of Hong Kong（香港中文大学）

Lifelong learning (LL) is vital for advanced task-oriented dialogue (ToD) systems. To address the catastrophic forgetting issue of LL, generative replay methods are widely employed to consolidate past knowledge with generated pseudo samples. However, most existing generative replay methods use only a single task-specific token to control their models. This scheme is usually not strong enough to constrain the generative model due to insufficient information involved. In this paper, we propose a novel method, prompt conditioned VAE for lifelong learning (PCLL), to enhance generative replay by in…

2022-11-24cs.AIcs.CLcs.LG

终身与持续学习对话系统

Lifelong and Continual Learning Dialogue Systems

Intel Labs（英特尔实验室）；University of Illinois at Chicago (UIC)（伊利诺伊大学芝加哥分校）；Indian Institute of Technology (IIT) - Roorkee（印度理工学院鲁尔基分校）

本书提出终身学习对话系统范式，使聊天机器人能在与用户和环境的自主交互中持续学习语言、知识、样本与对话技能，并综述相关技术进展与未来挑战。

2024-06-17cs.AIcs.CLcs.HC

Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the Job

University of Illinois at Chicago（伊利诺伊大学芝加哥分校）

Dialogue systems, also called chatbots, are now used in a wide range of applications. However, they still have some major weaknesses. One key weakness is that they are typically trained from manually-labeled data and/or written with handcrafted rules, and their knowledge bases (KBs) are also compiled by human experts. Due to the huge amount of manual effort involved, they are difficult to scale and also tend to produce many errors ought to their limited ability to understand natural language and the limited knowledge in their KBs. Thus, the level of user satisfactory is often low. In this pape…

2021-02-24cs.AIcs.CLcs.HC

我跑得像兔子一样快，你呢？一个多语言明喻对话数据集

I run as fast as a rabbit, can you? A Multilingual Simile Dialogue Dataset

School of Information Science, Beijing Language and Culture University（北京语言大学信息科学学院）；School of Computer Science, Harbin Institute of Technology（哈尔滨工业大学计算机科学学院）

本文提出最大规模的多语言明喻对话数据集 MSD（约 20K），涵盖英中双语，并设计明喻识别、解释、生成及对话检索、生成共 5 个任务，通过强基线模型实验验证了该数据集的挑战性。

2024-10-18cs.CL

Conversational Intent Understanding for Passengers in Autonomous Vehicles

Intel Labs（英特尔实验室）；Anticipatory Computing Lab（预期计算实验室）

Understanding passenger intents and extracting relevant slots are important building blocks towards developing a contextual dialogue system responsible for handling certain vehicle-passenger interactions in autonomous vehicles (AV). When the passengers give instructions to AMIE (Automated-vehicle Multimodal In-cabin Experience), the agent should parse such commands properly and trigger the appropriate functionality of the AV system. In our AMIE scenarios, we describe usages and support various natural commands for interacting with the vehicle. We collected a multimodal in-cabin data-set with m…

2018-12-14cs.CL

更多相关论文收起更多论文

对话式代码生成：为自动驾驶车辆测试设计驾驶场景生成对话系统的案例研究

Conversational Code Generation: a Case Study of Designing a Dialogue System for Generating Driving Scenarios for Testing Autonomous Vehicles

School of Informatics, University of Edinburgh 10 Crichton Street, Edinburgh EH8 9AB（信息学院，爱丁堡大学）

本研究设计了一个基于指令遵循大语言模型的自然语言界面，用于将非编程专家的对话转换为符号程序以生成自动驾驶测试场景，实验证明对话可将生成成功率提升4.5倍。

2025-09-08cs.CLcs.IRcs.RO

Audio-Visual Understanding of Passenger Intents for In-Cabin Conversational Agents

Intel Labs（英特尔实验室）

Building multimodal dialogue understanding capabilities situated in the in-cabin context is crucial to enhance passenger comfort in autonomous vehicle (AV) interaction systems. To this end, understanding passenger intents from spoken interactions and vehicle vision systems is a crucial component for developing contextual and visually grounded conversational agents for AV. Towards this goal, we explore AMIE (Automated-vehicle Multimodal In-cabin Experience), the in-cabin agent responsible for handling multimodal passenger-vehicle interactions. In this work, we discuss the benefits of a multimod…

2020-07-08cs.CL

Deploying Lifelong Open-Domain Dialogue Learning

Facebook AI Research（Facebook 人工智能研究院）

Much of NLP research has focused on crowdsourced static datasets and the supervised learning paradigm of training once and then evaluating test performance. As argued in de Vries et al. (2020), crowdsourced data has the issues of lack of naturalness and relevance to real-world use cases, while the static dataset paradigm does not allow for a model to learn from its experiences of using language (Silver et al., 2013). In contrast, one might hope for machine learning systems that become more useful as they interact with people. In this work, we build and deploy a role-playing game, whereby human…

2020-08-19cs.AIcs.CL

Towards Multimodal Understanding of Passenger-Vehicle Interactions in Autonomous Vehicles: Intent/Slot Recognition Utilizing Audio-Visual Data

Intel Labs（英特尔实验室）

Understanding passenger intents from spoken interactions and car's vision (both inside and outside the vehicle) are important building blocks towards developing contextual dialog systems for natural interactions in autonomous vehicles (AV). In this study, we continued exploring AMIE (Automated-vehicle Multimodal In-cabin Experience), the in-cabin agent responsible for handling certain multimodal passenger-vehicle interactions. When the passengers give instructions to AMIE, the agent should parse such commands properly considering available three modalities (language/text, audio, video) and tri…

2019-09-20cs.CLcs.CVcs.MM

LifeSide: 将智能体作为终身数字伴侣的基准测试

LifeSide: Benchmarking Agents as Lifelong Digital Companions

Hong Kong University of Science and Technology (Guangzhou)（香港理工大学（广州））；Hong Kong University of Science and Technology（香港理工大学）；Tencent（腾讯）

针对现有评估无法捕捉终身数字伴侣所需的多会话记忆、用户理解和隐私适应能力的问题，提出LifeSide基准，通过多智能体模拟构建记忆-情感-环境循环，评估模型在记忆追踪、用户理解、隐私控制和情感陪伴方面的表现，发现即使当前记忆基准饱和的模型也无法在长期内维持准确的用户理解和真正的陪伴。

2026-06-03cs.CL

DRIVE：面向智能车辆环境的富含不流利现象的合成对话数据生成框架

DRIVE: Disfluency-Rich Synthetic Dialog Data Generation Framework for Intelligent Vehicle Environments

Indian Institute of Technology Bombay（印度理工学院班加罗尔学院）

提出 DRIVE 框架下的 DiscoDrive 合成语料库，在七类车载多轮对话中动态融入不流利现象，验证其可提升模型性能、低资源增强效果与人评自然度。

2025-07-26cs.CL