A comprehensive solution to retrieval-based chatbot construction
Monash Biomedical Imaging, Monash University, Australia(墨尔本大学生物医学成像中心,墨尔本大学,澳大利亚);Department of Computer Science and Information Technology, La Trobe University, Australia(拉特鲁布大学计算机科学与信息技术系,拉特鲁布大学,澳大利亚)
Kristen Moore, Shenjun Zhong, Zhen He, Torsten Rudolf, Nils Fisher, Brandon Victor, Neha Jindal
In this paper we present the results of our experiments in training and deploying a self-supervised retrieval-based chatbot trained with contrastive learning for assisting customer support agents. In contrast to most existing research papers in this area where the focus is on solving just one component of a deployable chatbot, we present an end-to-end set of solutions to take the reader from an unlabelled chatlogs to a deployed chatbot. This set of solutions includes creating a self-supervised dataset and a weakly labelled dataset from chatlogs, as well as a systematic approach to selecting a fixed list of canned responses. We present a hierarchical-based RNN architecture for the response selection model, chosen for its ability to cache intermediate utterance embeddings, which helped to meet deployment inference speed requirements. We compare the performance of this architecture across 3 different learning objectives: self-supervised contrastive learning, binary classification, and multi-class classification. We find that using a self-supervised contrastive learning model outperforms training the binary and multi-class classification models on a weakly labelled dataset. Our results validate that the self-supervised contrastive learning approach can be effectively used for a real-world chatbot scenario.
Learning Implicit User Profiles for Personalized Retrieval-Based Chatbot
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(大数据管理与分析方法北京市重点实验室);Université de Montréal(蒙特利尔大学)
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
State Key Lab of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);Microsoft Research(微软研究院);College of Computer and Control Engineering, Nankai University(南开大学计算机与控制工程学院)
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
National Engineering Laboratory for Speech and Language Information Processing, University of Science and Technology of China(中国科学技术大学语音及语言信息处理国家工程实验室);State Key Laboratory of Cognitive Intelligence, iFLYTEK Research(科大讯飞研究院认知智能国家重点实验室)
Do AI chatbots find what experts would? Effects of model, user role, and sample size on study retrieval for medical questions
National Institute on Drug Abuse(国家药物滥用研究所);National Institutes of Health(美国国立卫生研究院);National Library of Medicine(国家医学图书馆);School of Information Sciences, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校信息科学学院)
Citation-Enhanced Generation for LLM-based Chatbots
Tsinghua University(清华大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);Jiangsu Collaborative Innovation Center for Language Competence(江苏省语言能力协同创新中心)
RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaboration
Center for Brain Inspired Computing Research (CBICR), Tsinghua University(清华大学脑启发计算研究中心);Optical Memory National Engineering Research Center, Tsinghua University(清华大学光存储国家工程研究中心);Tsinghua University-China Electronics Technology HIK Group Co. Joint Research Center for Brain-inspired Computing(清华大学-中国电子 hik 集团联合脑启发计算研究中心);IDG/McGovern Institute for Brain Research, Tsinghua University(清华大学 IDG/麦戈文脑科学研究院);Tsinghua University(清华大学)
Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots
Wangxuan Institute of Computer Technology(王选计算机技术研究所);Center for Data Science(数据科学中心);Academy for Advanced Interdisciplinary Studies(前沿交叉学科研究院);Peking University(北京大学);Soochow University(苏州大学);Gaoling School of Artificial Intelligence(高瓴人工智能学院);Renmin University of China(中国人民大学)
CRISS: A Retrieval-Augmented AI Chatbot for Assisting Cancer Registrars
University of Missouri(密苏里大学);Missouri Cancer Registry and Research Center(密苏里癌症登记与研究中心);MU Institute for Data Science and Informatics(密苏里大学数据科学与信息学研究所)
History of generative Artificial Intelligence (AI) chatbots: past, present, and future development
University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校);Asian University of Bangladesh(亚洲孟加拉大学);Sonargaon University(索纳尔冈大学);Babes-Bolyai University(巴比什-博雅依大学);Islamic University(伊斯兰大学);University of Chittagong(吉大港大学)
Towards Comprehensive Vietnamese Retrieval-Augmented Generation and Large Language Models
Foundation Models Lab, BKAI(BKAI基础模型实验室);Hanoi University of Science and Technology(河内科技大学);University of Information Technology(信息技术大学);Vietnam National University HCMC(胡志明市越南国家大学)