The Turing test examines whether AIs exhibit human-like behaviour in natural language conversations. The traditional setting limits each participant to one message at a time and requires constant human participation. This fails to reflect a natural conversational style and hinders the evaluation of dialogue agents based on Large Language Models (LLMs) in complex and prolonged interactions. This paper proposes \textbf{\textsc{X-Turing}}, which enhances the original test with a \textit{burst dialogue} pattern, allowing more dynamic exchanges using consecutive messages. It further reduces human workload by iteratively generating dialogues that simulate the long-term interaction between the agent and a human to compose the majority of the test process. With the \textit{pseudo-dialogue} history, the agent then engages in a shorter dialogue with a real human, which is paired with a human-human conversation on the same topic to be judged using questionnaires. We introduce the \textit{X-Turn Pass-Rate} metric to assess the human likeness of LLMs across varying durations. While LLMs like GPT-4 initially perform well, achieving pass rates of 51.9\% and 38.9\% during 3 turns and 10 turns of dialogues respectively, their performance drops as the dialogue progresses, which underscores the difficulty in maintaining consistency in the long term.
RogueAI: A Reverse Turing Test for Detecting Licensed AI Deception in Dialogue
AILab, MIGe, University of Trieste(的里雅斯特大学);Computational Statistics and Machine Learning, Istituto Italiano di Tecnologia(意大利理工学院);DIA, University of Trieste(的里雅斯特大学)
PRIDE: Privileged Information-enhanced Distillation for Empathetic Dialogue Generation
Anhui Robot Technology Standard Innovation Base, School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院安徽机器人技术标准创新基地)
BAP v2: An Enhanced Task Framework for Instruction Following in Minecraft Dialogues
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft(微软);University of Massachusetts Amherst(马萨诸塞大学阿姆赫斯特分校);Amazon(亚马逊);Amazon AGI(亚马逊人工智能实验室)
MotivGraph-SoIQ: Integrating Motivational Knowledge Graphs and Socratic Dialogue for Enhanced LLM Ideation
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems(认知与决策智能复杂系统重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Hunan Provincial Key Laboratory of Philosophy and Social Sciences of Artificial Intelligence and Precision International, Hunan Normal University(湖南省人工智能与精准哲学社会科学省级重点实验室,湖南师范大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models
the Department of Computer Science and Engineering, Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系);the institute of information engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);the College of Computer, National University of Defense Technology(国防科技大学计算机学院);the University of Sydney(悉尼大学)
Sentiment-enhanced Graph-based Sarcasm Explanation in Dialogue
Shandong University(山东大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);Shandong Jianzhu University(山东建筑大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
QDA-SQL: Questions Enhanced Dialogue Augmentation for Multi-Turn Text-to-SQL
School of Cyberspace Science Harbin Institute of Technology Harbin, China(网络空间科学学院 哈尔滨工业大学 哈尔滨,中国);School of Computer Science(计算机科学学院);Technology Harbin University of Science(技术 哈尔滨理工大学);School of Cyberspace Science Harbin Institute of Technology, Shenzhen Shenzhen, China(网络空间科学学院 哈尔滨工业大学深圳 哈尔滨,中国)
Planning Like Human: A Dual-process Framework for Dialogue Planning
Harbin Institute of Technology(哈尔滨工业大学);Singapore Management University(新加坡管理大学);School of Computer Science, Fudan University(复旦大学计算机科学学院);Peng Cheng Laboratory(鹏城实验室)
Domain Knowledge-Enhanced LLMs for Fraud and Concept Drift Detection
School of Computing and Augmented Intelligence (SCAI), Arizona State University (ASU)(计算与增强智能学院(SCAI),亚利桑那州立大学);Department of Computer Engineering, Tarsus University(计算机工程系,塔鲁斯大学);Minerva CQ and HumaConn AI Consulting(Minerva CQ和HumaConn人工智能咨询);School of Computing and Augmented Intelligence (SCAI), Arizona State University(计算与增强智能学院(SCAI),亚利桑那州立大学)
Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);School of Data Science, University of Science and Technology of China(中国科学技术大学数据科学学院);Tencent Youtu Lab(腾讯优图实验室)
Enhancing User-Oriented Proactivity in Open-Domain Dialogues with Critic Guidance
South China University of Technology(华南理工大学);Peng Cheng Laboratory(鹏城实验室);Pazhou Laboratory(琶洲实验室);Tencent AI Lab(腾讯AI实验室);Tencent Robotics X Lab(腾讯机器人X实验室);Hong Kong Polytechnic University(香港理工大学);Hunan University(湖南大学)