Recent advances in Natural Language Interfaces (NLIs) and Large Language Models (LLMs) have transformed our approach to NLP tasks, shifting the focus towards a more Pragmatics-based approach. This shift enables more natural interactions between humans and voice assistants, which have been historically difficult to achieve. Pragmatics involves understanding how users often talk out of turn, interrupt one another, or provide relevant information without being explicitly asked (maxim of quantity). To explore this, we developed a digital assistant that continuously listens to conversations and proactively generates relevant visualizations during data exploration tasks. In a within-subject study, participants interacted with both proactive and non-proactive versions of a voice assistant while exploring the Hawaii Climate Data Portal (HCDP). Results suggest that the proactive assistant enhanced user engagement and facilitated quicker insights. Our study highlights the potential of Pragmatic, proactive AI in NLIs and identifies key challenges in its implementation, offering insights for future research.
Paul G. Allen School of Computer Science & Engineering, University of Washington(保罗·G·阿伦计算机科学与工程学院,华盛顿大学);Allen Institute for Artificial Intelligence(阿伦人工智能研究所)
Gaze-Informed Proactive AI Assistance for Children's Picture Exploration
Saarland University(萨尔兰大学);Tübingen Digital Teaching Lab (TüDiLab)(蒂宾根数字教学实验室);Leibniz-Institut für Wissensmedien (IWM Tübingen)(莱布尼茨知识媒体研究所);Research Institute for Information Technology, Kyushu University(九州大学信息技术研究院)