Chart What I Say:探索 AI 辅助图表创作中的跨模态提示对齐
Chart What I Say: Exploring Cross-Modality Prompt Alignment in AI-Assisted Chart Authoring
AI总结:
本文比较图表创作中的语音与打字指令,揭示二者在命令格式和语言特征上的差异,并提出支持语音模态的系统设计指南与功能建议。
摘要:
近期的图表创作系统,例如 Amazon Q in QuickSight 和 Copilot for Power BI,展现出一种新兴关注点:支持自然语言输入,以通过创建图表分享来自数据的有意义洞察。当前,图表创作系统往往依赖语音转文字转录来集成语音输入能力,并以相似方式处理语音和打字输入。然而,其他交互领域中的跨模态输入比较表明,语音交互与打字交互的结构可能存在显著差异,这反映出用户基于界面可供性而产生的不同预期。因此,在本研究中,我们比较了用于图表创建的语音指令和打字指令。研究结果表明,尽管文本指令和语音指令都会涵盖图表元素及元素组织,但语音描述具有多种多样的命令格式、元素特征和复杂语言特征。基于这些发现,我们制定了面向语音的创作型系统设计指南,并提出了可整合到现有基于文本的系统中以支持语音模态的附加功能。
英文摘要:
Recent chart-authoring systems, such as Amazon Q in QuickSight and Copilot for Power BI, demonstrate an emergent focus on supporting natural language input to share meaningful insights from data through chart creation. Currently, chart-authoring systems tend to integrate voice input capabilities by relying on speech-to-text transcription, processing spoken and typed input similarly. However, cross-modality input comparisons in other interaction domains suggest that the structure of spoken and typed-in interactions could notably differ, reflecting variations in user expectations based on interface affordances. Thus, in this work, we compare spoken and typed instructions for chart creation. Findings suggest that while both text and voice instructions cover chart elements and element organization, voice descriptions have a variety of command formats, element characteristics, and complex linguistic features. Based on these findings, we developed guidelines for designing voice-based authoring-oriented systems and additional features that can be incorporated into existing text-based systems to support speech modality.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。