arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.16164cs.HC

AI驱动的数据科学中的对话挑战:障碍、需求与设计机遇

Conversational Challenges in AI-Powered Data Science: Obstacles, Needs, and Design Opportunities

Bhavya Chopra, Ananya Singha, Anna Fariha, Sumit Gulwani, Chris Parnin, Ashish Tiwari, Austin Z. Henley

AI总结:

本研究通过混合方法揭示了数据科学家在使用LLM聊天机器人时面临的上下文检索、提示词构建等挑战,并提出了数据刷选和探究式反馈循环等设计建议以改善交互。

摘要:

大型语言模型(LLMs)正越来越多地被应用于数据科学中,用于数据预处理和分析等任务。然而,数据科学家在与LLM驱动的聊天机器人对话并根据其建议和答案采取行动时,遇到了重大障碍。我们进行了一项混合方法研究,包括情境观察、半结构化访谈(n=14)和问卷调查(n=114),以识别这些挑战。我们的发现突出了数据科学家面临的关键问题,包括上下文数据检索、为复杂任务制定提示词、将生成的代码适配到本地环境,以及迭代地优化提示词。基于这些见解,我们提出了可操作的设计建议,例如数据刷选以支持上下文选择,以及探究式反馈循环,以改善数据科学工具中与AI助手的交流。

英文摘要:

Large Language Models (LLMs) are being increasingly employed in data science for tasks like data preprocessing and analytics. However, data scientists encounter substantial obstacles when conversing with LLM-powered chatbots and acting on their suggestions and answers. We conducted a mixed-methods study, including contextual observations, semi-structured interviews (n=14), and a survey (n=114), to identify these challenges. Our findings highlight key issues faced by data scientists, including contextual data retrieval, formulating prompts for complex tasks, adapting generated code to local environments, and refining prompts iteratively. Based on these insights, we propose actionable design recommendations, such as data brushing to support context selection, and inquisitive feedback loops to improve communications with AI-based assistants in data-science tools.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑