arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.11230cs.HC
收藏

DiSCoKit:一种用于在调查研究中部署实时大语言模型体验的开源工具包

DiSCoKit: An Open-Source Toolkit for Deploying Live LLM Experiences in Survey Research

Syracuse University(雪城大学)

Jaime Banks, Jon Stromer-Galley, Samiksha Singh, Collin Capano

AI总结:

DiSCoKit是一种开源工具包,旨在通过JavaScript支持的调查平台部署实时大语言模型体验,以促进人类-人工智能交互动态的社会科学研究。

摘要:

推进人类-人工智能交互动态及结果的社会科学研究往往需要研究者通过在线调查平台向参与者提供实时大语言模型(LLMs)的体验。然而,从记录聊天数据到操控AI行为以适应实验设计等技术性和实用性挑战,常常阻碍了基于调查的AI刺激部署。我们开发了DiSCoKit——一种开源工具包,用于通过支持JavaScript的调查平台(如Qualtrics)部署实时LLM体验(例如基于通过微软Azure门户交付的模型)。本文介绍了该工具包,解释了其科学动因,描述了其架构和操作,以及其部署可能性和限制。

英文摘要:

Advancing social-scientific research of human-AI interaction dynamics and outcomes often requires researchers to deliver experiences with live large-language models (LLMs) to participants through online survey platforms. However, technical and practical challenges (from logging chat data to manipulating AI behaviors for experimental designs) often inhibit survey-based deployment of AI stimuli. We developed DiSCoKit--an open-source toolkit for deploying live LLM experiences (e.g., ones based on models delivered through Microsoft Azure portal) through JavaScript-enabled survey platforms (e.g., Qualtrics). This paper introduces that toolkit, explaining its scientific impetus, describes its architecture and operation, as well as its deployment possibilities and limitations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑