Gricea：面向对话式人工智能研究的开放科学平台
Gricea: An Open Science Platform for Conversational AI Research
浏览论文内容
中文总结 AI 辅助
Gricea是一个开放科学平台，通过将对话式AI研究表示为可配置、可部署的工件，支持研究的构建、复现与扩展，促进知识积累。
中文摘要 AI 辅助
我们需要大规模开展对话式人工智能（CAI）研究，以理解人类行为并塑造CAI的设计。然而，系统和研究配置的报告碎片化阻碍了复现、扩展和知识积累。我们提出了Gricea，一个开放科学平台，将研究表示为可配置、可部署的研究工件，研究人员可以运行、检查、共享和重用这些工件。基于对先前CAI研究的形成性分析，Gricea将研究程序、面向参与者的系统和对话任务行为耦合在一起。在一项使用Gricea的复现研究中，我们复现了93%符合条件的CUI 2026论文的配置；同时标记了96%的论文中缺失的信息，这些缺失阻碍了忠实复现——进一步证明了Gricea的必要性。在一项用户研究中，来自不同背景的研究人员和从业者成功构建了可运行的研究，解决了各种开放性问题。这些发现共同证明了Gricea通过共享研究工件支持构建、复现和扩展CAI研究，从而通过开放科学实现累积性知识构建。
英文摘要
We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. Informed by a formative analysis of prior CAI research, Gricea couples study procedures, participant-facing systems, and conversational task behavior in. In a replication study using Gricea, we replicated configurations 93% of eligible CUI 2026 papers; while also flagging missing information in 96% of papers that hinder faithful replication --- further motivating Gricea's need. In a user study, researchers and practitioners from diverse backgrounds successfully constructed runnable studies addressing various open-ended research questions. Together, these findings demonstrate Gricea's support for constructing, reproducing, and extending CAI studies through shared research artifacts, enabling cumulative knowledge building through open science.
发表机构
- Johns Hopkins University（约翰斯·霍普金斯大学）
机构由 AI 辅助整理，请以论文原文为准。
