ECHO:一个用于评估聊天、人类行为和结果的开放研究平台
ECHO: An Open Research Platform for Evaluation of Chat, Human Behavior, and Outcomes
AI总结:
ECHO是一个开放平台,用于评估聊天系统、人类行为和结果,通过整合多种实验流程和工具,降低研究学习、决策和用户体验的技术门槛。
摘要:
ECHO(聊天、人类行为和结果评估)是一个开放的研究平台,旨在支持可重复的、混合方法研究人类与对话式人工智能系统和网络搜索引擎的互动。它使来自不同学科的研究人员能够 orchestrate 端到端的实验工作流程,整合知情同意和背景调查、基于聊天和搜索的信息获取会话、写作或判断任务,以及前后任务评估,所有这些都在一个统一的、低编码负载框架中。ECHO记录细粒度的交互轨迹和参与者响应,并导出结构化数据集供后续分析。通过支持聊天和搜索以及灵活的评估工具,ECHO降低了研究学习、决策和用户体验在不同信息获取范式中的技术障碍,使信息检索、人机交互和社会科学的研究人员能够进行可扩展和可重复的人中心AI评估。
英文摘要:
ECHO (Evaluation of Chat, Human behavior, and Outcomes) is an open research platform designed to support reproducible, mixed-method studies of human interaction with both conversational AI systems and Web search engines. It enables researchers from varying disciplines to orchestrate end-to-end experimental workflows that integrate consent and background surveys, chat-based and search-based information-seeking sessions, writing or judgment tasks, and pre- and post-task evaluations within a unified, low-coding-load framework. ECHO logs fine-grained interaction traces and participant responses, and exports structured datasets for downstream analysis. By supporting both chat and search alongside flexible evaluation instruments, ECHO lowers technical barriers for studying learning, decision making, and user experience across different information access paradigms, empowering researchers from information retrieval, HCI, and the social sciences to conduct scalable and reproducible human-centered AI evaluations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。