AI-Wrapped:参与式、隐私保护的长期LLM使用情况实地测量
AI-Wrapped: Participatory, Privacy-Preserving Measurement of Longitudinal LLM Use In-the-Wild
AI总结:
本文提出AI-Wrapped系统,通过隐私保护的方式收集真实LLM聊天使用数据,并分析用户使用模式及主题,揭示用户在日常场景中对LLM的使用特点及潜在问题。
摘要:
大型语言模型(LLM)对齐研究日益依赖于理解这些系统在日常情境中的使用方式。然而,由于隐私限制和平台控制,自然互动数据难以获取。我们提出了AI-Wrapped,一种原型工作流程,用于收集自然的LLM聊天机器人使用数据,同时向参与者提供即时的“包裹”式报告,包括使用统计数据、主要主题和行为模式。我们报告了在初始部署中,82名美国成年人从2025年的48,495次对话中获得的发现。参与者将LLM用于工具性和反思性目的,主题包含情感或存在性主题。某些使用模式反映了潜在的过度依赖或完美主义。高使用用户相比主要交易性用户表现出更多的反思交流。方法上,即使在零数据保留和PII去除的情况下,参与者可能仍因隐私和判断风险而犹豫分享聊天数据,这凸显了在构建对齐研究测量基础设施时透明设计的重要性。
英文摘要:
Alignment research on large language models (LLMs) increasingly depends on understanding how these systems are used in everyday contexts. Yet naturalistic interaction data is difficult to access due to privacy constraints and platform control. We present AI-Wrapped, a prototype workflow for collecting naturalistic LLM chatbot usage data while providing participants with an immediate "wrapped"-style report on their usage statistics, top topics, and behavioral patterns. We report findings from an initial deployment with 82 U.S.-based adults across 48,495 conversations from their 2025 chat histories. Participants used LLMs for both instrumental and reflective purposes and had topics with emotional or existential themes. Some usage patterns reflect potential over-reliance or perfectionism. Heavy users showed comparatively more reflective exchanges than primarily transactional ones. Methodologically, even with zero data retention and PII removal, participants may remain hesitant to share chat data due to perceived privacy and judgment risks, underscoring the importance of transparent design when building measurement infrastructure for alignment research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。