“我很高兴它开始产生一点幻觉”：使用 ClayFlect 协商多模态 AI 表征在物质意义建构中的作用
"I'm Very Happy for It to Start Hallucinating a Little Bit": Using ClayFlect to Negotiate Multimodal AI Representations in Material Meaning-Making
浏览论文内容
中文总结 AI 辅助
本研究提出 ClayFlect 系统，结合触觉黏土与多模态生成 AI，通过混合方法研究发现 AI 表征可协商性，支持用户意义建构并保留控制权。
中文摘要 AI 辅助
随着 AI 进入反思和情感支持领域，理解它如何在保留用户对解释的权威的同时参与个人意义建构变得越来越重要。我们提出了 ClayFlect，一种新颖的基于 MLLM 的系统，将触觉黏土制作与对话式和视觉生成式 AI 相结合，并报告了一项涉及 50 名参与者的混合方法研究。反思在物质、对话和生成形式中发展，而非仅通过 AI 交互。参与者将 AI 表征视为暂时的：他们比较、重定向、重新解释、选择性地整合或搁置这些表征，随着他们的制品和意义的发展。黏土提供了一个可直接操作的空间，参与者可以在其中独立于 AI 继续发展意义，而生成的表征则外化了超出他们轻易制作或可视化范围的可能性。我们展示了生成式 AI 如何通过保持可协商性的表征来参与，并得出了支持跨表征移动、保留并行控制点以及允许 AI 支持在反思展开时退却或加深的启示。
英文摘要
As AI enters reflection and emotional support, understanding how it can participate in personal meaning-making while preserving users' authority over interpretation is increasingly important. We present ClayFlect, a novel MLLM-powered system integrating tactile clay-making with conversational and visual generative AI, and report a mixed-methods study with 50 participants. Reflection developed across material, conversational, and generated forms rather than through AI interaction alone. Participants treated AI representations as provisional: they compared, redirected, reinterpreted, selectively incorporated, or left them aside as their artefacts and meanings evolved. Clay provided a directly manipulable space in which participants could continue developing meaning independently of the AI, while generated representations externalised possibilities beyond what they could readily make or visualise. We show how generative AI can participate through representations that remain negotiable, and derive implications for supporting movement across representations, preserving parallel sites of control, and allowing AI support to recede or deepen as reflection unfolds.
发表机构
- Singapore University of Technology and Design（新加坡科技设计大学）
机构由 AI 辅助整理，请以论文原文为准。
