arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.03375cs.HC
收藏

我提示,它生成,我们协商。探索使用VLMs在人类与AI共创视觉叙事中的文本-图像互文性

I Prompt, it Generates, we Negotiate. Exploring Text-Image Intertextuality in Human-AI Co-Creation of Visual Narratives with VLMs

Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));The University of Sydney(悉尼大学);Hong Kong Polytechnic University(香港理工大学);Aarhus University(奥胡斯大学);Institute for Network Sciences and Cyberspace, Tsinghua University(清华大学网络科学与网络空间研究院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Swinburne University of Technology(斯威本科技大学)

Mengyao Guo, Kexin Nie, Ze Gao, Black Sun, Xueyang Wang, Jinda Han, Xingting Wu

AI总结:

本研究通过GPT-4o对15名参与者进行定性分析,揭示了人类与AI共创视觉叙事中的文本-图像互文性,识别出四种协作模式与三条成功路径,并提出了基于角色的AI助手设计启示。

摘要:

通过人类与AI协作创作有意义的视觉叙事,需要理解当文本意图遇到AI生成的视觉内容时,文本-图像互文性是如何产生的。我们对15名参与者使用GPT-4o进行了三阶段的定性研究,以调查新手如何驾驭顺序视觉叙事。研究结果表明,用户通过识别超越字面描述的有意义的视觉内容、迭代细化提示词,以及通过互补的文本-图像关系构建叙事意义,制定了利用AI语义盈余的策略。我们识别出四种不同的协作模式,并通过fsQCA分析,发现了实现成功互文协作的三条路径:教育协作者、技术专家和视觉思考者。然而,参与者面临挑战,包括文化表征差距、视觉一致性问题,以及将叙事概念转化为视觉提示词的困难。这些发现为HCI研究做出了贡献,提供了人类与AI共创中“文本-图像互文性”的实证描述,并提出了基于角色的AI助手的设计启示,以更好地支持视觉叙事中迭代的、人类主导的创意过程。

英文摘要:

Creating meaningful visual narratives through human-AI collaboration requires understanding how text-image intertextuality emerges when textual intentions meet AI-generated visuals. We conducted a three-phase qualitative study with 15 participants using GPT-4o to investigate how novices navigate sequential visual narratives. Our findings show that users develop strategies to harness AI's semantic surplus by recognizing meaningful visual content beyond literal descriptions, iteratively refining prompts, and constructing narrative significance through complementary text-image relationships. We identified four distinct collaboration patterns and, through fsQCA's analysis, discovered three pathways to successful intertextual collaboration: Educational Collaborator, Technical Expert, and Visual Thinker. However, participants faced challenges, including cultural representation gaps, visual consistency issues, and difficulties translating narrative concepts into visual prompts. These findings contribute to HCI research by providing an empirical account of \textit{text-image intertextuality} in human-AI co-creation and proposing design implications for role-based AI assistants that better support iterative, human-led creative processes in visual storytelling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑