TaleForge:用于个性化故事创作的交互式多模态系统
TaleForge: Interactive Multimodal System for Personalized Story Creation
AI总结:
提出交互式多模态系统TaleForge,结合LLMs与文本到图像扩散技术,将用户面部嵌入故事叙事与插图,实现个性化文本与图像对齐的沉浸式体验。
摘要:
讲故事是一个高度个人化和创造性的过程,但现有方法通常将用户视为被动消费者,提供情节通用且个性化受限的内容。这削弱了参与度和沉浸感,尤其是在个人风格或外观至关重要的场景下。我们提出了TaleForge,一个个性化故事生成系统,它集成了大型语言模型(LLMs)和文本到图像扩散技术,将用户的面部图像嵌入到叙事和插图中。TaleForge包含三个互联模块:故事生成,LLMs根据用户提示创建叙事和角色描述;个性化图像生成,将用户的面部和服装选择合并到角色插图中;以及背景生成,创建包含个性化角色的场景背景。一项用户研究表明,当个体作为主角出现时,参与度和拥有感显著提升。参与者赞赏系统的实时预览和直观控制,尽管他们要求更精细的叙事编辑工具。TaleForge通过协调个性化文本和图像来创造沉浸式、以用户为中心的体验,推进了多模态叙事。
英文摘要:
Storytelling is a deeply personal and creative process, yet existing methods often treat users as passive consumers, offering generic plots with limited personalization. This undermines engagement and immersion, especially where individual style or appearance is crucial. We introduce TaleForge, a personalized story-generation system that integrates large language models (LLMs) and text-to-image diffusion to embed users' facial images within both narratives and illustrations. TaleForge features three interconnected modules: Story Generation, where LLMs create narratives and character descriptions from user prompts; Personalized Image Generation, merging users' faces and outfit choices into character illustrations; and Background Generation, creating scene backdrops that incorporate personalized characters. A user study demonstrated heightened engagement and ownership when individuals appeared as protagonists. Participants praised the system's real-time previews and intuitive controls, though they requested finer narrative editing tools. TaleForge advances multimodal storytelling by aligning personalized text and imagery to create immersive, user-centric experiences.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。