arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.09457cs.HC
收藏

“良好的开端,但……”:评估LLM生成的思维导图在基于视频的设计中的信息映射作用

"A Great Start, But...": Evaluating LLM-Generated Mind Maps for Information Mapping in Video-Based Design

Tianhao He, Karthi Saravanan, Evangelos Niforatos, Gerd Kortuem

AI总结:

本研究招募28名VBD从业者,对比经提示调优的LLM与专业设计师生成的民族志视频思维导图,发现LLM擅抓核心概念但层级组织与情境落地不足,提出相关优化方向以指导LLM辅助VBD信息映射研究。

摘要:

在基于视频的设计(Video-Based Design, VBD)中,从视频中提取概念并理解关联关系至关重要——视频是探索的主要媒介,但管理元信息需要耗费大量精力。思维导图凭借其可视化组织复杂数据的能力,为视频内容的结构化与分析提供了颇具前景的路径。大语言模型(Large Language Models, LLMs)的最新进展为VBD领域的元信息处理与视觉理解带来了新机遇,但其应用仍未得到充分探索。本研究招募了28名VBD从业者,探究经提示调优的LLM从民族志视频生成思维导图的应用效果。研究将LLM生成的思维导图与专业设计师制作的思维导图进行对比,在两种场景下评估了评分、设计有效性与用户体验。结果显示,LLM能有效捕捉核心概念,但在层级组织与情境落地方面存在不足。我们探讨了信任度、定制化与工作流整合这几个关键因素,为未来VBD中LLM辅助信息映射的研究提供方向。

英文摘要:

Extracting concepts and understanding relationships from videos is essential in Video-Based Design (VBD), where videos serve as a primary medium for exploration but require significant effort in managing meta-information. Mind maps, with their ability to visually organize complex data, offer a promising approach for structuring and analysing video content. Recent advancements in Large Language Models (LLMs) provide new opportunities for meta-information processing and visual understanding in VBD, yet their application remains underexplored. This study recruited 28 VBD practitioners to investigate the use of prompt-tuned LLMs for generating mind maps from ethnographic videos. Comparing LLM-generated mind maps with those created by professional designers, we evaluated rated scores, design effectiveness, and user experience across two contexts. Findings reveal that LLMs effectively capture central concepts but struggle with hierarchical organization and contextual grounding. We discuss trust, customization, and workflow integration as key factors to guide future research on LLM-supported information mapping in VBD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑