arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.09438cs.HC
收藏

意图透镜:推断捕获时间意图以将机会性照片捕获转化为结构化视觉笔记

Intent Lenses: Inferring Capture-Time Intent to Transform Opportunistic Photo Captures into Structured Visual Notes

Saarland University, Saarland Informatics Campus(萨尔兰大学,萨尔兰信息学园区);University of Koblenz(科布伦茨大学)

Ashwin Ram, Aeneas Leon Sommer, Martin Schmitz, Jürgen Steimle

AI总结:

本文提出意图透镜,通过大语言模型动态生成交互式对象,将捕获意图转化为结构化视觉笔记,提升信息复用和深度理解。

摘要:

机会性照片捕获(如幻灯片、展览或文物)是信息丰富环境中保存信息的常见策略,但通常缺乏意义。本文引入意图透镜,通过大语言模型推断捕获意图,生成可重用的交互对象,编码功能、信息源和结果表示层次,用于学术会议照片等场景,通过用户交互生成结构化视觉笔记,实验表明意图驱动的笔记符合用户预期,有效支持深入理解。

英文摘要:

Opportunistic photo capture (e.g., slides, exhibits, or artifacts) is a common strategy for preserving information encountered in information-rich environments for later revisitation. While fast and minimally disruptive, such photo collections rarely become meaningful notes. Existing automatic note-generation approaches provide some support but often produce generic summaries that fail to reflect what users intended to capture. We introduce Intent Lenses, a conceptual primitive for intent-mediated note generation and sensemaking. Intent Lenses reify users' capture-time intent inferred from captured information into reusable interactive objects that encode the function to perform, the information sources to focus on, and how results are represented at an appropriate level of detail. These lenses are dynamically generated using the reasoning capabilities of large language models. To investigate this concept, we instantiate Intent Lenses in the context of academic conference photos and present an interactive system that infers lenses from presentation captures to generate structured visual notes on a spatial canvas. Users can further add, link, and arrange lenses across captures to support exploration and sensemaking. A study with nine academics showed that intent-mediated notes aligned with users' expectations, providing effective overviews of their captures while facilitating deeper sensemaking.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑