arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

Thinkink:与大语言模型的二维空间原生墨水交互

Thinkink: 2D Spatial Ink-native Interaction with LLMs

Mohammad Hasan Payandeh, Daniel Vogel, Jian Zhao

arXiv 2607.21468首次发表:更新:

发表机构

Cheriton School of Computer Science, University of Waterloo(滑铁卢大学计算机科学学院)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

为将大语言模型融入手写笔记和草图构思,提出Thinkink,通过语义树和轻量级UI实现交互,经三阶段设计,研究不同阶段用户实践及交互挑战,贡献设计启示与交互工具。

AI 中文摘要

人们常使用手写笔记和草图来外化构思想法。为将大语言模型(LLMs)融入此实践,我们提出了Thinkink。提示可以是手写文本或绘制的草图,LLM生成的响应可视化为类似墨水的文本和草图,并在空间上整合到共享画布中。语义树简化了墨水解释,轻量级用户界面使用状态机提供明确控制。该工具通过三个阶段设计。形成性研究(N = 12)考察了传统和数字墨水方法的当前实践。结果为诊断研究(N = 6)的技术探针提供信息,识别可用性和人机LLM交互挑战。这推动了Thinkink的设计,最终研究(N = 10)考察人们如何将其融入构思实践。我们贡献了设计启示以及一个用于原生墨水LLM交互的工具,用户和LLM可在共享二维画布上书写和绘制。

英文摘要

People often use handwritten notes and sketches to externalize ideas for ideation. To integrate large language models (LLMs) into this practice, we propose Thinkink. Prompts can be handwritten text or drawn sketches with LLM-generated responses visualized as ink-like text and sketches spatially integrated into a shared canvas. A semantic tree streamlines ink interpretation, and a lightweight UI provides explicit control using a state machine. The tool was designed using a three-stage process. A formative study (N=12) examined current practices with conventional and digital inking methods. The results informed a technical probe for a diagnostic study (N=6) identifying usability and human-LLM interaction challenges. This motivated the design of Thinkink, with a final study (N=10) examining how people incorporate it into their ideation practices. We contribute design implications and a tool for ink-native LLM interaction where the user and LLM write and draw in a shared 2D canvas.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑