arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.10240cs.HCcs.AIcs.CV

AltCanvas:面向盲人或视力障碍人群的基于生成式AI的瓦片图像编辑器

AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People

Stanford University(斯坦福大学);University of Michigan(密歇根大学)

Seonghee Lee, Maho Kohga, Steve Landau, Sile O'Modhrain, Hari Subramonyam

AI总结:

针对视觉障碍人士在图像创作中缺乏精确控制与表现力的问题,提出基于瓦片界面的生成式AI图像编辑器AltCanvas,支持逐步构建场景、语音反馈及触觉图形输出,有效提升了盲人或低视力用户的插图创作能力。

摘要:

视觉障碍人士在创作高度依赖视觉元素的内容时常遇到困难,尤其是在传达空间和结构信息时。现有的无障碍绘图工具采用逐行构建图像的方式,适用于数学等简单任务,但不适合更具表现力的艺术创作。另一方面,新兴的基于生成式AI的文本到图像工具能根据自然语言描述生成富有表现力的插图,但缺乏对图像构图和属性的精确控制。为弥补这一空白,我们的工作将生成式AI与一种构造性方法相结合,为用户提供增强的控制和编辑能力。我们的系统AltCanvas采用基于瓦片的界面,使用户能够逐步构建视觉场景,每个瓦片代表场景中的一个对象。用户可以添加、编辑、移动和排列对象,同时接收语音和音频反馈。完成后,场景可渲染为彩色插图或用于触觉图形生成的矢量图。在设计与评估阶段,我们邀请了14名盲人或低视力用户参与,发现参与者能够有效使用AltCanvas工作流来创作插图。

英文摘要:

People with visual impairments often struggle to create content that relies heavily on visual elements, particularly when conveying spatial and structural information. Existing accessible drawing tools, which construct images line by line, are suitable for simple tasks like math but not for more expressive artwork. On the other hand, emerging generative AI-based text-to-image tools can produce expressive illustrations from descriptions in natural language, but they lack precise control over image composition and properties. To address this gap, our work integrates generative AI with a constructive approach that provides users with enhanced control and editing capabilities. Our system, AltCanvas, features a tile-based interface enabling users to construct visual scenes incrementally, with each tile representing an object within the scene. Users can add, edit, move, and arrange objects while receiving speech and audio feedback. Once completed, the scene can be rendered as a color illustration or as a vector for tactile graphic generation. Involving 14 blind or low-vision users in design and evaluation, we found that participants effectively used the AltCanvas workflow to create illustrations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑