为视障人士生成基于文本的触觉图形
Text-based Tactile Graphics Generation for the Visually Impaired
浏览论文内容
中文总结 AI 辅助
研究为视障人士开发基于文本生成触觉图形的集成系统，引入制作感知技术，能联合生成多种元素，经评估和用户研究，结果优于基线，拓宽了生成式AI对视障群体及其他人的可及性。
中文摘要 AI 辅助
触觉图形是盲人和低视力人群获取非文本信息的主要媒介，但难以规模化或个性化。近期生成模型虽革新视觉内容创作，但不满足触觉需求。本文提出首个集成生成系统，可根据自然语言提示直接生成可用于制作的2.5D触觉图形，联合生成全局基础几何形状、细粒度触觉表面纹理和符合标准的盲文。该方法引入了制作感知技术，包括模板引导的浮雕生成、基于快速扩散的文本到纹理模块以及严格的基础扁平化。大量评估和用户研究表明，参与者更青睐该系统的结果。此工作将生成图形从屏幕扩展到可触摸浮雕，拓宽了视障群体及其他人群对生成式人工智能的使用。
英文摘要
Tactile graphics are a primary medium for blind and low-vision (BLV) individuals to access non-textual information. However, they are difficult to scale or personalize. While recent generative models have revolutionized visual content creation, they are optimized for screen-based visual realism and fail to satisfy the haptic perceptual and physical fabrication constraints required for touch. We present the first integrated generative system that produces fabrication-ready 2.5D tactile graphics directly from natural language prompts, jointly generating global base geometry, fine-grained tactile surface textures, and standard-compliant braille within a unified 3D-printable representation. Our approach introduces fabrication-aware techniques, including template-guided relief generation, a fast diffusion-based text-to-texture module for high-resolution tileable normal maps, and strict base flattening to ensure tactile readability and printability, while supporting both automatic generation and interactive texture control. Extensive evaluations, together with in-person user studies with BLV participants and blindfolded sighted participants using physically 3D-printed outputs, show that participants consistently prefer our results over baselines. By extending generative graphics beyond screens to touchable reliefs, our work broadens access to generative AI for the BLV community and beyond.
发表机构
- Carnegie Mellon University（卡内基梅隆大学）
- Seoul National University（首尔大学）
- University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
机构由 AI 辅助整理，请以论文原文为准。
