arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.02007cs.HCcs.AI
收藏

TactStyle:面向数字制造的基于生成式AI的触觉纹理生成

TactStyle: Generating Tactile Textures with Generative AI for Digital Fabrication

MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);Vellore Institute of Technology(韦洛尔理工大学);Zhejiang University(浙江大学);University of Canterbury(坎特伯雷大学)

Faraz Faruqi, Maxine Perroni-Scharf, Jaskaran Singh Walia, Yunyi Zhu, Shuyue Feng, Donald Degraen, Stefanie Mueller

AI总结:

TactStyle系统通过微调图像生成模型生成高度场,将触觉特性融入3D模型风格化,实现从单一图像输入生成匹配视觉风格并复现触觉体验的3D打印纹理。

摘要:

生成式AI的最新研究使得基于图像提示的3D模型风格化成为可能。然而,这些方法未包含触觉信息,导致设计缺乏预期的触觉特性。我们提出了TactStyle系统,它允许创作者在用图像对3D模型进行风格化的同时,融入预期的触觉特性。TactStyle通过使用一个经过微调的改进型图像生成模型来实现这一点,该模型被微调以生成给定表面纹理的heightfields(高度场)。通过优化3D模型表面以体现生成的纹理,TactStyle创建出既匹配所需风格又复现触觉体验的模型。我们利用大规模纹理数据集来训练我们的纹理生成模型。在一项心理物理学实验中,我们评估了一组3D打印的原始纹理和TactStyle生成纹理的触觉质量。结果表明,TactStyle成功地从单一图像输入中生成了广泛的触觉特征,为触觉设计提供了一种新方法。

英文摘要:

Recent work in Generative AI enables the stylization of 3D models based on image prompts. However, these methods do not incorporate tactile information, leading to designs that lack the expected tactile properties. We present TactStyle, a system that allows creators to stylize 3D models with images while incorporating the expected tactile properties. TactStyle accomplishes this using a modified image-generation model fine-tuned to generate heightfields for given surface textures. By optimizing 3D model surfaces to embody a generated texture, TactStyle creates models that match the desired style and replicate the tactile experience. We utilize a large-scale dataset of textures to train our texture generation model. In a psychophysical experiment, we evaluate the tactile qualities of a set of 3D-printed original textures and TactStyle's generated textures. Our results show that TactStyle successfully generates a wide range of tactile features from a single image input, enabling a novel approach to haptic design.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑