arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.15634cs.GR
收藏

面向语义体绘制的基于文本的传输函数设计

Text-based Transfer Function Design for Semantic Volume Rendering

Sangwon Jeong, Jixian Li, Christopher Johnson, Shusen Liu, Matthew Berger

AI总结:

针对体绘制中传输函数设计难度大、存在语义鸿沟的问题,提出结合语言-视觉模型、全可微渲染管线与文本引导图像损失的方法,可基于简单文本生成符合用户意图的传输函数,降低体绘制使用门槛。

摘要:

传输函数设计是体绘制中的关键环节,直接影响体数据的视觉呈现与解读效果。然而,由于参数空间复杂,且传输函数数值与体数据中感兴趣特征之间存在语义鸿沟,创建符合用户视觉目标的有效传输函数通常颇具挑战。本研究提出一种新方法,借助语言-视觉模型的最新进展来弥合这一语义鸿沟。通过采用全可微渲染管线以及由语言描述引导的基于图像的损失函数,我们的方法生成的传输函数可输出高度契合用户意图的体绘制图像。我们验证了该方法的有效性,它能从简单描述中生成有意义的传输函数,让用户只需极少操作就能直观表达期望的视觉效果。这一进展简化了传输函数设计流程,让更广泛的用户群体都能便捷使用体绘制技术。

英文摘要:

Transfer function design is crucial in volume rendering, as it directly influences the visual representation and interpretation of volumetric data. However, creating effective transfer functions that align with users' visual objectives is often challenging due to the complex parameter space and the semantic gap between transfer function values and features of interest within the volume. In this work, we propose a novel approach that leverages recent advancements in language-vision models to bridge this semantic gap. By employing a fully differentiable rendering pipeline and an image-based loss function guided by language descriptions, our method generates transfer functions that yield volume-rendered images closely matching the user's intent. We demonstrate the effectiveness of our approach in creating meaningful transfer functions from simple descriptions, empowering users to intuitively express their desired visual outcomes with minimal effort. This advancement streamlines the transfer function design process and makes volume rendering more accessible to a wider range of users.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑