arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.07555cs.CV

GaussianCut:基于图割的3D Gaussian Splatting交互式分割

GaussianCut: Interactive segmentation via graph cut for 3D Gaussian Splatting

University of Toronto(多伦多大学)

Umangi Jain, Ashkan Mirzaei, Igor Gilitschenski

AI总结:

提出GaussianCut方法,通过将3D Gaussian Splatting场景表示为图并利用图割算法最小化能量函数,结合2D分割模型与用户输入,实现了无需额外训练的交互式3D多视角分割。

摘要:

我们引入了GaussianCut,这是一种针对以3D Gaussians表示的场景进行交互式多视角分割的新方法。该方法允许通过在单一视角上进行交互来选择待分割的对象。它接受直观的用户输入,例如点点击、粗略涂鸦或文本。使用3D Gaussian Splatting(3DGS)作为底层场景表示,简化了对感兴趣对象的提取,这些对象被视为场景Gaussians的一个子集。我们的核心思想是将场景表示为一个图,并使用图割算法最小化能量函数,从而有效地将Gaussians划分为前景和背景。为此,我们基于场景Gaussians构建图,并在图上设计一个分割对齐的能量函数,以将用户输入与场景属性相结合。为了获得初始的粗略分割,我们利用2D图像/视频分割模型,并进一步使用我们的图构建来优化这些粗略估计。我们的实证评估表明了GaussianCut在多种场景下的适应性。GaussianCut在3D分割方面取得了与最先进方法相媲美的性能,且无需任何额外的分割感知训练。

英文摘要:

We introduce GaussianCut, a new method for interactive multiview segmentation of scenes represented as 3D Gaussians. Our approach allows for selecting the objects to be segmented by interacting with a single view. It accepts intuitive user input, such as point clicks, coarse scribbles, or text. Using 3D Gaussian Splatting (3DGS) as the underlying scene representation simplifies the extraction of objects of interest which are considered to be a subset of the scene's Gaussians. Our key idea is to represent the scene as a graph and use the graph-cut algorithm to minimize an energy function to effectively partition the Gaussians into foreground and background. To achieve this, we construct a graph based on scene Gaussians and devise a segmentation-aligned energy function on the graph to combine user inputs with scene properties. To obtain an initial coarse segmentation, we leverage 2D image/video segmentation models and further refine these coarse estimates using our graph construction. Our empirical evaluations show the adaptability of GaussianCut across a diverse set of scenes. GaussianCut achieves competitive performance with state-of-the-art approaches for 3D segmentation without requiring any additional segmentation-aware training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑