Humans naturally perceive the geometric structure and semantic content of a 3D world as intertwined dimensions, enabling coherent and accurate understanding of complex scenes. However, most prior approaches prioritize training large geometry models for low-level 3D reconstruction and treat high-level spatial understanding in isolation, overlooking the crucial interplay between these two fundamental aspects of 3D-scene analysis, thereby limiting generalization and leading to poor performance in downstream 3D understanding tasks. Recent attempts have mitigated this issue by simply aligning 3D models with specific language models, thus restricting perception to the aligned model's capacity and limiting adaptability to downstream tasks. In this paper, we propose InstanceGrounded Geometry Transformer (IGGT), an end-to-end large unified transformer to unify the knowledge for both spatial reconstruction and instance-level contextual understanding. Specifically, we design a 3D-Consistent Contrastive Learning strategy that guides IGGT to encode a unified representation with geometric structures and instance-grounded clustering through only 2D visual inputs. This representation supports consistent lifting of 2D visual inputs into a coherent 3D scene with explicitly distinct object instances. To facilitate this task, we further construct InsScene-15K, a large-scale dataset with high-quality RGB images, poses, depth maps, and 3D-consistent instance-level mask annotations with a novel data curation pipeline.
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences（中国科学院人工智能安全国家重点实验室，计算技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）；ETH Zürich（苏黎世联邦理工学院）；City College of New York, City University of New York, USA（纽约城市学院，纽约城市大学，美国）；Shanghai Jiao Tong University（上海交通大学）
Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Institute of Artificial Intelligence, Xiamen University（厦门大学人工智能学院）；China Star Optoelectronics Technology（中国星电科技）；TCL Corporate Research (HK) Co., Ltd.（TCL香港企业研究有限公司）；Department of Electrical and Electronic Engineering, The University of Hong Kong（香港大学电子与电气工程系）
Beyond Gaussian Bottlenecks: Topologically Aligned Encoding of Vision-Transformer Feature Spaces
Department of Computer Engineering, Koç University, Istanbul, Turkey（科克大学计算机工程系，伊斯坦布尔，土耳其）；Department of Computer Engineering, Hacettepe University, Ankara, Turkey（哈恰塔佩大学计算机工程系，安卡拉，土耳其）；KUIS AI Research Center, Istanbul, Turkey（KUIS人工智能研究中心，伊斯坦布尔，土耳其）；Department of Electrical and Electronics Engineering, Koç University, Istanbul, Turkey（科克大学电气与电子工程系，伊斯坦布尔，土耳其）
UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction
NLPR, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所模式识别国家重点实验室）；Peking University（北京大学）；Tsinghua University（清华大学）；Galbot Inc.（北京银河通用机器人有限公司）；Shanghai Jiao Tong University（上海交通大学）；Beijing Academy of Artificial Intelligence（北京智源人工智能研究院）
MotionGrounder: Grounded Multi-Object Motion Transfer via Diffusion Transformer
School of Electrical Engineering, Korea Advanced Institute of Science and Technology（韩国科学技术院电气工程学院）；Adobe Research（Adobe研究院）；CMLab, Chung-Ang University（中央大学CMLab）
Shenzhen International Graduate School Tsinghua University（清华大学深圳国际研究生院）；Institute of Artificial Intelligence Xiamen University（厦门大学人工智能研究院）；China Star Optoelectronics Technology（中国星电科技）；TCL Corporate Research (HK) Co Ltd.（TCL香港企业研发中心）；Department of Electrical and Electronic Engineering The University of Hong Kong（香港大学电子与电气工程系）
MVGGT: Multimodal Visual Geometry Grounded Transformer for Multiview 3D Referring Expression Segmentation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University（厦门大学多媒体可信感知与高效计算教育部重点实验室）；Shanghai Innovation Institute（上海创新研究院）；Fudan University（复旦大学）；ByteDance（字节跳动）；Tianjin University of Science and Technology（天津科技大学）
Nanjing University of Science and Technology（南京理工大学）；Li Auto Inc.（Li Auto公司）；Northwestern Polytechnical University（西北工业大学）；Department of Computing, The Hong Kong Polytechnic University（香港理工大学计算学院）
State Key Laboratory of Precision Blasting, Jianghan University（江汉大学精密爆破重点实验室）；Harvard AI and Robotics Lab, Harvard University（哈佛大学AI与机器人实验室）；School of EIC, Huazhong University of Science and Technology（华中科技大学电子信息学院）；Department of Computing, The Hong Kong Polytechnic University（香港理工大学计算机系）；Department of Computer Science, Hong Kong Baptist University（香港 Baptist 大学计算机科学系）；School of Mathematics and Statistics, Hubei University of Education（湖北省教育学院数学与统计学学院）
Field Converter: Geometry-Initialized Temporal Residual Refinement for World-Grounded Player Pose Estimation from Soccer Broadcasts
Institut de Biomécanique Humaine Georges Charpak (IBHGC), Arts et Métiers ParisTech（乔治·沙帕克人体生物力学研究所（IBHGC），巴黎高科国立高等工艺学校）；French Football Federation (FFF)（法国足球联合会（FFF））
Glass Surface Detection Grounded in 3D Visual Geometry
Jiangnan University（江南大学）；University of Science and Technology of China（中国科学技术大学）；University of Wurzburg（维尔茨堡大学）；City University of Hong Kong (Dongguan)（香港城市大学（东莞））
DDVT: Dynamic Dual-level Vision Transformer Fusion Network for Answer Grounding in Visual Question Answering
National and Local Joint Engineering Laboratory of Computer Aided Design, School of Software Engineering, Dalian University（大连大学软件工程学院计算机辅助设计国家地方联合工程实验室）；School of Computer Science and Technology, Dalian University of Technology（大连理工大学计算机科学与技术学院）
