3D shape generation from text is a fundamental task in 3D representation learning. The text-shape pairs exhibit a hierarchical structure, where a general text like ``chair" covers all 3D shapes of the chair, while more detailed prompts refer to more specific shapes. Furthermore, both text and 3D shapes are inherently hierarchical structures. However, existing Text2Shape methods, such as SDFusion, do not exploit that. In this work, we propose HyperSDFusion, a dual-branch diffusion model that generates 3D shapes from a given text. Since hyperbolic space is suitable for handling hierarchical data, we propose to learn the hierarchical representations of text and 3D shapes in hyperbolic space. First, we introduce a hyperbolic text-image encoder to learn the sequential and multi-modal hierarchical features of text in hyperbolic space. In addition, we design a hyperbolic text-graph convolution module to learn the hierarchical features of text in hyperbolic space. In order to fully utilize these text features, we introduce a dual-branch structure to embed text features in 3D feature space. At last, to endow the generated 3D shapes with a hierarchical structure, we devise a hyperbolic hierarchical loss. Our method is the first to explore the hyperbolic hierarchical representation for text-to-shape generation. Experimental results on the existing text-to-shape paired dataset, Text2Shape, achieved state-of-the-art results. We release our implementation under HyperSDFusion.github.io.
Hierarchical Features Matter: A Deep Exploration of Progressive Parameterization Method for Dataset Distillation
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Augusta University(奥古斯塔大学)
Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration
Biomedical Engineering Department, College of Future Technology, Peking University(北京大学未来技术学院生物医学工程系);Institute of Medical Technology, Peking University Health Science Center(北京大学医学部医学技术研究所);National Biomedical Imaging Center, Peking University(北京大学国家生物医学成像中心)
Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation
School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Cybersecurity, Northwestern Polytechnical University(西北工业大学网络空间安全学院)
EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation
Key Laboratory of Intelligent Information Processing, Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS)(智能信息处理重点实验室,计算技术研究所(ICT),中国科学院(CAS));Jilin University (JLU)(吉林大学(JLU));Beijing University of Posts and Telecommunications (BUPT)(北京邮电大学(BUPT));University of the Chinese Academy of Sciences(中国科学院大学)
Bridging Scales in Map Generation: A scale-aware cascaded generative mapping framework for seamless and consistent multi-scale cartographic representation
Key Laboratory of Geological Survey and Evaluation of Ministry of Education(教育部地质调查与评价重点实验室);China University of Geosciences(中国地质大学);School of Computer Science(计算机学院);School of Geographical and Information Engineering(地理与信息工程学院);College Of Computer and lnformation Technology(计算机与信息学院);China Three Gorges University(三峡大学);Engineering Research Center of Natural Resource Information Management and Digital Twin Engineering Software(自然资源信息管理与数字孪生工程软件工程研究中心);Hubei Key Laboratory of Intelligent Geo-Information Processing(湖北省智能地理信息处理重点实验室)
PHI: Bridging Domain Shift in Long-Term Action Quality Assessment via Progressive Hierarchical Instruction
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(虚拟现实技术与系统国家重点实验室,北京航空航天大学);Department of Computer Science, Durham University(杜伦大学计算机科学系);Department of Computer Science and Technology, Institute for AI, BNRist Center, Tsinghua-Bosch Joint ML Center, THBI Lab, Tsinghua University(人工智能研究院,北京人工智能研究院,清华大学-博世联合机器学习中心,THBI实验室,清华大学计算机科学与技术系);Zhongguancun Laboratory, Beijing(中关村实验室,北京)
HalluShift++: Bridging Language and Vision through Internal Representation Shifts for Hierarchical Hallucinations in MLLMs
Netaji Subhash Engineering College (NSEC)(奈尔贾伊·萨布哈工程学院);TCG Crest;Electronics and Communication Sciences Unit (ECSU)(电子与通信科学单位);Indian Statistical Institute(印度统计研究所)
Unveiling and Bridging the Functional Perception Gap in MLLMs: Atomic Visual Alignment and Hierarchical Evaluation via PET-Bench
School of Biomedical Engineering, Southern Medical University(生物医学工程学院,南方医科大学);School of Biomedical Engineering, Shanghai Jiaotong University(生物医学工程学院,上海交通大学);Department of Electronic Engineering, Chinese University of Hong Kong(电子工程系,中国香港大学);Faculty of Dentistry, The University of Hong Kong(牙科学院,香港大学);Department of Nuclear Medicine, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine(核医学科,广州中医药大学第二附属医院);PET Center, Department of Nuclear Medicine, Guangdong Provincial People’s Hospital, Southern Medical University(PET中心,核医学科,广东省人民医院,南方医科大学);Department of Nuclear Medicine, Nanfang Hospital, Southern Medical University(核医学科,南芳医院,南方医科大学);Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospitals(核医学与分子影像学部,日内瓦大学医院);Departments of Radiology, Physics, and Biomedical Engineering, The University of British Columbia(放射学、物理和生物医学工程系,不列颠哥伦比亚大学);Medical Artificial Intelligence Laboratory, Westlake University(医学人工智能实验室,西湖大学)
Bridging the 2D-3D Gap: A Hierarchical Semantic-Geometric Map for Vision Language Navigation
School of Computer Science and Technology, East China Normal University(东华大学计算机科学与技术学院);Bosch Corporate Research(博世企业研究);King Abdullah University of Science and Technology(卡布斯大学)
DuoFormer: Leveraging Hierarchical Representations by Local and Global Attention Vision Transformer
Scientific Computing and Imaging Institute, University of Utah(科学计算与成像研究所,犹他大学);Kahlert School of Computing, University of Utah(计算学院,犹他大学);Electrical and Computer Engineering, University of Utah(电气与计算机工程,犹他大学);Department of Pathology, University of Utah(病理学系,犹他大学)
BLaFA: Bridging Language to 3D Functional Affordances for Dexterous Robotic Grasping in Tool Use
School of Artificial Intelligence and Robotics, Hunan University(湖南大学人工智能与机器人学院);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University(机器人视觉感知与控制技术国家工程研究中心,湖南大学);Key Laboratory of Advanced Manufacturing Technology of the Ministry of Education, Guizhou University(教育部贵州大学先进制造技术重点实验室)
MambaBack: Bridging Local Features and Global Contexts in Whole Slide Image Analysis
Nhu Department of Electrical Engineering and Computer Science, University of California, Irvine(加州大学尔湾分校Nhu电子工程与计算机科学系);Department of Electrical & Computer Engineering, National University of Singapore(新加坡国立大学电子与计算机工程系);PuzzleLogic Pte Ltd, Singapore(新加坡PuzzleLogic公司)
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval
School of Computer Science and Technology, Xi’an University of Posts and Telecommunications(西安邮电大学计算机科学与技术学院);Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing(陕西省网络数据分析与智能处理重点实验室);Xi’an Key Laboratory of Big Data and Intelligent Computing(西安大数据与智能计算重点实验室);School of Computer Engineering, Weifang University(潍坊大学计算机工程学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Department of Electronic and Electrical Engineering, Brunel University of London(伦敦布鲁内尔大学电子与电气工程系);Dept. Matemàtiques i Informàtica and Institute of Neuroscience, Univeritat de Barcelona(数学与计算机系和神经科学研究所,巴塞罗那大学)
Embracing Events and Frames with Hierarchical Feature Refinement Network for Object Detection
Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);University of Technology Sydney(悉尼科技大学);Tongji University(同济大学)
SAMamba: Adaptive State Space Modeling with Hierarchical Vision for Infrared Small Target Detection
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences)(教育部计算电力网络与信息安全重点实验室,山东计算机科学中心(济南国家超算中心),齐鲁工业大学(山东省科学院));The State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Shandong Provincial Key Laboratory of Computer Networks, Shandong Fundamental Research Center for Computer Science(山东省计算机网络重点实验室,山东省计算机科学基础研究中心)