Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model point cloud data globally with linear computational complexity. In particular, for the first time, we demonstrate that Mamba-based point cloud methods can outperform previous methods based on transformer or multi-layer perceptrons (MLPs). To enable Mamba to process 3-D point cloud data more effectively, we propose a novel Consistent Traverse Serialization method to convert point clouds into 1-D point sequences while ensuring that neighboring points in the sequence are also spatially adjacent. Consistent Traverse Serialization yields six variants by permuting the order of \textit{x}, \textit{y}, and \textit{z} coordinates, and the synergistic use of these variants aids Mamba in comprehensively observing point cloud data. Furthermore, to assist Mamba in handling point sequences with different orders more effectively, we introduce point prompts to inform Mamba of the sequence's arrangement rules. Finally, we propose positional encoding based on spatial coordinate mapping to inject positional information into point cloud sequences more effectively. Point Cloud Mamba surpasses the state-of-the-art (SOTA) point-based method PointNeXt and achieves new SOTA performance on the ScanObjectNN, ModelNet40, ShapeNetPart, and S3DIS datasets. It is worth mentioning that when using a more powerful local feature extraction module, our PCM achieves 79.6 mIoU on S3DIS, significantly surpassing the previous SOTA models, DeLA and PTv3, by 5.5 mIoU and 4.9 mIoU, respectively.
Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models
Xi’an Jiaotong University(西安交通大学);School of Artificial Intelligence and Robotics, Hunan University(湖南大学人工智能与机器人学院);University of Western Australia(西澳大学)
Minkowski-MambaNet: A Point Cloud Framework with Selective State Space Models for Forest Biomass Quantification
School of Computer Science and Technology, the Key Laboratory of Signal Detection and Processing, and the Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center, Xinjiang University(计算机科学与技术学院、信号检测与处理重点实验室以及新疆多模态智能处理与信息安全工程技术研究中心,新疆大学);National Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家实验室,南京大学);Xinjiang Guanghui New Energy Co., Ltd(新疆广汇新能源有限公司);Hongyousoft Co., Ltd(宏远软件有限公司)
Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding
Bournemouth University(伯恩茅斯大学);Jilin University(吉林大学);The University of Western Australia(西澳大学);Hangzhou City University(杭州城市大学);Northwest A&F University(西北农林科技大学)
ForestMamba: Sparse Mamba with Geometry-guided Queries for 3D Forest Point Cloud Segmentation
Nagoya University(名古屋大学);RIKEN Seika(日本理化学研究所Seika研究中心);University of California, Los Angeles(加州大学洛杉矶分校);University of Twente(埃因霍温理工大学);Ritsumeikan University(立命馆大学)
ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding
Key Laboratory of Signal Detection and Processing, Xinjiang University(信号检测与处理重点实验室,新疆大学);Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing, Xinjiang University(丝绸之路多语种认知计算联合国际实验室,新疆大学);National Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学)
WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusion
PCA Lab, Nanjing University of Science and Technology(南京理工大学光电信息科学与工程实验室);School of Automation, Southeast University(东南大学自动化学院);State Key Laboratory for Novel Software Technology, Nanjing University(南京大学软件新技术国家重点实验室);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
MBPU: A Plug-and-Play State Space Model for Point Cloud Upsamping with Fast Point Rendering
School of Computer Science, Fudan University(复旦大学计算机科学学院);Academy for Engineering and Technology, Fudan University(复旦大学工程技术研究院);Department of Information Engineering, The Chinese University of Hong Kong(香港中文大学信息工程系);School of Mechanical Engineering, Tongji University(同济大学机械工程学院)
3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion
Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University(复旦大学计算机学院数据科学实验室);Department of Information Engineering, The Chinese University of Hong Kong(香港中文大学信息工程系)
LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Institute of Visual Intelligence, Pengcheng Laboratory(鹏城实验室视觉智能研究院);College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机与软件学院);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Bytedance Inc.(字节跳动公司)
MambaMOS: LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Model
College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机与通信工程学院);College of Optical Science and Engineering, Zhejiang University(浙江大学光学工程学院);School of Robotics, Hunan University(湖南大学机器人学院);School of Electronics and Information Engineering, South China Normal University(华南师范大学电子与信息工程学院)
CloudMamba: An Uncertainty-Guided Dual-Scale Mamba Network for Cloud Detection in Remote Sensing Imagery
Beihang University(北京航空航天大学);Key Laboratory of Spacecraft Design Optimization and Dynamic Simulation Technologies, Ministry of Education(教育部航天器设计优化与动态模拟技术重点实验室)
Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction
National University of Singapore(新加坡国立大学);Singapore Management University(新加坡管理大学);Nanyang Technological University(南洋理工大学);Sea AI Lab(Sea AI实验室);Skywork AI