Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Survey
VIT Bhopal University(VIT博帕尔大学);University of Dubai(迪拜大学);University of Medea(迈迪亚大学);University of Sharjah(沙迦大学);De Montfort University(德蒙福特大学);Qatar University(卡塔尔大学)
The 3D point cloud (3DPC) has significantly evolved and benefited from the advance of deep learning (DL). However, the latter faces various issues, including the lack of data or annotated data, the existence of a significant gap between training data and test data, and the requirement for high computational resources. To that end, deep transfer learning (DTL), which decreases dependency and costs by utilizing knowledge gained from a source data/task in training a target data/task, has been widely investigated. Numerous DTL frameworks have been suggested for aligning point clouds obtained from several scans of the same scene. Additionally, DA, which is a subset of DTL, has been modified to enhance the point cloud data's quality by dealing with noise and missing points. Ultimately, fine-tuning and DA approaches have demonstrated their effectiveness in addressing the distinct difficulties inherent in point cloud data. This paper presents the first review shedding light on this aspect. it provides a comprehensive overview of the latest techniques for understanding 3DPC using DTL and domain adaptation (DA). Accordingly, DTL's background is first presented along with the datasets and evaluation metrics. A well-defined taxonomy is introduced, and detailed comparisons are presented, considering different aspects such as different knowledge transfer strategies, and performance. The paper covers various applications, such as 3DPC object detection, semantic labeling, segmentation, classification, registration, downsampling/upsampling, and denoising. Furthermore, the article discusses the advantages and limitations of the presented frameworks, identifies open challenges, and suggests potential research directions.
Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysis
Fudan University(复旦大学);University of Science and Technology of China(中国科学技术大学);Shanghai AI Laboratory(上海人工智能实验室);University of Shanghai for Science and Technology(上海理工大学)
Deep Learning-Based Point Cloud Registration: A Comprehensive Survey and Taxonomy
Southeast University(东南大学);Purple Mountain Laboratories(紫金山实验室);Nanyang Technological University(南洋理工大学);Lee Kong Chian School of Medicine(李光前医学院);Huazhong University of Science and Technology(华中科技大学);School of Artificial Intelligence and Automation(人工智能与自动化学院);College of Computing & Data Science(计算与数据科学学院)
GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learning
School of Computer Science, Fudan University(复旦大学计算机科学学院);School of Mechanical Engineering, Tongji University(同济大学机械工程学院);Academy for Engineering and Technology, Fudan University(复旦大学工程技术研究院)
MinD-3D++: Advancing fMRI-Based 3D Reconstruction with High-Quality Textured Mesh Generation and a Comprehensive Dataset
Fudan University(复旦大学);Fudan ISTBI–ZJNU Algorithm Centre for Brain-Inspired Intelligence(复旦大学-浙江师范大学脑启发智能算法中心);Zhejiang Normal University(浙江师范大学);Shanghai Innovation Institute(上海创新研究院);ETH Zürich(苏黎世联邦理工学院);Northwestern Polytechnical University(西北工业大学)
Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functions
Engineering Sciences, Homi Bhabha National Institute Training School Complex(工程科学,霍米·巴赫瓦全国研究所培训学校);Computer and Informatics Group, VECC 1/AF(计算机与信息组,VECC 1/AF)
Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completion
SenseTime-CUHK Joint Lab, The Chinese University of Hong Kong(商汤科技-香港中文大学联合实验室,香港中文大学);S-Lab, Nanyang Technological University(南洋理工大学S-Lab);SenseTime Research(商汤科技研究院);Shanghai AI Laboratory(上海人工智能实验室);Centre of Perceptual and Interactive Intelligence(感知与交互智能中心)
DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarios
Queen Mary University of London(伦敦玛丽女王大学);Queen Mary’s Digital Environment Research Institute (DERI)(伦敦玛丽女王大学数字环境研究 institutes (DERI));Remark AI UK Ltd(英国Remark AI有限公司)
MICo-150K: A Comprehensive Dataset Advancing Multi-Image Composition
Hong Kong Polytechnic University(香港理工大学);Tsinghua University(清华大学);Peking University(北京大学);Sun Yat-Sen University(中山大学);OPPO Research Institute(OPPO研究院)
Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning
The Chinese University of Hong Kong(香港中文大学);SenseTime Research(商汤科技研究院);University of Toronto(多伦多大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);CPII under InnoHK(InnoHK框架下的CPII)
PAVLM: Advancing Point Cloud based Affordance Understanding Via Vision-Language Model
Technical Aspects of Multimodal Systems (TAMS), Department of Informatics, University of Hamburg(汉堡大学信息学院多模态系统技术部门);Hon Hai Research Institute (HHRI)(鸿海研究机构);Department of Electrical Engineering, National Taiwan University(台湾大学电子工程系);Department of Computer Science and Technology, National Tsinghua University(清华大学计算机科学与技术系)
Advancing Multinational License Plate Recognition Through Synthetic and Real Data Fusion: A Comprehensive Evaluation
Pontifical Catholic University of Paraná (PUCPR), Curitiba, Brazil;Federal University of Paran\'a (UFPR), Curitiba, Brazil;Federal Institute of Paran\'a (IFPR), Irati, Brazil;Federal University of Ouro Preto (UFOP), Ouro Preto, Brazil;Federal University of Technology-Paran\' a (UTFPR), Curitiba, Brazil
Advancing Image Super-resolution Techniques in Remote Sensing: A Comprehensive Survey
Research Center for Space Computing System, Zhejiang Lab(空间计算系统研究中心,浙江实验室);School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);School of Information Science and Engineering, Lanzhou University(信息科学与工程学院,兰州大学)
Advancing Object Detection in Transportation with Multimodal Large Language Models (MLLMs): A Comprehensive Review and Empirical Testing
Arab American University(阿拉伯美国大学);Columbia University(哥伦比亚大学);Budapest University of Technology and Economics(布达佩斯技术与经济大学);Al-Ahliyya Amman University(阿赫利耶阿曼大学);Queensland University of Technology(昆士兰科技大学)
CoPeD-Advancing Multi-Robot Collaborative Perception: A Comprehensive Dataset in Real-World Environments
New York University(纽约大学);Tandon School of Engineering(坦登工程学院);U.S. Army Combat Capabilities Development Command(美国陆军作战能力发展司令部);Army Research Laboratory(陆军研究实验室)
Advancing ALS Applications with Large-Scale Pre-training: Dataset Development and Downstream Assessment
organization= National Institute of Advanced Industrial Science;Technology (AIST) Artificial Intelligence Research Center , city= Tokyo , country= Japan
Comprehensive Visual Question Answering on Point Clouds through Compositional Scene Manipulation
The Future Network of Intelligence Institute, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)未来智能网络研究院);School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)理工学院)
FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understanding
Lappeenranta-Lahti University of Technology LUT(拉佩兰塔-拉赫蒂技术大学);Tianjin University(天津大学);AMD Silo AI;Great Bay University(大湾大学);Rensselaer Polytechnic Institute(雷士大学);Brno University of Technology(布拉格技术大学)
MetaFruit Meets Foundation Models: Leveraging a Comprehensive Multi-Fruit Dataset for Advancing Agricultural Foundation Models
Michigan State University(密歇根州立大学);Nanyang Technological University(南洋理工大学);Shanghai Jiao Tong University(上海交通大学);Pennsylvania State University(宾夕法尼亚州立大学);United States Department of Agriculture Agricultural Research Service(美国农业部农业研究服务局)
Harnessing Self-Supervised Deep Learning and Geostationary Remote Sensing for Advancing Wildfire and Associated Air Quality Monitoring: Improved Smoke and Fire Front Masking using GOES and TEMPO Radiance Data
Spatial Informatics Group, LLC.(空间信息集团有限责任公司);ADNET systems, INC.(ADNET系统公司);NASA Langley Research Center(美国国家航空航天局兰利研究中心);University at Albany(奥尔巴尼大学)