Point Clouds Are Specialized Images: A Knowledge Transfer Approach for 3D Understanding
School of Electrical and Data Engineering, University of Technology Sydney(悉尼科技大学电气与数据工程学院);School of Computer Science, University of Nottingham Ningbo(诺丁汉大学宁波校区计算机学院);Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University(香港理工大学电机及电子工程系)
Jiachen Kang, Wenjing Jia, Xiangjian He, Kin Man Lam
Self-supervised representation learning (SSRL) has gained increasing attention in point cloud understanding, in addressing the challenges posed by 3D data scarcity and high annotation costs. This paper presents PCExpert, a novel SSRL approach that reinterprets point clouds as "specialized images". This conceptual shift allows PCExpert to leverage knowledge derived from large-scale image modality in a more direct and deeper manner, via extensively sharing the parameters with a pre-trained image encoder in a multi-way Transformer architecture. The parameter sharing strategy, combined with a novel pretext task for pre-training, i.e., transformation estimation, empowers PCExpert to outperform the state of the arts in a variety of tasks, with a remarkable reduction in the number of trainable parameters. Notably, PCExpert's performance under LINEAR fine-tuning (e.g., yielding a 90.02% overall accuracy on ScanObjectNN) has already approached the results obtained with FULL model fine-tuning (92.66%), demonstrating its effective and robust representation capability.
Sim2real Transfer Learning for Point Cloud Segmentation: An Industrial Application Case on Autonomous Disassembly
Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB(弗劳恩霍夫光电、系统技术与图像利用研究所IOSB);Fraunhofer Center for Machine Learning(弗劳恩霍夫机器学习中心)
Transferable and Undefendable Point Cloud Attacks via Medial Axis Transform
Cyberspace Institute of Advanced Technology, Guangzhou University(高级科技 cyber 空间研究所,广州大学);School of Computer Science and Cyber Engineering, Guangzhou University(计算机科学与网络工程学院,广州大学);Department of Automation, University of Science and Technology of China(自动化系,中国科学技术大学);School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(人工智能、光学与电子学(iOPEN)学院,西北工业大学)
Rethinking Transferable Adversarial Attacks on Point Clouds from a Compact Subspace Perspective
Cyberspace Institute of Advanced Technology, Guangzhou University(广州大学网络安全研究院);School of Computer Science and Cyber Engineering, Guangzhou University(广州大学计算机科学与网络工程学院);Department of Automation, University of Science and Technology of China(中国科学技术大学自动化系);Institute for Math & AI, Wuhan University(武汉大学数学与人工智能研究院);School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能、光学与电子学院(iOPEN))
APC: Transferable and Efficient Adversarial Point Counterattack for Robust 3D Point Cloud Recognition
Department of Artificial Intelligence, University of Seoul, South Korea(首尔大学人工智能系,韩国);Department of Geo Informatics, University of Seoul, South Korea(首尔大学地理信息系,韩国)
CSDN: Cross-modal Shape-transfer Dual-refinement Network for Point Cloud Completion
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Delft University of Technology(代尔夫特理工大学);Lingnan University(岭南大学);The Hong Kong Polytechnic University(香港理工大学)
Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Survey
VIT Bhopal University(VIT博帕尔大学);University of Dubai(迪拜大学);University of Medea(迈迪亚大学);University of Sharjah(沙迦大学);De Montfort University(德蒙福特大学);Qatar University(卡塔尔大学)
CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-training
Harbin Institute of Technology(哈尔滨工业大学);City University of Hong Kong(香港城市大学);The University of Hong Kong(香港大学);Shanghai AI Laboratory(上海人工智能实验室);Peng Cheng Laboratory(鹏城实验室)
Tri-Efficient Transfer Learning for Point Cloud Videos
School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件学院);School of Information and Communication Engineering, Xi’an Jiaotong University(西安交通大学信息与通信工程学院);SIGS, Tsinghua University(清华大学深圳国际研究生院)
PointRFT: Explicit Reinforcement Fine-tuning for Point Cloud Few-shot Learning
School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);International School, Beijing University of Posts and Telecommunications(北京邮电大学国际学院)
TrackAny3D: Transferring Pretrained 3D Models for Category-unified 3D Point Cloud Tracking
Zhejiang University of Technology(浙江工业大学);RMIT University(皇家墨尔本理工大学);Zhejiang Key Laboratory of Visual Information Intelligent Processing(浙江省视觉信息智能处理重点实验室)
Cage-Based Deformation for Transferable and Undefendable Point Cloud Attack
Cyberspace Institute of Advanced Technology, Guangzhou University(广州市先进空间技术研究院,广州大学);School of Computer Science and Cyber Engineering, Guangzhou University(计算机科学与网络工程学院,广州大学);Department of Automation, University of Science and Technology of China(自动化学院,中国科学技术大学);School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(人工智能、光学与电子学院(iOPEN),西北工业大学);Graphics & Geometric Computing Laboratory, School of Mathematical Sciences, University of Science and Technology of China(图形与几何计算实验室,中国科学技术大学数学科学学院)
Towards a 3D Transfer-based Black-box Attack via Critical Feature Guidance
Nanjing University of Science and Technology(南京理工大学);STCA, Microsoft(STCA微软公司);Nanyang Technological University(南洋理工大学);Nanjing University of Industry Technology(南京工业技术大学)
Evaluating transfer learning strategies for improving dairy cattle body weight prediction in small farms using depth-image and point-cloud data
Department of Animal Sciences, University of Florida(动物科学系,佛罗里达大学);Department of Large Animal Clinical Sciences, University of Florida(大动物临床科学系,佛罗里达大学);Laboratory of Biometry and Bioinformatics, Department of Agricultural and Environmental Biology, Graduate School of Agricultural and Life Sciences, The University of Tokyo(生物度量与生物信息学实验室,农业与环境生物学系,东京大学研究生院);Department of Agricultural and Environmental Biology, Graduate School of Agricultural and Life Sciences, The University of Tokyo(农业与环境生物学系,东京大学研究生院)
Attention-Guided Lidar Segmentation and Odometry Using Image-to-Point Cloud Saliency Transfer
University of Tsukuba(筑波大学);National Institute of Advanced Industrial Science and Technology(日本产业技术综合研究所);CNRS-AIST Joint Robotics Laboratory (JRL)(法国国家科学研究中心-日本产业技术综合研究所联合机器人实验室)
Enhancing Scene Classification in Cloudy Image Scenarios: A Collaborative Transfer Method with Information Regulation Mechanism using Optical Cloud-Covered and SAR Remote Sensing Images
School of Geosciences and Info-Physics, Central South University(中南大学地球科学与信息物理学院);Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente(特文特大学地球信息科学与地球观测学院)
X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));The Future Network of Intelligence Institute(未来网络智能研究院);Shenzhen Research Institute of Big Data(深圳大数据研究院);Shanghai Jiao Tong University(上海交通大学);Sun Yat-sen University(中山大学)
Transferring CLIP's Knowledge into Zero-Shot Point Cloud Semantic Segmentation
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Didi Chuxing(滴滴出行)