Most existing self-supervised learning (SSL) approaches for 3D point clouds are dominated by generative methods based on Masked Autoencoders (MAE). However, these generative methods have been proven to struggle to capture high-level discriminative features effectively, leading to poor performance on linear probing and other downstream tasks. In contrast, contrastive methods excel in discriminative feature representation and generalization ability on image data. Despite this, contrastive learning (CL) in 3D data remains scarce. Besides, simply applying CL methods designed for 2D data to 3D fails to effectively learn 3D local details. To address these challenges, we propose a novel Dual-Branch \textbf{C}enter-\textbf{S}urrounding \textbf{Con}trast (CSCon) framework. Specifically, we apply masking to the center and surrounding parts separately, constructing dual-branch inputs with center-biased and surrounding-biased representations to better capture rich geometric information. Meanwhile, we introduce a patch-level contrastive loss to further enhance both high-level information and local sensitivity. Under the FULL and ALL protocols, CSCon achieves performance comparable to generative methods; under the MLP-LINEAR, MLP-3, and ONLY-NEW protocols, our method attains state-of-the-art results, even surpassing cross-modal approaches. In particular, under the MLP-LINEAR protocol, our method outperforms the baseline (Point-MAE) by \textbf{7.9\%}, \textbf{6.7\%}, and \textbf{10.3\%} on the three variants of ScanObjectNN, respectively. The code will be made publicly available.
Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask
State Key Laboratory of Robotics and System at Harbin Institute of Technology(哈尔滨工业大学机器人系统国家重点实验室);Lanzhou University of Technology(兰州理工大学);Department of Computer Science(计算机科学系);University of Liverpool(利物浦大学)
Surrey Institute for People-Centred AI(苏格兰人本人工智能研究所);Centre For Vision, Speech and Signal Processing (CVSSP)(视觉、语音和信号处理中心);Jiangnan University(江南大学);Carnegie Mellon University(卡内基梅隆大学)
Rethinking Image Forgery Detection via Soft Contrastive Learning and Unsupervised Clustering
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Guangdong Key Laboratory of Intelligent Information Processing, College of Electronics and Information Engineering, Shenzhen University(广东智能信息处理重点实验室、电子与信息工程学院)
Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Training
Southeast University(东南大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Case Western Reserve University(凯斯西储大学);Centre de Recherche en Information Biomédicale Sino-Français(中法生物医学信息研究中心)
SurANet: Surrounding-Aware Network for Concealed Object Detection via Highly-Efficient Interactive Contrastive Learning Strategy
The College of Electrical and Information Engineering, Hunan University(湖南大学电气与信息工程学院);The School of Robotics, Hunan University(湖南大学机器人学院);China Telecom Institute of AI(中国电信人工智能研究院);Northwestern Polytechnical University(西北工业大学);China Telecom(中国电信);the School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能与光学电子学院(iOPEN))
More performant and scalable: Rethinking contrastive vision-language pre-training of radiology in the LLM era
School of Biomedical Engineering, Division of Life Sciences;Medicine, University of Science;Technology of China (USTC), Hefei Anhui, 230026, China Center for Medical Imaging, Robotics, Analytic Computing \& Learning (MIRACLE), Suzhou Institute for Advance Research, USTC, Suzhou Jiangsu, 215123, China The First Affiliated Hospital of USTC, Division of Life Sciences;Medicine, USTC, Hefei Anhui, 230001, China Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou Jiangsu, 215123, China State Key Laboratory of Precision
本文提出利用 LLMs 自动从放射学报告中提取诊断标签以低成本构建大规模“银标准”数据集,从而促进大规模监督预训练,仅使用 3D ResNet-18 结合原始 CLIP 训练便在零样本诊断和跨模态检索任务上取得了最先进的性能。
Rethinking the Sample Relations for Few-Shot Classification
School of Big Data and Software Engineering, Chongqing University(重庆大学大数据与软件学院);Chongqing University(重庆大学);Fowler College of Business, San Diego State University(圣地亚哥州立大学福勒商学院);San Diego State University(圣地亚哥州立大学)
Robust Single Object Tracking in LiDAR Point Clouds under Adverse Weather Conditions
School of Mathematical Sciences, Dalian University of Technology(大连理工大学数学科学学院);School of Economics and Management, China University of Mining and Technology(中国矿业大学经济管理学院);DUT-BSU Joint Institute, Dalian University of Technology(大连理工大学-白俄罗斯国立大学联合学院)