Deep learning on point clouds has received increased attention thanks to its wide applications in AR/VR and autonomous driving. These applications require low latency and high accuracy to provide real-time user experience and ensure user safety. Unlike conventional dense workloads, the sparse and irregular nature of point clouds poses severe challenges to running sparse CNNs efficiently on the general-purpose hardware. Furthermore, existing sparse acceleration techniques for 2D images do not translate to 3D point clouds. In this paper, we introduce TorchSparse, a high-performance point cloud inference engine that accelerates the sparse convolution computation on GPUs. TorchSparse directly optimizes the two bottlenecks of sparse convolution: irregular computation and data movement. It applies adaptive matrix multiplication grouping to trade computation for better regularity, achieving 1.4-1.5x speedup for matrix multiplication. It also optimizes the data movement by adopting vectorized, quantized and fused locality-aware memory access, reducing the memory movement cost by 2.7x. Evaluated on seven representative models across three benchmark datasets, TorchSparse achieves 1.6x and 1.5x measured end-to-end speedup over the state-of-the-art MinkowskiEngine and SpConv, respectively.
Cloud detection in Landsat-8 imagery in Google Earth Engine based on a deep neural network
Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences(中国科学院精密测量科学与技术创新研究院);Anhui University(安徽大学);University of Chinese Academy of Sciences(中国科学院大学);University of Nottingham(诺丁汉大学)
Machine learning enables polymer cloud-point engineering via inverse design
Institute of Materials Research & Engineering(材料研究与工程研究所);Institute of High-Performance Computing(高性能计算研究所);Massachussets Institute of Technology(麻省理工学院)