SENNS: Sparse Extraction Neural NetworkS for Feature Extraction
Obafemi Awolowo University(奥巴费米·阿沃洛沃大学)
Abdulrahman Oladipupo Ibraheem
备注:
Eighteen pages in all, but much of the central ideas are covered in the first five and a half pages; most of the remaining pages are devoted to straightforward mathematical derivations, and the presentation of three algorithms. Manuscript contains no figures at this time
By drawing on ideas from optimisation theory, artificial neural networks (ANN), graph embeddings and sparse representations, I develop a novel technique, termed SENNS (Sparse Extraction Neural NetworkS), aimed at addressing the feature extraction problem. The proposed method uses (preferably deep) ANNs for projecting input attribute vectors to an output space wherein pairwise distances are maximized for vectors belonging to different classes, but minimized for those belonging to the same class, while simultaneously enforcing sparsity on the ANN outputs. The vectors that result from the projection can then be used as features in any classifier of choice. Mathematically, I formulate the proposed method as the minimisation of an objective function which can be interpreted, in the ANN output space, as a negative factor of the sum of the squares of the pair-wise distances between output vectors belonging to different classes, added to a positive factor of the sum of squares of the pair-wise distances between output vectors belonging to the same classes, plus sparsity and weight decay terms. To derive an algorithm for minimizing the objective function via gradient descent, I use the multi-variate version of the chain rule to obtain the partial derivatives of the function with respect to ANN weights and biases, and find that each of the required partial derivatives can be expressed as a sum of six terms. As it turns out, four of those six terms can be computed using the standard back propagation algorithm; the fifth can be computed via a slight modification of the standard backpropagation algorithm; while the sixth one can be computed via simple arithmetic. Finally, I propose experiments on the ARABASE Arabic corpora of digits and letters, the CMU PIE database of faces, the MNIST digits database, and other standard machine learning databases.
Relative-Absolute Fusion: Rethinking Feature Extraction in Image-Based Iterative Method Selection for Solving Sparse Linear Systems
School of Software Technology, Dalian University of Technology(大连理工大学软件学院);Greater Bay Area National Center of Technology Innovation(粤港澳大湾区国家技术创新中心);CATARC Automotive Test Center (Tianjin) Co., Ltd(CATARC汽车测试中心(天津)有限公司)
ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformation
Beihang University(北京航空航天大学);University of Macau(澳门大学);National University of Singapore(新加坡国立大学);Institute for Infocomm Research, Agency for Science, Technology and Research(新加坡科技研究局资讯通信研究院)
URoadNet: Dual Sparse Attentive U-Net for Multiscale Road Network Extraction
College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications(南京邮电大学自动化学院与人工智能学院);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);Jarvis Research Center, Tencent YouTu Lab(腾讯优图实验室贾维斯研究中心)
自动驾驶汽车必须快速识别驾驶环境以确保安全驾驶。随着激光雷达(Light Detection And Range,LiDAR)传感器在自动驾驶汽车中的广泛应用,对传感器帧速率范围内的点云进行逐点分类的快速语义分割在驾驶环境识别中引起了人们的关注。基于体素和融合的语义分割模型是目前点云语义分割的主流模型,但由于体素分辨率高,计算量大,影响了其实时性。本文提出了一种基于点卷积和三维稀疏卷积的快速体素语义分割模型(PCSCNet)。所提出的模型的设计优于在高和低体素分辨率使用点卷积为基础的特征提取。此外,该模型在特征提取后使用3D稀疏卷积加速特征传播。实验结果表明,该模型在语义分割方面优于SemanticKITTI和nuScenes的实时模型,在LiDAR点云推理方面达到了实时性要求。
FSHNet: Fully Sparse Hybrid Network for 3D Object Detection
School of Computer Science and Engineering, Sun Yat-sen University(计算机科学与工程学院,中山大学);Key Laboratory of Machine Intelligence and Advanced Computing, Sun Yat-sen University(机器智能与高级计算关键实验室,中山大学);School of Artificial Intelligence, Sun Yat-sen University(人工智能学院,中山大学)
Bi-Level Routing and Sparse Spatial Attention based Multi-View BEV 3D Object Detection for Autonomous Driving
Stuart Weitzman School of Design University of Pennsylvania(宾夕法尼亚大学斯图尔特·韦茨曼设计学院);Courant Institute of Mathematical Science New York University(纽约大学库朗数学科学研究所)
Self-supervised Extraction of Human Motion Structures via Frame-wise Discrete Features
Tokyo University of Agriculture and Technology(东京农工大学);National Institute of Advanced Industrial Science and Technology(产业技术综合研究所);Osaka University(大阪大学)
RibPull: Implicit Occupancy Fields and Medial Axis Extraction for CT Ribcage Scans
Electrical and Computer Engineering Department, University of California, Santa Cruz(加州大学圣克ruz分校电子与计算机工程系);Inria, Univ. Rennes, CNRS, IRISA, M2S, Rennes(Inria,里尔大学,CNRS,IRISA,M2S,里尔);LIRIS - CNRS - Université Claude Bernard Lyon 1(LIRIS-CNRS-里尔1大学);Computer Science Engineering Department, University of California, Santa Cruz(加州大学圣克ruz分校计算机科学工程系)