Deep learning's success has been widely recognized in a variety of machine learning tasks, including image classification, audio recognition, and natural language processing. As an extension of deep learning beyond these domains, graph neural networks (GNNs) are designed to handle the non-Euclidean graph-structure which is intractable to previous deep learning techniques. Existing GNNs are presented using various techniques, making direct comparison and cross-reference more complex. Although existing studies categorize GNNs into spatial-based and spectral-based techniques, there hasn't been a thorough examination of their relationship. To close this gap, this study presents a single framework that systematically incorporates most GNNs. We organize existing GNNs into spatial and spectral domains, as well as expose the connections within each domain. A review of spectral graph theory and approximation theory builds a strong relationship across the spatial and spectral domains in further investigation.
LITIS Lab（LITIS实验室）；University of Rouen Normandy（鲁昂诺曼底大学）
This paper aims at revisiting Graph Convolutional Neural Networks by bridging the gap between spectral and spatial design of graph convolutions. We theoretically demonstrate some equivalence of the graph convolution process regardless it is designed in the spatial or the spectral domain. The obtained general framework allows to lead a spectral analysis of the most popular ConvGNNs, explaining their performance and showing their limits. Moreover, the proposed framework is used to design new convolutions in spectral domain with a custom frequency profile while applying them in the spatial domain…
Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networks
Mississippi State University（密西西比州立大学）；Virginia Tech（弗吉尼亚理工大学）；South Dakota State University（南达科他州立大学）；Emory University（埃默里大学）；The University of Texas at Dallas（德克萨斯大学达拉斯分校）；JD.COM Silicon Valley Research Center（京东硅谷研究中心）；IBM T. J. Watson Research Center（IBM托马斯·J·沃森研究中心）
Bridging Traffic State and Trajectory for Dynamic Road Network and Trajectory Representation Learning
School of Computer Science and Engineering, Beihang University（北京航空航天大学计算机科学与工程学院）；School of Economics and Management, Beihang University（北京航空航天大学经济管理学院）；Shenzhen Institute of Beihang University（北京航空航天大学深圳研究院）
Context-Enhanced Multi-View Trajectory Representation Learning: Bridging the Gap through Self-Supervised Models
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Nanyang Technological University（南洋理工大学）
OmniPMNet: Bridging discrete and gridded PM10 forecasts via omni-query neural processes
ColorfulClouds Technology Co., Ltd.（彩云科技有限公司）；School of Systems Science, Beijing Normal University（北京师范大学系统科学学院）；D-ITET, ETH Zurich（苏黎世联邦理工学院动态信息与电气工程系）
Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms
College of Intelligence and Computing, Tianjin University（天津大学智能与计算学院）；Montreal Institute of Learning Algorithms (MILA)（蒙特利尔学习算法研究所）；Department of Computer Science and Engineering, Southern University of Science and Technology（南方科技大学计算机科学与工程系）
Bridging Text and Molecule: A Survey on Multimodal Frameworks for Molecule
Center for Research on Intelligent Perception and Computing (CRIPAC)（智能感知与计算研究中心）；State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS)（多模态人工智能系统国家重点实验室）；Institute of Automation, Chinese Academy of Sciences (CASIA)（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）
Université du Québec à Montréal（魁北克大学蒙特利尔分校）；Higher Colleges of Technology（高等技术学院）；Inria（法国国家信息与自动化研究所）；Ecole Polytechnique（巴黎综合理工学院）；IPP（巴黎理工学院）
Fairness emerged as an important requirement to guarantee that Machine Learning (ML) predictive systems do not discriminate against specific individuals or entire sub-populations, in particular, minorities. Given the inherent subjectivity of viewing the concept of fairness, several notions of fairness have been introduced in the literature. This paper is a survey that illustrates the subtleties between fairness notions through a large number of examples and scenarios. In addition, unlike other surveys in the literature, it addresses the question of: which notion of fairness is most suited to a…
Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images
The Chinese University of Hong Kong（香港中文大学）；The University of Hong Kong（香港大学）；Institute of Medical Intelligence and XR, The Chinese University of Hong Kong（香港中文大学医学智能与扩展现实研究所）
University of Gotenburg（哥德堡大学）；Dublin Institute of Technology（都柏林理工学院）
Natural language processing (NLP) can be done using either top-down (theory driven) and bottom-up (data driven) approaches, which we call mechanistic and phenomenological respectively. The approaches are frequently considered to stand in opposition to each other. Examining some recent approaches in deep learning we argue that deep neural networks incorporate both perspectives and, furthermore, that leveraging this aspect of deep learning may help in solving complex problems within language technology, such as modelling language and perception in the domain of spatial cognition.
Geographical Context Matters: Bridging Fine and Coarse Spatial Information to Enhance Continental Land Cover Mapping
University of Natural Resources and Life Sciences, Vienna（维也纳自然资源与生命科学大学）；University of Montpellier（蒙彼利埃大学）；AgroParisTech（巴黎农艺学院）；CIRAD（法国国际农业发展研究中心）；CNRS（法国国家科学研究中心）；INRAE（法国国家农业食品与环境研究院）；INRIA（法国国家信息与自动化研究院）
University of Science and Technology of China（中国科学技术大学）
There still remains an extreme performance gap between Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) when training from scratch on small datasets, which is concluded to the lack of inductive bias. In this paper, we further consider this problem and point out two weaknesses of ViTs in inductive biases, that is, the spatial relevance and diverse channel representation. First, on spatial aspect, objects are locally compact and relevant, thus fine-grained feature needs to be extracted from a token and its neighbors. While the lack of data hinders ViTs to attend the spatial re…
The University of Tokyo（东京大学）；LPIXEL Inc.（LPIXEL公司）；National Institute of Informatics（国立信息学研究所）；University of Cambridge（剑桥大学）；Keio University（庆应义塾大学）
Despite the success of Convolutional Neural Network-based Computer-Aided Diagnosis research, its clinical applications remain challenging. Accordingly, developing medical Artificial Intelligence (AI) fitting into a clinical environment requires identifying/bridging the gap between AI and Healthcare sides. Since the biggest problem in Medical Imaging lies in data paucity, confirming the clinical relevance for diagnosis of research-proven image augmentation techniques is essential. Therefore, we hold a clinically valuable AI-envisioning workshop among Japanese Medical Imaging experts, physicians…
This survey focuses on categorizing and evaluating the methods of supernet optimization in the field of Neural Architecture Search (NAS). Supernet optimization involves training a single, over-parameterized network that encompasses the search space of all possible network architectures. The survey analyses supernet optimization methods based on their approaches to spatial and temporal optimization. Spatial optimization relates to optimizing the architecture and parameters of the supernet and its subnets, while temporal optimization deals with improving the efficiency of selecting architectures…
