Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed for dynamic graph modeling in recent years, effective and scalable models are yet to be developed. In this paper, we propose a novel graph neural network approach, called TCL, which deals with the dynamically-evolving graph in a continuous-time fashion and enables effective dynamic node representation learning that captures both the temporal and topology information. Technically, our model contains three novel aspects. First, we generalize the vanilla Transformer to temporal graph learning scenarios and design a graph-topology-aware transformer. Secondly, on top of the proposed graph transformer, we introduce a two-stream encoder that separately extracts representations from temporal neighborhoods associated with the two interaction nodes and then utilizes a co-attentional transformer to model inter-dependencies at a semantic level. Lastly, we are inspired by the recently developed contrastive learning and propose to optimize our model by maximizing mutual information (MI) between the predictive representations of two future interaction nodes. Benefiting from this, our dynamic representations can preserve high-level (or global) semantics about interactions and thus is robust to noisy interactions. To the best of our knowledge, this is the first attempt to apply contrastive learning to representation learning on dynamic graphs. We evaluate our model on four benchmark datasets for interaction prediction and experiment results demonstrate the superiority of our model.
Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition
Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Hebei University of Science and Technology(河北科技大学)
Conditional Neural Processes~(CNPs) bridge neural networks with probabilistic inference to approximate functions of Stochastic Processes under meta-learning settings. Given a batch of non-{ \it i.i.d} function instantiations, CNPs are jointly optimized for in-instantiation observation prediction and cross-instantiation meta-representation adaptation within a generative reconstruction pipeline. There can be a challenge in tying together such two targets when the distribution of function observations scales to high-dimensional and noisy spaces. Instead, noise contrastive estimation might be able…
Rethinking the Sample Relations for Few-Shot Classification
School of Big Data and Software Engineering, Chongqing University(重庆大学大数据与软件学院);Chongqing University(重庆大学);Fowler College of Business, San Diego State University(圣地亚哥州立大学福勒商学院);San Diego State University(圣地亚哥州立大学)
Angular Gaussian Supervised Contrastive Learning for Long-Tailed Electrocardiogram Arrhythmia Diagnosis
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);Department of Neurology and Neurological Rehabilitation, Shanghai Yangzhi Rehabilitation Hospital, School of Medicine, Tongji University(同济大学医学院附属上海养志康复医院神经科与神经康复科)
Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations
School of Computer Science, University of Nottingham Ningbo China(诺丁汉大学宁波校区计算机科学学院);Institute of Biomedical Engineering, Ningbo institute of materials technology and engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所生物医学工程研究所);School of Electrical & Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院)
Physical probes expose and alleviate chemical-environment collapse in molecular representations
Hainan Institute, Zhejiang University(浙江大学海南研究院);Institute of Marine Biology and Pharmacology, Ocean College, Zhejiang University(浙江大学海洋学院海洋生物学与药理研究所);School of Food and Pharmacy, Zhejiang Ocean University(浙江海洋大学食品学院);Hangzhou Bio-Sincerity Pharmaceutical Technology Company Limited(杭州生物 sincerity 药业技术有限公司);School of Pharmaceutical Sciences, Shanghai Jiao Tong University(上海交通大学药学院)
Learning and Leveraging World Models in Visual Representation Learning
FAIR at Meta(Meta FAIR实验室);Univ Gustave Eiffel(Gustave Eiffel大学);CNRS(法国国家科学研究中心);INRIA(法国国家信息与自动化研究所);Courant Institute, New York University(纽约大学柯朗数学科学研究所);Center for Data Science, New York University(纽约大学数据科学中心)
本文提出 Image World Models,将 JEPA 从掩码预测扩展到潜空间中的全局光度变换预测,并证明其可微调出强性能且能控制表征的不变性或等变性。
Hyperbolic Multimodal Representation Learning for Biological Taxonomies
Simon Fraser University(西蒙弗雷泽大学);University of Waterloo(滑铁卢大学);Vector Institute(向量研究所);University of Guelph(圭尔夫大学);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所);Aalborg University(奥胡斯大学)
On Leveraging Variational Graph Embeddings for Open World Compositional Zero-Shot Learning
Technische Universität München(慕尼黑工业大学);Mercateo AG(Mercateo股份公司)
人类能够识别和分类已知概念的新组合。组合零镜头学习(Compositional Zero-Shot learning,CNOML)的任务是学习原始概念(即对象和状态)的组合,即使是它们的新组合也可以被zero-shot分类。在这项工作中,我们不假设任何先验知识的可行性,即开放世界的设置,其中不可行的组合物占主导地位的搜索空间的新组合物。我们提出了一种组合变分图自动编码器(CVGAE)的方法来学习原始概念(节点)的变分嵌入以及它们的组合(通过边缘)的可行性。这样的建模使得CVGAE可扩展到现实世界的应用场景。这与SOTA方法CGE相反,SOTA方法CGE在计算上非常昂贵。例如,对于基准C-GQA数据集,CGE需要3.94 x 10^5个节点,而CVGAE只需要1323个节点。我们学习将图和图像嵌入映射到公共嵌入空间。CVGAE采用深度度量学习方法,并通过投影图和图像嵌入之间的双向对比损失来学习该空间中的相似性度量。我们在三个基准数据集上验证了该方法的有效性,并通过一个图像检索任务证明了CVGAE学习的表示更适合于组合泛化。
Evaluating alignment between humans and neural network representations in image-based learning tasks
Institute for Human-Centered AI, Helmholtz Computational Health Center(亥姆霍兹计算健康中心以人为本人工智能研究所);Max Planck Institute for Biological Cybernetics(马克斯·普朗克生物控制论研究所);Max Planck School of Cognition(马克斯·普朗克认知科学学院);Max Planck Institute for Human Cognitive & Brain Sciences(马克斯·普朗克人类认知与脑科学研究所);University of Tübingen(蒂宾根大学);Kavli Institute for Systems Neuroscience(卡夫利系统神经科学研究所);Leipzig University(莱比锡大学);Technical University Dresden(德累斯顿工业大学);Julius-Maximilians-Universität Würzburg(维尔茨堡大学);Max Planck Institute for Human Development(马克斯·普朗克人类发展研究所)
Graph Data Augmentation via Contrastive Generator Inversion ($\texttt{DCBA}$)
Wrocław University of Science and Technology(弗罗茨瓦夫理工大学);University of Technology Sydney(悉尼科技大学);SGH Warsaw School of Economics(华沙经济大学);Toronto Metropolitan University(多伦多都会大学)