In many real-world machine learning applications, samples belong to a set of domains e.g., for product reviews each review belongs to a product category. In this paper, we study multi-domain imbalanced learning (MIL), the scenario that there is imbalance not only in classes but also in domains. In the MIL setting, different domains exhibit different patterns and there is a varying degree of similarity and divergence among domains posing opportunities and challenges for transfer learning especially when faced with limited or insufficient training data. We propose a novel domain-aware contrastive knowledge transfer method called DCMI to (1) identify the shared domain knowledge to encourage positive transfer among similar domains (in particular from head domains to tail domains); (2) isolate the domain-specific knowledge to minimize the negative transfer from dissimilar domains. We evaluated the performance of DCMI on three different datasets showing significant improvements in different MIL scenarios.
UBMF: Uncertainty-Aware Bayesian Meta-Learning Framework for Fault Diagnosis with Imbalanced Industrial Data
Hangzhou International Innovation Institute, Beihang University(北京航空航天大学杭州国际创新研究院);Institute of Reliability Engineering, Beihang University(北京航空航天大学可靠性工程研究所);Science & Technology on Reliability & Environmental Engineering Laboratory(可靠性与环境工程技术重点实验室);School of Reliability and Systems Engineering, Beihang University(北京航空航天大学可靠性与系统工程学院)
ImGCL: Revisiting Graph Contrastive Learning on Imbalanced Node Classification
Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University(清华大学交叉信息研究院);Tencent AI Lab(腾讯人工智能实验室);Hong Kong University of Science and Technology(香港科技大学)
Theoretical Analysis of Contrastive Learning under Imbalanced Data: From Training Dynamics to a Pruning Solution
New Jersey Institute of Technology(新泽西理工学院);Cornell University(康奈尔大学);University of Louisiana at Lafayette(路易斯安那大学拉法叶分校);Rensselaer Polytechnic Insitute(伦斯勒理工学院)
PROTOCOL: Partial Optimal Transport-enhanced Contrastive Learning for Imbalanced Multi-view Clustering
Shanghai Key Laboratory of Intelligent Information Processing, College of Computer Science and Artificial Intelligence, Fudan University, China(上海智能信息处理实验室,计算机科学与人工智能学院,复旦大学);College of Computer Science and Technology, Qingdao University, China(计算机科学与技术学院,青岛大学);Shanghai Key Laboratory of Navigation and Location-based Services, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, China(上海导航与位置服务实验室,电子信息与电气工程学院,上海交通大学);Institute of Science and Technology for Brain-Inspired Intelligence and Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, China(脑启发智能科学技术研究院和计算神经科学与脑启发智能重点实验室,复旦大学)
Contrastive Pre-training for Imbalanced Corporate Credit Ratings
Center for Research on Intelligent Perception and Computing(智能感知与计算研究中心);National Laboratory of Pattern Recognition(模式识别国家实验室);Institute of Automation, Chinese Academy of Science(中国科学院自动化研究所)
Breaking the Prototype Bias Loop: Confidence-Aware Federated Contrastive Learning for Highly Imbalanced Clients
Key Laboratory of Water Big Data Technology of Ministry of Water Resources, College of Computer Science and Software Engineering, Hohai University, Nanjing, China(水利部水大数据技术重点实验室,计算机科学与软件工程学院,河海大学,南京,中国);Department of Computer Science, City University of Hong Kong, Hong Kong, China(计算机科学系,香港城市大学,香港,中国);State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China(新型软件技术国家重点实验室,南京大学,南京,中国);School of Artificial Intelligence and Information Technology, Nanjing University of Chinese Medicine, Nanjing, China(人工智能与信息技术学院,南京中医药大学,南京,中国)
Negatives-Dominant Contrastive Learning for Generalization in Imbalanced Domains
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Computer and Artificial Intelligence, Nanjing University of Finance and Economics(南京财经大学计算机与人工智能学院);MIIT Key Laboratory of Pattern Analysis and Machine Intelligence(信息产业部模式分析与机器智能重点实验室)
Dynamic Graph-Like Learning with Contrastive Clustering on Temporally-Factored Ship Motion Data for Imbalanced Sea State Estimation in Autonomous Vessel
School of Computer Science and Engineering, Tianjin University of Technology(计算机科学与工程学院,天津理工大学)
Quantum-Informed Contrastive Learning with Dynamic Mixup Augmentation for Class-Imbalanced Expert Systems
organization= Thomas Lord Department of Computer Science, Viterbi School of Engineering, University of Southern California , city= Los Angeles , state= CA , postcode= 90089 , country= USA;organization= Department of Industrial Engineering;Management, Khulna University of Engineering \& Technology (KUET) , city= Khulna , postcode= 9203 , country= Bangladesh;organization= Department of Computer Science, American International University-Bangladesh (AIUB) , city= Dhaka , postcode= 1229 , country= Bangladesh
Collaborative Optimization of Multiclass Imbalanced Learning: Density-Aware and Region-Guided Boosting
School of Mathematics and Computer, Guangdong Ocean University(数学与计算机学院,广东海洋大学);School of Automation Engineering, University of Electronic Science and Technology of China(自动化工程学院,电子科技大学)
针对标签噪声的学习是保证深度神经网络可靠性能的重要课题。目前的研究通常是指动态噪声建模与模型输出概率和损失值,然后分离干净和噪声样本。这些方法取得了显著的成功。然而,与精心挑选的数据不同,现有的方法在面对不平衡的数据集时往往不能很好地执行,这是现实世界中的常见情况。我们彻底调查了这一现象,并指出了阻碍性能的两个主要问题,即,\emph{inter-class loss distribution discrepancy}和\emph{misleading predictions due to uncertainty}。第一个问题是,现有的方法通常执行类不可知的噪声建模。然而,损失分布在类别不平衡的类别之间显示出显着的差异,并且类别不可知的噪声建模很容易与噪声样本和少数类别中的样本混淆。第二个问题是由于认知不确定性和任意不确定性,模型可能会输出误导性的预测,因此现有的方法,仅依赖于输出概率可能无法区分置信样本。受我们观察的启发,我们提出了一个不确定性感知的标签校正框架~(ULC)来处理不平衡数据集上的标签噪声。首先,我们进行认知不确定性感知类特定噪声建模,以识别值得信赖的干净样本,并完善/丢弃高度自信的真实/损坏的标签。然后,我们在后续的学习过程中引入任意的不确定性,以防止在标签噪声建模过程中的噪声积累。我们在几个合成和真实世界的数据集上进行实验。实验结果证明了该方法的有效性,特别是在…
Pathology-Aware Multi-View Contrastive Learning for Patient-Independent ECG Reconstruction
Department of Computer Science and Engineering, Indian Institute of Technology Roorkee(计算机科学与工程系,印度理工学院Roorkee);Department of Biosciences and Bioengineering, Indian Institute of Technology Roorkee(生物科学与生物工程系,印度理工学院Roorkee)
Unsupervised Contrastive Learning Using Out-Of-Distribution Data for Long-Tailed Dataset
Department of Electronic Engineering, Seoul National University of Science and Technology(电子工程系,首尔科学技术大学);Department of Electrical and Information Engineering, Seoul National University of Science and Technology(电气与信息工程系,首尔科学技术大学);School of Electrical and Electronics Engineering, Chung-Ang University(电气电子工程学院, Chung-Ang 大学)
Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation
SKLSDE, School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机学院软件开发环境国家重点实验室);Beijing Advanced Institution on Big Data and Brain Computing, Beihang University(北京航空航天大学大数据与脑机智能高精尖创新中心);School of Electrical Engineering and Computer Science, University of Ottawa(渥太华大学电气工程与计算机科学学院)