Deep neural networks have been shown to easily overfit to biased training data with label noise or class imbalance. Meta-learning algorithms are commonly designed to alleviate this issue in the form of sample reweighting, by learning a meta weighting network that takes training losses as inputs to generate sample weights. In this paper, we advocate that choosing proper inputs for the meta weighting network is crucial for desired sample weights in a specific task, while training loss is not always the correct answer. In view of this, we propose a novel meta-learning algorithm, MetaInfoNet, which automatically learns effective representations as inputs for the meta weighting network by emphasizing task-related information with an information bottleneck strategy. Extensive experimental results on benchmark datasets with label noise or class imbalance validate that MetaInfoNet is superior to many state-of-the-art methods.
Spectral Surgery: Training-Free Refinement of LoRA via Gradient-Guided Singular Value Reweighting
School of Computing（计算学院）；Information Systems, Singapore Management University（信息系统，新加坡管理大学）；School of Computing, National University of Singapore（计算学院，新加坡国立大学）；State Key Laboratory for Multimedia Information Processing, Peking University（多媒体信息处理国家重点实验室，北京大学）
Adversarial Reweighting Guided by Wasserstein Distance for Bias Mitigation
SCHUFA Holding AG（舒法控股公司）；The Open University（开放大学）；L3S research center Hannover（汉诺威L3S研究中心）；University of Stuttgart（斯图加特大学）；Technical University of Munich（慕尼黑工业大学）
Standard Unsupervised Domain Adaptation (UDA) methods assume the availability of both source and target data during the adaptation. In this work, we investigate Source-free Unsupervised Domain Adaptation (SF-UDA), a specific case of UDA where a model is adapted to a target domain without access to source data. We propose a novel approach for the SF-UDA setting based on a loss reweighting strategy that brings robustness against the noise that inevitably affects the pseudo-labels. The classification loss is reweighted based on the reliability of the pseudo-labels that is measured by estimating t…
Causal Ensemble Agent: Hierarchical Causal Discovery with LLM-guided Expert Reweighting
The University of Melbourne（墨尔本大学）；MBZUAI（穆罕默德·本·扎耶德人工智能大学）；Peking University（北京大学）；Adelaide University（阿德莱德大学）；Hong Kong Baptist University（香港浸会大学）；The University of Sydney（悉尼大学）；Carnegie Mellon University（卡内基梅隆大学）
From Reweighting to Rewriting: Unlocking the Intervention Effects of Influential Samples in Training Data Attribution
State Key Laboratory of Multimedia Information Processing, Peking University（北京大学多媒体信息处理国家重点实验室）；YiXin-AILab（翼星人工智能实验室）；Beijing Academy of Artificial Intelligence（北京人工智能研究院）
Rethinking Data Curation in LLM Training: Online Reweighting Offers Better Generalization than Offline Methods
University of Cambridge（剑桥大学）；OATML, University of Oxford（牛津大学OATML实验室）；University of Toronto（多伦多大学）；Shanghai Jiao Tong University（上海交通大学）；Samsung AI Center（三星人工智能中心）
Diffusion-Guided Feature Selection via Nishimori Temperature: Noise-Based Spectral Embedding
Department of Computer Science（计算机科学系）；South-West State University（西南州大学）；T8 LLC Moscow, Russia（T8 LLC莫斯科俄罗斯）；South-West State University Kursk, Russia（西南州大学库尔斯克俄罗斯）
RollVerify: Bridging Efficiency and Accuracy in Long-Tail Rollout Reinforcement Learning
Shanghai Jiao Tong University（上海交通大学）；Central South University（中南大学）；SenseTime Research（商汤科技研究院）；The Chinese University of Hong Kong（香港中文大学）；Beihang University（北京航空航天大学）
