Google Research(谷歌研究院);Mila, Québec Artificial Intelligence Institute(Mila——魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);CIFAR(加拿大高等研究院);IVADO(IVADO数据价值研究所)
Recent studies show that task distribution plays a vital role in the meta-learner's performance. Conventional wisdom is that task diversity should improve the performance of meta-learning. In this work, we find evidence to the contrary; (i) our experiments draw into question the efficacy of our learned models: similar manifolds can be learned with a subset of the data (lower task diversity). This finding questions the advantage of providing more data to the model, and (ii) adding diversity to the task distribution (higher task diversity) sometimes hinders the model and does not lead to a significant improvement in performance as previously believed. To strengthen our findings, we provide both empirical and theoretical evidence.
Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);Tsinghua University(清华大学);the Hong Kong University of Science and Technology(香港科技大学);University of Chinese Academy of Sciences(中国科学院大学)
MetaVA: Curriculum Meta-learning and Pre-fine-tuning of Deep Neural Networks for Detecting Ventricular Arrhythmias based on ECGs
National University of Singapore(新加坡国立大学);HeartVoice Medical Technology(心声医疗科技);University of Science and Technology of China(中国科学技术大学);Sir Run Run Shaw Hospital, Zhejiang University School of Medicine(浙江大学医学院附属邵逸夫医院);Peking University(北京大学);Institute of Medical Technology, Health Science Center of Peking University(北京大学医学部医学技术研究院)
Department of Computer Science, Stanford University(斯坦福大学计算机科学系);Machine Learning Department, Carnegie Mellon University(卡内基梅隆大学机器学习系);Department of Computer Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学系)
Submodular function maximization has found a wealth of new applications in machine learning models during the past years. The related supermodular maximization models (submodular minimization) also offer an abundance of applications, but they appeared to be highly intractable even under simple cardinality constraints. Hence, while there are well-developed tools for maximizing a submodular function subject to a matroid constraint, there is much less work on the corresponding supermodular maximization problems. We give a broad parameterized family of monotone functions which includes submodular …
Meta-Ensemble Learning with Diverse Data Splits for Improved Respiratory Sound Classification
Department of Electronic Engineering, Wonkwang University(Wonkwang大学电子工程系);RSC LAB, MODULABS(MODULABS的RSC实验室);AICU Global Inc.(AICU Global公司);Seoul National University Bundang Hospital(首尔国立大学柏阳医院)
On the Effect of Sampling Diversity in Scaling LLM Inference
The Pennsylvania State University(宾夕法尼亚州立大学);Carnegie Mellon University(卡内基梅隆大学);University of California, Los Angeles(加州大学洛杉矶分校);Rensselaer Polytechnic Institute(罗切斯特理工学院);The Chinese University of Hong Kong(香港中文大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);NEC Laboratories America(NEC美国实验室)