We propose a general information-theoretic approach called Seraph (SEmi-supervised metRic leArning Paradigm with Hyper-sparsity) for metric learning that does not rely upon the manifold assumption. Given the probability parameterized by a Mahalanobis distance, we maximize the entropy of that probability on labeled data and minimize it on unlabeled data following entropy regularization, which allows the supervised and unsupervised parts to be integrated in a natural and meaningful way. Furthermore, Seraph is regularized by encouraging a low-rank projection induced from the metric. The optimization of Seraph is solved efficiently and stably by an EM-like scheme with the analytical E-Step and convex M-Step. Experiments demonstrate that Seraph compares favorably with many well-known global and local metric learning methods.
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
Beijing University of Posts and Telecommunications(北京邮电大学);Tsinghua University(清华大学);INF Technology(INF科技);Hong Kong University of Science and Technology(香港科技大学)
MMHCL: Multi-Modal Hypergraph Contrastive Learning for Recommendation
School of Computer Science and Engineering, Nanjing University of Science and Technology(计算机科学与工程学院,南京理工大学);Shituoyun (Nanjing) Technology Co., Ltd(石墨云(南京)科技有限公司);School of Artificial Intelligence, Beijing Normal University(人工智能学院,北京师范大学)
Sparsity-Constraint Optimization via Splicing Iteration
School of Mathematics, University of Birmingham, Birmingham, UK(英国伯明翰大学数学学院);Saw Swee Hock School of Public Health, National University of Singapore, Singapore(新加坡国立大学 Saw Swee Hock 公共卫生学院);Department of Statistics and Finance/International Institute of Finance, School of Management, University of Science and Technology of China, Hefei, Anhui, China(中国科学技术大学管理学院统计与金融系/国际金融研究院);School of Statistics and Information, Shanghai University of International Business and Economics, Shanghai, China(上海国际经贸管理大学统计与信息学院)
Rethinking Bayesian Learning for Data Analysis: The Art of Prior and Inference in Sparsity-Aware Modeling
Zhejiang University(浙江大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));National and Kapodistrian University of Athens(雅典国立卡波迪斯特里安大学);Aalborg University(奥尔堡大学);Cyprus University of Technology(塞浦路斯理工大学)