Motivated by the need to address the degeneracy of canonical Laplace learning algorithms in low label rates, we propose to reformulate graph-based semi-supervised learning as a nonconvex generalization of a \emph{Trust-Region Subproblem} (TRS). This reformulation is motivated by the well-posedness of Laplacian eigenvectors in the limit of infinite unlabeled data. To solve this problem, we first show that a first-order condition implies the solution of a manifold alignment problem and that solutions to the classical \emph{Orthogonal Procrustes} problem can be used to efficiently find good classifiers that are amenable to further refinement. To tackle refinement, we develop the framework of Sequential Subspace Optimization for graph-based SSL. Next, we address the criticality of selecting supervised samples at low-label rates. We characterize informative samples with a novel measure of centrality derived from the principal eigenvectors of a certain submatrix of the graph Laplacian. We demonstrate that our framework achieves lower classification error compared to recent state-of-the-art and classical semi-supervised learning methods at extremely low, medium, and high label rates.
Calibrated Adaptation: Bayesian Stiefel Manifold Priors for Reliable Parameter-Efficient Fine-Tuning
Department of Computer Science, Iowa State University(计算机科学系,爱荷华州立大学);Department of Civil, Construction and Environmental Engineering, Iowa State University(土木、建设与环境工程系,爱荷华州立大学)
Department of Applied Mathematics and Theoretical Physics, The University of Cambridge(应用数学与理论物理系,剑桥大学);Department of Medicine, The University of Cambridge(医学系,剑桥大学);Department of Statistics, The University of Warwick(统计系,沃里克大学)
Self-Supervised Laplace Approximation for Bayesian Uncertainty Quantification
Rational Intelligence Lab, CISPA Helmholtz Center for Information Security Department of Statistics, LMU Munich(理性智能实验室,CISPA海德堡信息安全中心统计学系,慕尼黑大学);Department of Statistics, LMU Munich(统计学系,慕尼黑大学);Department of Computer Science, The University of Manchester(计算机科学系,曼彻斯特大学)
Spectal Harmonics: Bridging Spectral Embedding and Matrix Completion in Self-Supervised Learning
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Artificial Intelligence Research Institute (AIRI)(人工智能研究院(AIRI));Skolkovo Institute of Science and Technology (Skoltech)(斯科尔科沃科学技术学院(Skoltech))
SCALP: Semi-Supervised Statistical Shape Modeling from Imperfect 3D Photogrammetry via Landmark-Anchored Spectral Warp
Scientific Computing and Imaging Institute, University of Utah(犹他大学科学计算与成像研究所);Kahlert School of Computing, University of Utah(犹他大学卡勒特计算机学院);Division of Pediatric Plastic Surgery, UPMC Children’s Hospital of Pittsburgh(匹兹堡大学医学中心儿童医院小儿整形外科)
Uniform Convergence Rates for Lipschitz Learning on Graphs
Hausdorff Center for Mathematics, University of Bonn(波恩大学豪斯多夫数学中心);School of Mathematics, University of Minnesota(明尼苏达大学数学学院);Department of Mathematics, University of Erlangen–Nürnberg(埃尔朗根-纽伦堡大学数学系)
Robust Graph-Based Semi-Supervised Learning via $p$-Conductances
Department of Mathematics, UC San Diego(加州大学圣迭戈分校数学系);Halicioğlu Data Science Institute, UC San Diego(加州大学圣迭戈分校哈利乔格鲁数据科学研究所);Department of Mathematics, University of Missouri(密苏里大学数学系)
Semi-Supervised Federated Learning via Dual Contrastive Learning and Soft Labeling for Intelligent Fault Diagnosis
School of Electronic and Optical Engineering, Nanjing University of Science and Technology(南京理工大学电子与光学工程学院);School of Information Science and Engineering, Southeast University(东南大学信息科学与工程学院);Institute of Artificial Intelligence Research, Jiangsu Second Normal University(江苏第二师范学院人工智能研究所);Digital Research Institute, ENN Group(ENN集团数字研究院);School of Computing, Engineering and Mathematical Sciences, La Trobe University(拉筹伯大学计算、工程与数学科学学院);College of Science and Engineering, James Cook University(詹姆斯库克大学科学与工程学院)
GLL: A Differentiable Graph Learning Layer for Neural Networks
Department of Mathematics University of California, Los Angeles(数学系,加州大学洛杉矶分校);Computing + Mathematical Sciences (CMS) Department California Institute of Technology(计算与数学科学系(CMS),加州理工学院);School of Mathematics University of Minnesota(数学系,明尼苏达大学)