A dataset server must often distribute the same large payload to many clients, incurring massive communication costs. Since clients frequently operate on diverse hardware and software frameworks, transmitting a pre-trained model is often infeasible; instead, agents require raw data to train their own task-specific models locally. While dataset distillation attempts to compress training signals, current methods struggle to scale to high-resolution data and rarely achieve sufficiently small files. In this paper, we propose Pseudo-Labels as Data (PLADA), a method that completely eliminates pixel transmission. We assume agents are preloaded with a large, generic, unlabeled reference dataset (e.g., ImageNet-1K, ImageNet-21K) and communicate a new task by transmitting only the class labels for specific images. To address the distribution mismatch between the reference and target datasets, we introduce a pruning mechanism that filters the reference dataset to retain only the labels of the most semantically relevant images for the target task. This selection process simultaneously maximizes training efficiency and minimizes transmission payload. Experiments on 10 diverse datasets demonstrate that our approach can transfer task knowledge with a payload of less than 1 MB while retaining high classification accuracy, offering a promising solution for efficient dataset serving.
Is More Data Worth the Cost? Dataset Scaling Laws in a Tiny Attention-Only Decoder
Institute of Computer Science, University of St. Gallen(圣加仑大学计算机科学研究所);Institute of Computer Science in Vorarlberg, University of St. Gallen(圣加仑大学福拉尔贝格计算机科学研究所)
How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions
Department of Electrical & Computer Engineering(电气与计算机工程系);Paul G. Allen School of Computer Science & Engineering(保罗·G·艾伦计算机科学与工程学院);University of Washington(华盛顿大学)
Malware Detection in Docker Containers: An Image is Worth a Thousand Logs
K3Y Ltd(K3Y有限公司);International Hellenic University(国际希腊大学);Kingston University(金斯顿大学);University of Peloponnese(伯罗奔尼撒大学);Aristotle University of Thessaloniki(亚里士多德大学);Hellenic Mediterranean University(希腊地中海大学);University of Western Macedonia(西马其顿大学)
Is ImageNet worth 1 video? Learning strong image encoders from 1 long unlabelled video
Inria(法国国家信息与自动化研究所);Univ Rennes(雷恩大学);CNRS(法国国家科学研究中心);IRISA(法国计算机科学与随机系统研究所);University of Central Florida(中佛罗里达大学);Google DeepMind(谷歌DeepMind);University of Amsterdam(阿姆斯特丹大学);Institute of Advanced Research on Artificial Intelligence (IARAI)(人工智能高级研究所)
Is the Statistical Advantage Worth the Cost? An Empirical Comparison of KANs and MLPs for Structured Data Classification
Institute of Computer Science, University of the Philippines Los Baños(菲律宾大学洛斯巴尼奥斯分校计算机科学研究所);Machine Learning and Artificial Intelligence Applications Lab, University of the Philippines Los Baños(菲律宾大学洛斯巴尼奥斯分校机器学习与人工智能应用实验室)