arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.23358cs.LGcs.CV
收藏

一个数据集值一兆字节

A Dataset is Worth 1 MB

School of Computer Science and Engineering(计算机科学与工程学院)

Elad Kimchi Shoshani, Leeyam Gabay, Yedid Hoshen

AI总结:

本文提出PLADA方法,通过传输类别标签而非像素数据,实现高效的数据集分发,减少通信成本并保持高分类准确率。

摘要:

一个数据集服务器经常需要将相同的大数据负载分发给许多客户端,这会带来巨大的通信成本。由于客户端经常在不同的硬件和软件框架上运行,传输预训练的模型通常是不可行的;相反,代理需要原始数据来训练自己的任务特定模型。虽然数据集蒸馏试图压缩训练信号,但当前的方法在处理高分辨率数据时难以扩展,且很少能实现足够小的文件。在本文中,我们提出了伪标签作为数据(PLADA),一种完全消除像素传输的方法。我们假设代理已预先加载了一个大型、通用、未标记的参考数据集(例如ImageNet-1K,ImageNet-21K),并通过传输特定图像的类别标签来通信新任务。为了解决参考数据集与目标数据集之间的分布不匹配问题,我们引入了一种修剪机制,该机制过滤参考数据集,只保留对目标任务最语义相关图像的标签。这个选择过程同时提高了训练效率并最小化了传输负载。在10个多样化的数据集上进行的实验表明,我们的方法可以在小于1MB的负载下转移任务知识,同时保持高分类准确率,为高效的数据显示提供了一个有前途的解决方案。

英文摘要:

A dataset server must often distribute the same large payload to many clients, incurring massive communication costs. Since clients frequently operate on diverse hardware and software frameworks, transmitting a pre-trained model is often infeasible; instead, agents require raw data to train their own task-specific models locally. While dataset distillation attempts to compress training signals, current methods struggle to scale to high-resolution data and rarely achieve sufficiently small files. In this paper, we propose Pseudo-Labels as Data (PLADA), a method that completely eliminates pixel transmission. We assume agents are preloaded with a large, generic, unlabeled reference dataset (e.g., ImageNet-1K, ImageNet-21K) and communicate a new task by transmitting only the class labels for specific images. To address the distribution mismatch between the reference and target datasets, we introduce a pruning mechanism that filters the reference dataset to retain only the labels of the most semantically relevant images for the target task. This selection process simultaneously maximizes training efficiency and minimizes transmission payload. Experiments on 10 diverse datasets demonstrate that our approach can transfer task knowledge with a payload of less than 1 MB while retaining high classification accuracy, offering a promising solution for efficient dataset serving.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑