基于位回编码的大字母多集压缩
Compressing Multisets with Large Alphabets using Bits-Back Coding
摘要:
当前以最佳速率压缩多集合的方法具有与字母表大小线性缩放的计算复杂性,使得它们在许多现实世界设置中太慢而不实用。我们将展示如何将序列的压缩算法转换为一个多集,以换取一个额外的复杂性,是准线性的序列长度。这使我们能够以最佳速率压缩多组可交换符号,同时计算复杂性与字母表大小解耦。关键的见解是避免直接编码多集,而是压缩代理序列,使用一种称为“位回编码”的技术。我们证明了实验上的任务,这是棘手的最优速率的方法:压缩多组图像和JavaScript对象表示法(JSON)文件的方法。我们的实验代码可以在https://github.com/facebookresearch/multiset-compression上找到。
英文摘要:
Current methods which compress multisets at an optimal rate have computational complexity that scales linearly with alphabet size, making them too slow to be practical in many real-world settings. We show how to convert a compression algorithm for sequences into one for multisets, in exchange for an additional complexity term that is quasi-linear in sequence length. This allows us to compress multisets of exchangeable symbols at an optimal rate, with computational complexity decoupled from the alphabet size. The key insight is to avoid encoding the multiset directly, and instead compress a proxy sequence, using a technique called `bits-back coding'. We demonstrate the method experimentally on tasks which are intractable with previous optimal-rate methods: compression of multisets of images and JavaScript Object Notation (JSON) files. Code for our experiments is available at https://github.com/facebookresearch/multiset-compression.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。