One-D-Piece:图像分词器与质量可控压缩的结合
One-D-Piece: Image Tokenizer Meets Quality-Controllable Compression
AI总结:
针对现有图像分词器固定长度分配效率低的问题,提出带Tail Token Drop机制的One-D-Piece可变长度离散图像分词器,实现质量可控压缩,重建质量与下游任务适配性均优于现有方法。
摘要:
当前的图像分词方法需要大量token(令牌)来捕获图像中包含的信息。尽管不同图像的信息量存在差异,但大多数图像分词器仅支持固定长度分词,导致token分配效率低下。本研究提出One-D-Piece,这是一款专为可变长度分词设计的离散图像分词器,实现了质量可控机制。为实现可变压缩率,我们在离散一维图像分词器中引入了一种简单却有效的正则化机制,名为“Tail Token Drop(尾部令牌丢弃)”。该方法促使关键信息集中在token序列的头部,在支持可变分词的同时,保持了当前最优的重建质量。我们通过多项重建质量指标评估该分词器,发现在更小的字节大小下,其感知质量显著优于现有的质量可控压缩方法,包括JPEG和WebP。此外,我们在图像分类、目标检测、语义分割和深度估计等多种下游计算机视觉任务上评估了该分词器,证实相较于其他可变码率方法,它能适配更多应用场景。我们的方法展现了可变长度离散图像分词的通用性,在压缩效率和重建性能方面建立了新范式。最后,我们通过对分词器的详细分析验证了尾部令牌丢弃的有效性。
英文摘要:
Current image tokenization methods require a large number of tokens to capture the information contained within images. Although the amount of information varies across images, most image tokenizers only support fixed-length tokenization, leading to inefficiency in token allocation. In this study, we introduce One-D-Piece, a discrete image tokenizer designed for variable-length tokenization, achieving quality-controllable mechanism. To enable variable compression rate, we introduce a simple but effective regularization mechanism named "Tail Token Drop" into discrete one-dimensional image tokenizers. This method encourages critical information to concentrate at the head of the token sequence, enabling support of variadic tokenization, while preserving state-of-the-art reconstruction quality. We evaluate our tokenizer across multiple reconstruction quality metrics and find that it delivers significantly better perceptual quality than existing quality-controllable compression methods, including JPEG and WebP, at smaller byte sizes. Furthermore, we assess our tokenizer on various downstream computer vision tasks, including image classification, object detection, semantic segmentation, and depth estimation, confirming its adaptability to numerous applications compared to other variable-rate methods. Our approach demonstrates the versatility of variable-length discrete image tokenization, establishing a new paradigm in both compression efficiency and reconstruction performance. Finally, we validate the effectiveness of tail token drop via detailed analysis of tokenizers.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。