图像中有什么？压缩图像的探索性解码
What's in the Image? Explorable Decoding of Compressed Images
摘要：
为了节省存储空间和传输带宽，每天捕获的视觉内容的数量不断增加，有必要使用有损压缩方法。虽然大量的研究工作致力于改进压缩技术，但每种方法都不可避免地丢弃信息。特别是在低比特率下，该信息通常对应于语义上有意义的视觉线索，使得解压缩涉及显著的模糊性。尽管存在这个事实，现有的解压缩算法通常仅产生单个输出，并且不允许观看者探索映射到给定压缩代码的图像集合。在这项工作中，我们提出了第一个图像解压缩方法，以方便用户探索的各种自然图像，可能会引起压缩输入代码，从而使用户能够确定什么可以和什么不可能有原始场景。具体来说，我们开发了一种新的基于深度网络的解码器架构，用于无处不在的JPEG标准，它允许遍历与压缩JPEG文件一致的解压缩图像集。为了允许简单的用户交互，我们开发了一个图形用户界面，包括几个直观的探索工具，包括一个自动工具，用于检查感兴趣的特定解决方案。我们在图形，医疗和法医用例上展示了我们的框架，展示了其广泛的潜在应用。
英文摘要：
The ever-growing amounts of visual contents captured on a daily basis necessitate the use of lossy compression methods in order to save storage space and transmission bandwidth. While extensive research efforts are devoted to improving compression techniques, every method inevitably discards information. Especially at low bit rates, this information often corresponds to semantically meaningful visual cues, so that decompression involves significant ambiguity. In spite of this fact, existing decompression algorithms typically produce only a single output, and do not allow the viewer to explore the set of images that map to the given compressed code. In this work we propose the first image decompression method to facilitate user-exploration of the diverse set of natural images that could have given rise to the compressed input code, thus granting users the ability to determine what could and what could not have been there in the original scene. Specifically, we develop a novel deep-network based decoder architecture for the ubiquitous JPEG standard, which allows traversing the set of decompressed images that are consistent with the compressed JPEG file. To allow for simple user interaction, we develop a graphical user interface comprising several intuitive exploration tools, including an automatic tool for examining specific solutions of interest. We exemplify our framework on graphical, medical and forensic use cases, demonstrating its wide range of potential applications.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
