arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.10036cs.ITmath.IT
收藏

AI时代的信息压缩:最新进展与未来挑战

Information Compression in the AI Era: Recent Advances and Future Challenges

Jun Chen, Yong Fang, Ashish Khisti, Ayfer Ozgur, Nir Shlezinger, Chao Tian

AI总结:

本文综述机器学习与数据压缩的新兴联系,梳理面向任务压缩、率失真-感知理论、深度学习压缩及LLM文本压缩等进展,并展望未来方向。

摘要:

本综述文章聚焦机器学习与数据压缩领域之间正在形成的联系。尽管经典(有损)数据压缩的基本极限已通过率失真理论确立,但它与机器学习的联系催生了新的理论分析和应用领域。我们综述了基于任务和面向目标的压缩、率失真-感知理论以及用于估计和推理的压缩方面的近期工作。基于深度学习的方法也为压缩提供了自然的数据驱动算法途径。我们综述了将深度学习技术应用于基于任务或面向目标的压缩,以及图像和视频压缩的近期工作。我们还讨论了大语言模型在文本压缩中的潜在用途。最后,我们为这一充满前景的领域提供了若干未来研究方向。

英文摘要:

This survey articles focuses on emerging connections between the fields of machine learning and data compression. While fundamental limits of classical (lossy) data compression are established using rate-distortion theory, the connections to machine learning have resulted in new theoretical analysis and application areas. We survey recent works on task-based and goal-oriented compression, the rate-distortion-perception theory and compression for estimation and inference. Deep learning based approaches also provide natural data-driven algorithmic approaches to compression. We survey recent works on applying deep learning techniques to task-based or goal-oriented compression, as well as image and video compression. We also discuss the potential use of large language models for text compression. We finally provide some directions for future research in this promising field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑