Cross Modal Compression: Towards Human-comprehensible Semantic Compression
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Peking University(北京大学);Information Technology R&D Innovation Center of Peking University(北京大学信息技术创新研发中心)
Traditional image/video compression aims to reduce the transmission/storage cost with signal fidelity as high as possible. However, with the increasing demand for machine analysis and semantic monitoring in recent years, semantic fidelity rather than signal fidelity is becoming another emerging concern in image/video compression. With the recent advances in cross modal translation and generation, in this paper, we propose the cross modal compression~(CMC), a semantic compression framework for visual data, to transform the high redundant visual data~(such as image, video, etc.) into a compact, human-comprehensible domain~(such as text, sketch, semantic map, attributions, etc.), while preserving the semantic. Specifically, we first formulate the CMC problem as a rate-distortion optimization problem. Secondly, we investigate the relationship with the traditional image/video compression and the recent feature compression frameworks, showing the difference between our CMC and these prior frameworks. Then we propose a novel paradigm for CMC to demonstrate its effectiveness. The qualitative and quantitative results show that our proposed CMC can achieve encouraging reconstructed results with an ultrahigh compression ratio, showing better compression performance than the widely used JPEG baseline.
End-to-End RGB-IR Joint Image Compression With Channel-wise Cross-modality Entropy Model
School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);National Engineering Research Center of Visual Technology, School of Computer Science, Peking University(视觉技术国家工程研究中心,北京大学计算机科学学院);School of Communication Engineering, Hangzhou Dianzi University(杭州电子科技大学通信工程学院);Pengcheng Laboratory(鹏城实验室);Advanced Institute of Information Technology, Peking University(北京大学信息科学技术高级研究院)
Joint Lossless Compression and Steganography for Medical Images via Large Language Models
Center for Future Media and School of Computer Science and Engineering, University of Electronic Science and Technology of China(未来媒体中心和电子科技大学计算机科学与工程学院);Department of Computer Science and Engineering, University of Electronic Science and Technology of China(计算机科学与工程学院,电子科技大学);Department of Electrical Engineering, and the Center for Intelligent Multidimensional Data Analysis, City University of Hong Kong(电子工程系和智能多维数据分析中心,城市大学);Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence(机器学习系,Mohamed bin Zayed人工智能大学)
Perceptual Image Compression with Cooperative Cross-Modal Side Information
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Peng Cheng Laboratory(鹏城实验室);Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies(广东省新型安全智能重点实验室);Huawei Technologies Company Ltd(华为技术有限公司);Shenzhen University(深圳大学)
Performance Benchmarking and Optimisation of Clustering Algorithms for Local and Non-Local Similarity Measure in Medical Image Analysis
Department of Mathematics, Rhodes University, PO Box 94, Makhanda, 6140, South Africa(数学系,罗德斯大学);Department of Statistics, Rhodes University, PO Box 94, Makhanda, 6140, South Africa(统计系,罗德斯大学);National Institute for Theoretical and Computational Sciences (NITheCS), Stellenbosch 7600, South Africa(理论与计算科学国家研究所)
A Survey on Medical Image Compression: From Traditional to Learning-Based Approaches
Beijing Jiaotong University(北京交通大学);Tsinghua University(清华大学);Shanghai United Imaging Healthcare Co., Ltd(上海联影医疗科技股份有限公司);City University of Hong Kong(香港城市大学)