Video compression aims to maximize reconstruction quality with minimal bitrates. Beyond standard distortion metrics, perceptual quality and temporal consistency are also critical. However, at ultra-low bitrates, traditional end-to-end compression models tend to produce blurry images of poor perceptual quality. Besides, existing generative compression methods often treat video frames independently and show limitations in time coherence and efficiency. To address these challenges, we propose the Efficient Video Diffusion with Sparse Information Transmission (Diff-SIT), which comprises the Sparse Temporal Encoding Module (STEM) and the One-Step Video Diffusion with Frame Type Embedder (ODFTE). The STEM sparsely encodes the original frame sequence into an information-rich intermediate sequence, achieving significant bitrate savings. Subsequently, the ODFTE processes this intermediate sequence as a whole, which exploits the temporal correlation. During this process, our proposed Frame Type Embedder (FTE) guides the diffusion model to perform adaptive reconstruction according to different frame types to optimize the overall quality. Extensive experiments on multiple datasets demonstrate that Diff-SIT establishes a new state-of-the-art in perceptual quality and temporal consistency, particularly in the challenging ultra-low-bitrate regime. Code is released at https://github.com/MingdeZhou/Diff-SIT.
SparseGF: A Height-Aware Sparse Segmentation Framework with Context Compression for Robust Ground Filtering Across Urban to Natural Scenes
School of Remote Sensing and Geomatics Engineering, Nanjing University of Information Science and Technology(南京信息工程大学遥感与地理信息工程学院);Tiandu-Nuist Deep Space Exploration Laboratory(天都-南京信息工程大学深空探测实验室);School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感与信息工程学院);School of Land Science and Technology, China University of Geosciences(中国地质大学(北京)土地科学与技术学院);School of Geospatial Artificial Intelligence, East China Normal University(华东师范大学地理信息智能学院);Department of Geography and Environmental Management, University of Waterloo(滑铁卢大学地理与环境管理系);Department of Systems Design Engineering, University of Waterloo(滑铁卢大学系统设计工程系)
Extreme Model Compression for Edge Vision-Language Models: Sparse Temporal Token Fusion and Adaptive Neural Compression
University of Information Technology and Sciences(信息科技与科学大学);The University of Burdwan(布尔德万大学);Tarakeswar Degree College(塔拉克瓦尔学位学院);University of Missouri, Columbia(密苏里大学,哥伦比亚)
SparseStreet: Sparse Gaussian Splatting for Real-Time Street Scene Simulation
Peking University(北京大学);Chinese Academy of Sciences(中国科学院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Autonomous Driving Development, NIO(蔚来自动驾驶开发)
Rendering-Oriented 3D Point Cloud Attribute Compression using Sparse Tensor-based Transformer
School of Telecommunication Engineering, Xidian University(西安电子科技大学通信工程学院);City University of Hong Kong(香港城市大学);School of Electronics and Information, Northwestern Polytechnical University(西北工业大学电子信息学院);School of Engineering, Royal Melbourne Institute of Technology(皇家墨尔本理工大学工程学院)