Mirage: 通过感知错觉实现视频的50000倍加速传输
Mirage: Transmitting a Video as a Perceptual Illusion for 50,000X Speedup
AI总结：
Mirage提出了一种无需传输原始视频数据的通信框架，通过语义表示和生成模型实现高效的视频传输，实现50000倍的压缩加速。
摘要：
现有的通信框架主要旨在准确重建源信号以确保可靠传输。然而，这种以信号级保真度为导向的设计往往导致高通信开销和系统复杂性，特别是在视频通信场景中，主流框架依赖于传输视觉数据本身，导致显著的带宽消耗。为了解决这个问题，我们提出了一种视觉数据免费的通信框架Mirage，用于实现极其高效的视频传输同时保留语义信息。Mirage将视频内容分解为两个互补的组成部分：捕捉运动动态的时间序列信息和描述整体视觉结构的空间外观表示。时间信息通过视频描述来保存，而关键帧被编码为紧凑的语义表示用于空间外观。这些表示被传输到接收端，其中使用生成视频模型合成视频。由于不传输原始视觉数据，Mirage本质上是隐私保护的。Mirage还支持跨部署场景的个性化适应。发送端、网络和接收端可以独立对语义表示、传输和生成施加约束，从而实现效率、隐私、控制和感知质量之间的灵活权衡。视频传输的实验结果表明，Mirage在原始视频传输上实现了高达50000倍的数据级压缩加速，随着视频内容规模的增大，增益预计会进一步扩大。
英文摘要：
The existing communication framework mainly aims at accurate reconstruction of source signals to ensure reliable transmission. However, this signal-level fidelity-oriented design often incurs high communication overhead and system complexity, particularly in video communication scenarios where mainstream frameworks rely on transmitting visual data itself, resulting in significant bandwidth consumption. To address this issue, we propose a visual data-free communication framework, Mirage, for extremely efficient video transmission while preserving semantic information. Mirage decomposes video content into two complementary components: temporal sequence information capturing motion dynamics and spatial appearance representations describing overall visual structure. Temporal information is preserved through video captioning, while key frames are encoded into compact semantic representations for spatial appearance. These representations are transmitted to the receiver, where videos are synthesized using generative video models. Since no raw visual data is transmitted, Mirage is inherently privacy-preserving. Mirage also supports personalized adaptation across deployment scenarios. The sender, network, and receiver can independently impose constraints on semantic representation, transmission, and generation, enabling flexible trade-offs between efficiency, privacy, control, and perceptual quality. Experimental results in video transmission demonstrate that Mirage achieves up to a 50000X data-level compression speedup over raw video transmission, with gains expected to scale with larger video content sizes.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
