arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.06207cs.NIcs.MM
收藏

使用3D引擎的在线直播系统的设计与实现

Design and Implementation of Online Live Streaming System Using A 3D Engine

Aizierjiang Aiersilan

AI总结:

本文提出利用Unity 3D等3D引擎将多路视频映射到虚拟画布并经单通道低延迟传输,设计实现了含RTSP、WebSocket、HTTP、MySQL、Redis和Nginx的可扩展直播系统。

摘要:

随着直播视频需求的不断增长,尤其是5G网络的出现,对低延迟、高质量传输的需求日益增加。尽管5G提供了硬件层面的改进,但用于最大限度降低延迟的有效软件解决方案仍然至关重要。当前的多通道直播等方法未能从根本上解决延迟问题,往往只是增加新通道,而没有优化整体性能。本文提出了一种新颖方法,利用3D引擎(例如Unity 3D)通过单通道传输多输入视频数据,并降低延迟。通过借助3D引擎的能力,如世界/屏幕空间相机、3D画布和网络摄像头纹理,所提出的系统将来自多个外部相机的视频流整合为统一的低延迟输出。本文的附属项目展示了一个低延迟多通道直播视频系统的实现。该系统采用RTSP协议,并考察了视频编码技术,同时包含一个基于Unity 3D的客户端应用。系统架构包括用于持久连接的WebSocket服务器、用于通信的HTTP服务器、用于存储的MySQL数据库、用于缓存的Redis,以及用于负载均衡的Nginx。每个模块独立运行,从而在系统设计中确保灵活性和可扩展性。该系统的一项关键创新是使用3D场景将多个视频输入映射到虚拟画布上,并由引擎内相机录制以便传输。这种设计最大限度地减少了冗余数据,实现了高效且由导播引导的直播网络。论文最后讨论了项目过程中遇到的挑战,并为未来改进提供了解决方案。

英文摘要:

With the growing demand for live video streaming, there is an increasing need for low-latency and high-quality transmission, especially with the advent of 5G networks. While 5G offers hardware-level improvements, effective software solutions for minimizing latency remain essential. Current methods, such as multi-channel streaming, fail to address latency issues fundamentally, often only adding new channels without optimizing overall performance. This thesis proposes a novel approach using a 3D engine (e.g., Unity 3D) to stream multi-input video data through a single channel with reduced latency. By leveraging 3D engine capabilities, such as World/Screen Space Cameras, 3D Canvases, and Webcam Textures, the proposed system consolidates video streams from multiple external cameras into a unified, low-latency output. The affiliated project of this thesis demonstrates the implementation of a low-latency multi-channel live video streaming system. It employs the RTSP protocol and examines video encoding techniques, alongside a client-side application based on Unity 3D. The system architecture includes a WebSocket server for persistent connections, an HTTP server for communication, a MySQL database for storage, Redis for caching, and Nginx for load balancing. Each module operates independently, ensuring flexibility and scalability in the system's design. A key innovation of this system is its use of a 3D scene to map multiple video inputs onto a virtual canvas, recorded by an in-engine camera for transmission. This design minimizes redundant data, enabling an efficient and director-guided live streaming network. The thesis concludes by discussing challenges encountered during the project and provides solutions for future improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑