直到层坍塌：通过批归一化层的视角压缩深度神经网络
Till the Layers Collapse: Compressing a Deep Neural Network through the Lenses of Batch Normalization Layers
AI总结：
本文提出TLC方法，通过批归一化层视角减小网络深度来压缩深度神经网络，降低计算需求与延迟，并在Swin-T等模型及图像和NLP任务上得到验证。
摘要：
如今，深度神经网络因其能处理各种复杂任务而被广泛使用。其通用性使其成为现代技术中非常强大的工具。然而，深度神经网络通常存在过参数化问题。使用这些大模型会消耗大量计算资源。在本文中，我们提出了一种名为Till the Layers Collapse（TLC）的方法，该方法通过批归一化层的视角来压缩深度神经网络。通过减小这些网络的深度，我们的方法降低了深度神经网络的计算需求和整体延迟。我们在Swin-T、MobileNet-V2和RoBERTa等流行模型上，跨图像分类和自然语言处理（NLP）任务验证了我们的方法。
英文摘要：
Today, deep neural networks are widely used since they can handle a variety of complex tasks. Their generality makes them very powerful tools in modern technology. However, deep neural networks are often overparameterized. The usage of these large models consumes a lot of computation resources. In this paper, we introduce a method called \textbf{T}ill the \textbf{L}ayers \textbf{C}ollapse (TLC), which compresses deep neural networks through the lenses of batch normalization layers. By reducing the depth of these networks, our method decreases deep neural networks' computational requirements and overall latency. We validate our method on popular models such as Swin-T, MobileNet-V2, and RoBERTa, across both image classification and natural language processing (NLP) tasks.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
