Addressing the resource waste caused by fixed computation paradigms in deep learning models under dynamic scenarios, this paper proposes a Transformer$^{-1}$ architecture based on the principle of deep adaptivity. This architecture achieves dynamic matching between input features and computational resources by establishing a joint optimization model for complexity and computation. Our core contributions include: (1) designing a two-layer control mechanism, composed of a complexity predictor and a reinforcement learning policy network, enabling end-to-end optimization of computation paths; (2) deriving a lower bound theory for dynamic computation, proving the system's theoretical reach to optimal efficiency; and (3) proposing a layer folding technique and a CUDA Graph pre-compilation scheme, overcoming the engineering bottlenecks of dynamic architectures. In the ImageNet-1K benchmark test, our method reduces FLOPs by 42.7\% and peak memory usage by 34.1\% compared to the standard Transformer, while maintaining comparable accuracy ($\pm$0.3\%). Furthermore, we conducted practical deployment on the Jetson AGX Xavier platform, verifying the effectiveness and practical value of this method in resource-constrained environments. To further validate the generality of the method, we also conducted experiments on several natural language processing tasks and achieved significant improvements in resource efficiency.
BitRL: Reinforcement Learning with 1-bit Quantized Language Models for Resource-Constrained Edge Deployment
Department of Computer Science BRAC University Dhaka 1212, Bangladesh;Department of Computer Science Missouri State University Springfield, MO, USA;Department of Computer Science \& Engineering Prime University Dhaka, Bangladesh;Department of Computer Science \& Engineering German University Bangladesh Dhaka, Bangladesh;Department of Information Technology Jahangirnagar University Dhaka, Bangladesh
Co-Designing Binarized Transformer and Hardware Accelerator for Efficient End-to-End Edge Deployment
School of Electronic Science and Engineering, Nanjing University(南京大学电子科学与技术学院);Department of Computer Science and Engineering, Chinese University of Hong Kong(香港中文大学计算机科学与工程系);School of Integrated Circuits, Sun Yat-sen University(中山大学集成电路学院)
本文提出 BMT 二值化 Transformer、BAT 加速器及设计空间联合优化方法,在精度、延迟和鲁棒性间取得平衡,并显著提升边缘部署的吞吐量与能效。
Constrained Edge AI Deployment: Fine-Tuning vs Distillation for LLM Compression
Department of Computer Science, University of West Florida(计算机科学系,西佛罗里达大学);Department of Mathematics and Statistics, University of West Florida(数学与统计学系,西佛罗里达大学);Department of Intelligent Systems and Robotics, University of West Florida(智能系统与机器人系,西佛罗里达大学);Institute of Human and Machine Cognition(人机认知研究所);DEVCOM Army Research Laboratory(陆军研究实验室)
TinyFormer: Efficient Transformer Design and Deployment on Tiny Devices
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Qingdao Research Institute, Beihang University(北京航空航天大学青岛研究所);Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学(深圳)计算机科学与工程系);Fert Beijing Research Institute, School of Integrated Circuit Science and Engineering, Beihang University(北京航空航天大学集成电路科学与工程学院)
Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Survey
Renmin University of China(中国人民大学);Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化院);Shanghai Academy of AI for Science(上海人工智能科学研究院);Department of houmo.ai(houmo.ai部门)
CaTs and DAGs: Integrating Directed Acyclic Graphs with Transformers for Causally Constrained Predictions
Kivira Health(Kivira健康公司);The Sense Innovation and Research Center, CHUV, Lausanne, Switzerland(The Sense创新与研究中心,CHUV,洛桑,瑞士);Centre for Vision, Speech and Signal Processing, University of Surrey, U.K.(视觉、语音和信号处理中心,萨里大学,英国);Institute of Psychology, University of Lausanne, Switzerland(心理学研究所,洛桑大学,瑞士);EPFL, Switzerland(瑞士联邦理工学院)
NASP-T: A Fuzzy Neuro-Symbolic Transformer for Logic-Constrained Aviation Safety Report Classification
Faculty of Science and Technology (REALTEK)(科学与技术学院);Norwegian University of Life Sciences (NMBU)(挪威生命科学大学);Dresden International University (DIU)(德累斯顿国际大学)
Easz: An Agile Transformer-based Image Compression Framework for Resource-constrained IoTs
Mohamed bin Zayed University of Artificial Intelligence(Mohamed bin Zayed大学人工智能学院);The Hang Seng University of Hong Kong(恒生大学);City University of Hong Kong(城市大学);The Chinese University of Hong Kong(香港中文大学);National Taiwan University(台湾国立台湾大学)