HGQ-LUT: Fast LUT-Aware Training and Efficient Architectures for DNN Inference
California Institute of Technology, Pasadena, CA, USA(加州理工学院);University of Bristol, UK(布里斯托大学);Imperial College London, UK(伦敦帝国理工学院);SLAC National Accelerator Laboratory, Menlo Park, CA, USA(SLAC国家加速器实验室)
Chang Sun, Zhiqiang Que, Bakhtiar Zadeh, Qibin Liu, Kevin H. Alvarez, Wayne Luk, Maria Spiropulu
Lookup-table (LUT) based neural networks can deliver ultra-low latency and excellent hardware efficiency on FPGAs by mapping arithmetic operations directly onto the logic primitives. However, state-of-the-art LUT-aware training (LAT) approaches remain difficult to use in practice: they are often orders of magnitude slower to train than conventional networks, require non-trivial manual tuning for hardware efficiency, and lack an end-to-end workflow. This work presents HGQ-LUT, integrated in https://github.com/calad0i/HGQ2, a new LAT approach that achieves state-of-the-art hardware efficiency while accelerating training by over 100 times on modern GPUs. HGQ-LUT introduces LUT-Dense and LUT-Conv layers that are implemented with regular, accelerator-efficient tensor operations during training, which are then compiled into logic LUTs for hardware. By combining these layers with fine-grained, element-wise heterogeneous quantization (including zero-bit pruning) and a LUT-aware resource surrogate, HGQ-LUT enables the automatic exploration of accuracy-resource trade-offs without manual bit-width tuning. We further integrate HGQ-LUT into open-source toolchains, enabling unified design, compilation, and bit-exact verification of hybrid architectures that mix LUT-based with conventional arithmetic blocks. These features make LAT-based DNNs practical for real-world deployment, such as at the CERN Large Hadron Collider's experiments.
Hardware-Software Co-Design for Float16 On-Device Training on RISC-V Single-Core
CEA-Leti, Mines Saint-Etienne, Equipe Commune SAS(CEA-莱蒂、圣艾蒂安 Mines、共同团队 SAS);Univ. Grenoble Alpes, CEA-Leti(格勒诺布尔阿尔卑斯大学、CEA-莱蒂);Mines Saint-Etienne, CEA-Leti, Centre CMP, Equipe commune SAS(圣艾蒂安 Mines、CEA-莱蒂、CMP 中心、共同团队 SAS)