In industrial and environmental monitoring, achieving real-time and precise fluid flow measurement remains a critical challenge. This study applies linear quantization in FPGA-based soft sensors for fluid flow estimation, significantly enhancing Neural Network model precision by overcoming the limitations of traditional fixed-point quantization. Our approach achieves up to a 10.10% reduction in Mean Squared Error and a notable 9.39% improvement in inference speed through targeted hardware optimizations. Validated across multiple data sets, our findings demonstrate that the optimized FPGA-based quantized models can provide efficient, accurate real-time inference, offering a viable alternative to cloud-based processing in pervasive autonomous systems.
Auto-ViT-Acc: An FPGA-Aware Automatic Acceleration Framework for Vision Transformer with Mixed-Scheme Quantization
Northeastern University(东北大学);Simon Fraser University(西蒙弗雷泽大学);University of California, Irvine(加州大学欧文分校);ETH Zurich(苏黎世联邦理工学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
视觉Transformer(ViT)正在出现,在计算机视觉任务中具有显著提高的准确性。然而,其复杂的体系结构和巨大的计算/存储需求迫切需要新的硬件加速器的设计方法。这项工作提出了一个FPGA感知的自动ViT加速框架的基础上提出的混合方案量化。据我们所知,这是第一个基于FPGA的ViT加速框架,探索模型量化。与最先进的ViT量化工作(算法方法,只有没有硬件加速)相比,我们的量化实现了0.47%至1.36%的高的Top-1精度在相同的位宽。与32位浮点基线FPGA加速器相比,我们的加速器的帧速率提高了约5.6倍(即,56.8 FPS vs. 10.0 FPS),DeiT-base在ImageNet数据集上的准确率下降了0.71%。
HGQ: High Granularity Quantization for Real-time Neural Networks on FPGAs
California Institute of Technology(加利福尼亚理工学院);Imperial College London(伦敦帝国理工学院);ETH Zurich(苏黎世联邦理工学院);Institute of Physics Belgrade(贝尔格莱德物理研究所);Fermilab(费米实验室)
Shedding the Bits: Pushing the Boundaries of Quantization with Minifloats on FPGAs
School of Computing, National University of Singapore(新加坡国立大学计算机学院);AMD Research and Advanced Development(AMD研究与高级开发部);Tampere University(坦佩雷大学);AMD(AMD公司)
California Institute of Technology, Pasadena, CA, USA(加利福尼亚技术研究所);Fermi National Accelerator Laboratory, Batavia, IL, USA(费米国家加速器实验室);European Organization for Nuclear Research (CERN), Geneva, Switzerland(欧洲核子研究中心)
Compressing Recurrent Neural Networks for FPGA-accelerated Implementation in Fluorescence Lifetime Imaging
Center for Modeling, Simulation, & Imaging in Medicine(医学建模、仿真与成像中心);Rensselaer Polytechnic Institute(伦斯勒理工学院);IBM T.J. Watson Research Center(IBM TJ·沃森研究中心)
Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers
Northeastern University(东北大学);Simon Fraser University(西蒙菲莎大学);ETH Zurich(苏黎世联邦理工学院);University of Connecticut(康涅狄格大学);Beijing University of Technology(北京工业大学)
Towards Tensor Network Models for Low-Latency Jet Tagging on FPGAs
Dipartimento di Fisica e Astronomia "Galileo Galilei", University of Padua(伽利略·伽利莱物理与天文学系,帕多瓦大学);PlanQC GmbH(PlanQC公司);Institute for Complex Quantum Systems, Ulm University(复杂量子系统研究所,乌尔姆大学);European Organization for Nuclear Research (CERN)(欧洲核子研究中心);Padua Quantum Technologies Research Center, University of Padua(帕多瓦量子技术研究中心,帕多瓦大学)
Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics
University of Tokyo(东京大学);Institute of Physics Belgrade(贝尔格莱德物理研究所);European Organization for Nuclear Research (CERN)(欧洲核子研究中心(CERN));California Institute of Technology(加州理工学院);Columbia University(哥伦比亚大学);University of California San Diego(加州大学圣迭戈分校);Massachusetts Institute of Technology(麻省理工学院);Northwestern University(西北大学);Fermi National Accelerator Laboratory(费米国家加速器实验室);HawkEye360;University of Illinois at Chicago(伊利诺伊大学芝加哥分校)
Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4ml
Politecnico di Milano(米兰理工大学);Institute of Physics Belgrade(贝尔格莱德物理研究所);University of Oxford(牛津大学);European Organization for Nuclear Research (CERN)(欧洲核子研究组织);ETH Zürich(苏黎世联邦理工学院);Chalmers University of Technology(查尔姆斯理工大学);Zenseact(Zenseact公司);University of Gothenburg(哥德堡大学);Fermi National Accelerator Laboratory(费米国家加速器实验室);Amazon(亚马逊公司);University of Washington(华盛顿大学);Massachusetts Institute of Technology(麻省理工学院)
E-RNN: Design Optimization for Efficient Recurrent Neural Networks in FPGAs
Syracuse University(雪城大学);Northeastern University(东北大学);Florida International University(佛罗里达国际大学);University of Southern California(南加利福尼亚大学);Carnegie Mellon University(卡内基梅隆大学);SUNY University at Buffalo(纽约州立大学布法罗分校)
TRINE: A Token-Aware, Runtime-Adaptive FPGA Inference Engine for Multimodal AI
University of California, Irvine(加州大学尔湾分校);Purdue University Northwest(北达科他州立大学);Qualcomm(高通);Samsung(三星)
针对多模态AI中不同计算/内存模式导致嵌入式平台实时性不足的问题,提出TRINE,一种无需重配置的单比特流FPGA加速器与编译器,通过统一层映射、运行时模式切换、令牌剪枝和依赖感知层卸载,实现端到端多模态推理,在Alveo U50和ZCU104上相比RTX 4090和Jetson Orin Nano分别降低延迟22.57倍和6.86倍,功耗仅20-21W。