Design Environment of Quantization-Aware Edge AI Hardware for Few-Shot Learning
Research Institute of Electrical Communication, Tohoku University(东北大学电气通信研究所);Graduate School of Engineering, Tohoku University(东北大学工学院);IMT Atlantique, Lab-STICC, UMR CNRS 6285(大西洋高等矿业学院,实验室-STICC,法国国家科学研究中心联合研究单位6285)
R. Kanda, N. Onizawa, M. Leonardon, V. Gripon, T. Hanyu
This study aims to ensure consistency in accuracy throughout the entire design flow in the implementation of edge AI hardware for few-shot learning, by implementing fixed-point data processing in the pre-training and evaluation phases. Specifically, the quantization module, called Brevitas, is applied to implement fixed-point data processing, which allows for arbitrary specification of the bit widths for the integer and fractional parts. Two methods of fixed-point data quantization, quantization-aware training (QAT) and post-training quantization (PTQ), are utilized in Brevitas. With Tensil, which is used in the current design flow, the bit widths of the integer and fractional parts need to be 8 bits each or 16 bits each when implemented in hardware, but performance validation has shown that accuracy comparable to floating-point operations can be maintained even with 6 bits or 5 bits each, indicating potential for further reduction in computational resources. These results clearly contribute to the creation of a versatile design and evaluation environment for edge AI hardware for few-shot learning.
HERO: Hardware-Efficient RL-based Optimization Framework for NeRF Quantization
The Hong Kong University of Science and Technology(香港科技大学);Northeastern University(东北大学);The Hong Kong University of Science and Technology (GZ)(香港科技大学(广州))
Bit-Width-Aware Design Environment for Few-Shot Learning on Edge AI Hardware
Research Institute of Electrical Communication, Tohoku University(东北大学电气通信研究所);Graduate School of Engineering, Tohoku University(东北大学工学研究科);IMT Atlantique, Lab-STICC, UMR CNRS 6285(大西洋高等理工学院,Lab-STICC,CNRS联合研究实验室6285)
SigmaQuant: Hardware-Aware Heterogeneous Quantization Method for Edge DNN Inference
Embedded Systems Laboratory (ESL), EPFL, Switzerland(嵌入式系统实验室(ESL),EPFL,瑞士);University of Applied Sciences and Arts Western Switzerland (HES-SO), Switzerland(应用科学与艺术西瑞士大学(HES-SO),瑞士)
Pre-Quantized Deep Learning Models Codified in ONNX to Enable Hardware/Software Co-Design
Marvell Technology Inc.(美满科技公司);Nokia Solutions and Networks Oy(诺基亚解决方案与网络公司);Nokia of America Corporation(诺基亚美国公司);Nokia Solutions and Networks Sp. z o.o.(诺基亚解决方案与网络有限责任公司);Nokia Paris Saclay(诺基亚巴黎萨克雷(此处保留英文原名,因“Paris Saclay”是地名相关,中文常不直译机构名,按原文处理))
AHCQ-SAM: Toward Accurate and Hardware-Compatible Post-Training Segment Anything Model Quantization
Department of Electronics and Electrical Engineering, Keio University(庆应义塾大学电子与电气工程系);School of Computer Science and Technology, Hainan University(海南大学计算机科学与技术学院);Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(厦门大学多媒体可信感知与高效计算教育部重点实验室)
GRAU: A Generic Runtime-Reconfigurable Activation-Requantization Unit for Quantized Neural Network Accelerators
Ruhr University Bochum, Germany(博德姆鲁尔大学);Dresden University of Technology, Germany(德累斯顿技术大学);Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI Dresden/Leipzig), Germany(可扩展数据与人工智能中心(ScaDS.AI 德累斯顿/莱比锡))
Hardware-Compatible Single-Shot Feasible-Space Heuristics for Solving the Quadratic Assignment Problem
QB Information Technologies (1QBit)(1QB信息技术公司);Institute for Neuromorphic Compute Nodes (PGI-14), Peter Grünberg Institute, Forschungszentrum Jülich GmbH(于利希研究中心彼得·格林贝格研究所神经形态计算节点研究所);RWTH Aachen University(亚琛工业大学);HPE Labs, Hewlett Packard Enterprise(惠普企业实验室);University of California, Santa Barbara(加州大学圣塔芭芭拉分校)