Existing methods to recover model accuracy on analog-digital hardware in the presence of quantization and analog noise include noise-injection training. However, it can be slow in practice, incurring high computational costs, even when starting from pretrained models. We introduce the Sensitivity-Aware Finetuning (SAFT) approach that identifies noise sensitive layers in a model, and uses the information to freeze specific layers for noise-injection training. Our results show that SAFT achieves comparable accuracy to noise-injection training and is 2x to 8x faster.
Enabling Physical AI at the Edge: Hardware-Accelerated Recovery of System Dynamics
School of Electrical Engineering Arizona State University Tempe, USA(电气工程学院亚利桑那州立大学Tempe分校);School of Computing Science Arizona State University Tempe, USA(计算科学学院亚利桑那州立大学Tempe分校)
MDQEC-QAS: Meta-Decoding for Quantum Error Correction with Hardware-Aware VQC Search and Confidence-Gated Recovery
Department of Physics, Indian Institute of Technology (BHU)(印度理工学院(BHU)物理系);eBRAIN Lab, Division of Engineering, New York University Abu Dhabi (NYUAD)(纽约大学阿布扎克分校(NYUAD)工程学院eBRAIN实验室);Center for Quantum and Topological Systems (CQTS), NYUAD Research Institute, NYUAD(纽约大学阿布扎克分校(NYUAD)量子与拓扑系统中心(CQTS))
OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization
Institute for Infocomm Research, Agency for Science, Technology and Research(新加坡科技研究局资讯通信研究院);College of Computer Science, Sichuan University(四川大学计算机学院);Nanyang Technological University(南洋理工大学)
Towards Resiliency in Large Language Model Serving with KevlarFlow
Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,地点,国家);School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,地点,国家);Department of Computer Science, Purdue University, West Lafayette, IN, United States(计算机科学系,普渡大学,西拉法叶,印第安纳,美国)