Neural network acoustic models have significantly advanced state of the art speech recognition over the past few years. However, they are usually computationally expensive due to the large number of matrix-vector multiplications and nonlinearity operations. Neural network models also require significant amounts of memory for inference because of the large model size. For these two reasons, it is challenging to deploy neural network based speech recognizers on resource-constrained platforms such as embedded devices. This paper investigates the use of binary weights and activations for computation and memory efficient neural network acoustic models. Compared to real-valued weight matrices, binary weights require much fewer bits for storage, thereby cutting down the memory footprint. Furthermore, with binary weights or activations, the matrix-vector multiplications are turned into addition and subtraction operations, which are computationally much faster and more energy efficient for hardware platforms. In this paper, we study the applications of binary weights and activations for neural network acoustic modeling, reporting encouraging results on the WSJ and AMI corpora.
SYNAPSE: Empowering LLM Agents with Episodic-Semantic Memory via Spreading Activation
School of Computing, University of Georgia(佐治亚大学计算机学院);Department of Biosystems Engineering and Soil Science, University of Tennessee(田纳西大学生物系统工程与土壤科学系);Department of Biomedical Informatics, University of Colorado School of Medicine(科罗拉多医学院生物医学信息学系);Department of Biomedical Engineering, New Jersey Institute of Technology(新泽西理工学院生物医学工程系);Department of Physics and Astronomy, The University of Georgia(佐治亚大学物理与天文学系)
MiA-Signature: Approximating Global Activation for Long-Context Understanding
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Pattern Recognition Center, WeChat AI, Tencent(微信AI模式识别中心);Hunyuan Team, Tencent(腾讯文心一言团队)
Out of the Memory Barrier: A Highly Memory Efficient Training System for LLMs with Million-Token Contexts
Key Laboratory of Multimedia Trusted Perception and Efficient Computing Ministry of Education of China(教育部多媒体可信感知与高效计算重点实验室);Xiamen University(厦门大学);Peking University(北京大学);University of Illinois Urbana-Champaign(伊利诺伊大学香槟分校);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室)
TokenSeek: Memory Efficient Fine Tuning via Instance-Aware Token Ditching
Rochester Institute of Technology(罗切斯特理工学院);Meta AI;Kent State University(肯特州立大学);Rutgers University(罗格斯大学);UC Davis(加州大学戴维斯分校);Accenture(安永);University of Missouri-Kansas City(密苏里大学堪萨斯城分校)