Hybrid Quantum-inspired Resnet and Densenet for Pattern Recognition
Institute for Brain Sciences(脑科学研究院);Kuang Yaming Honors School, Nanjing University(南京大学匡杨荣誉学院);National Laboratory of Solid State Microstructures(固态微结构国家实验室);School of Physics, Collaborative Innovation Center of Advanced Microstructures(物理学院,先进微结构协同创新中心);School of Physics(物理学院);Beijing Key Laboratory of Opto-Electronic Functional Materials(北京光学材料重点实验室);Micro-Nano Devices, Key Laboratory of Quantum State Construction(微纳器件,量子态构造重点实验室);Manipulation(Ministry of Education), Renmin University of China(操控(教育部),中国人民大学)
In this paper, we propose two hybrid quantum-inspired neural networks with adaptive residual and dense connections respectively for pattern recognition. We explain the frameworks of the symmetrical circuit models in the quantum-inspired layers in our hybrid models. We also illustrate the potential superiority of our hybrid models to prevent gradient explosion owing to the sine and cosine functions in the quantum-inspired layers. Groups of numerical experiments on generalization power showcase that our hybrid models are comparable to the pure classical models with different noisy datasets utilized. Furthermore, the comparison between our hybrid models and a state-of-the-art hybrid quantum-classical convolutional network demonstrates 3%-4% higher accuracy of our hybrid densely-connected model than the hybrid quantum-classical network. Additionally, compared with other two hybrid quantum-inspired residual networks, our hybrid models showcase a little higher accuracy on image datasets with asymmetrical noises. Simultaneously, in terms of groups of robustness experiments, the outcomes demonstrate that our two hybrid models outperform pure classical models notably in resistance to adversarial parameter attacks with various asymmetrical noises. They also indicate the slight superiority of our densely-connected hybrid model over the hybrid quantum-classical network to both symmetrical and asymmetrical attacks. Meanwhile, the accuracy of our two hybrid models is a little bit higher than that of the two hybrid quantum-inspired residual networks. In addition, an ablation study indicate that the recognition accuracy of our two hybrid models is 2%-3% higher than that of the traditional quantum-inspired neural network without residual or dense connection. Eventually, we discuss the application scenarios of our hybrid models by analyzing their computational complexity.
Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNets
Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);PCL Research Center of Networks and Communications, Peng Cheng Laboratory(鹏城实验室网络通信PCL研究中心);The University of Melbourne(墨尔本大学)
Deep Residual-Dense Lattice Network for Speech Enhancement
Institute for Integrated and Intelligent Systems, Griffith University, Australia(格里菲斯大学综合智能系统研究所);School of Artificial Intelligence, Xidian University, China(西安电子科技大学人工智能学院)
Learning Faster without Deeper Networks: A*-Inspired Batch Selection for Efficient CNN Training
AI Laboratory, University Metropolitan Tirana(地拉那都市大学人工智能实验室);Laboratory of Images Signals and Intelligent Systems, ESIEE Paris(巴黎高等电子与电工工程师学校图像信号与智能系统实验室)