Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究所);National University of Singapore(新加坡国立大学);Centre for Quantum Technologies, National University of Singapore(新加坡国立大学量子技术中心);NUS Graduate School for Integrative Sciences and Engineering(新加坡国立大学综合科学与工程研究生院)
It has long been suggested that the biological brain operates at some critical point between two different phases, possibly order and chaos. Despite many indirect empirical evidence from the brain and analytical indication on simple neural networks, the foundation of this hypothesis on generic non-linear systems remains unclear. Here we develop a general theory that reveals the exact edge of chaos is the boundary between the chaotic phase and the (pseudo)periodic phase arising from Neimark-Sacker bifurcation. This edge is analytically determined by the asymptotic Jacobian norm values of the non-linear operator and influenced by the dimensionality of the system. The optimality at the edge of chaos is associated with the highest information transfer between input and output at this point similar to that of the logistic map. As empirical validations, our experiments on the various deep learning models in computer vision demonstrate the optimality of the models near the edge of chaos, and we observe that the state-of-art training algorithms push the models towards such edge as they become more accurate. We further establishes the theoretical understanding of deep learning model generalization through asymptotic stability.
On Hardware-Aware Design and Optimization of Edge Intelligence
School of Computer Science and Engineering, Nanyang Technological University, Singapore(南洋理工大学计算机科学与工程学院);HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore(南洋理工大学HP-NTU数字制造企业实验室);Department of Computer Science, Norwegian University of Science and Technology, Norway(挪威技术大学计算机科学系);HP Inc., Palo Alto, California, USA(惠普公司)
Bringing AI To Edge: From Deep Learning's Perspective
HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University(南洋理工大学惠普-南大数字制造企业实验室);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);Innovations and Experiences–Business Personal Systems, HP Inc.(惠普公司创新与体验-个人系统业务部)
Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence
Sun Yat-sen University(中山大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Tsinghua University(清华大学);Midea Group(美的集团);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Peng Cheng Laboratory(鹏城实验室);Terminus Group(特斯联集团);The University of Waterloo(滑铁卢大学)
EI-MTD:Moving Target Defense for Edge Intelligence against Adversarial Attacks
Zhejiang University of Science and Technology(浙江科技大学);Zhejiang University(浙江大学);Guangzhou University(广州大学);Hangzhou Hikvision Digital Technology Co., Ltd.(杭州海康威视数字技术股份有限公司)
Optimal input representation in neural systems at the edge of chaos
Departamento de Electromagnetismo y Física de la Materia(电磁学与物质物理系);Instituto Carlos I de Física Teórica y Computacional(卡洛斯一世理论与计算物理研究所);Universidad de Granada(格拉纳达大学)
Integrated Sensing-Communication-Computation for Edge Artificial Intelligence
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);Shenzhen Research Institute of Big Data(深圳大数据研究院);School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(北京邮电大学信息与通信工程学院);Tsinghua University(清华大学)
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications
The Hong Kong University of Science and Technology(香港科技大学);Peng Cheng Laboratory(鹏城实验室);ShanghaiTech University(上海科技大学);Huawei Technologies Co., Ltd.(华为技术有限公司);Tsinghua University(清华大学)
Design of a dynamic and self adapting system, supported with artificial intelligence, machine learning and real time intelligence for predictive cyber risk analytics in extreme environments, cyber risk in the colonisation of Mars
University of Oxford(牛津大学);Cisco Research Centre(思科研究中心);Cardiff University(卡迪夫大学);University of Warwick(华威大学)