Advancements in deep learning are revolutionizing science and engineering. The immense success of deep learning is largely due to its ability to extract essential high-dimensional (HD) features from input data and make inference decisions based on this information. However, current deep neural network (DNN) models face several challenges, such as the requirements of extensive amounts of data and computational resources. Here, we introduce a new learning scheme, referred to as deep-and-wide learning (DWL), to systematically capture features not only within individual input data (intra-data features) but also across the data (inter-data features). Furthermore, we propose a dual-interactive-channel network (D-Net) to realize the DWL, which leverages our Bayesian formulation of low-dimensional (LD) inter-data feature extraction and its synergistic interaction with the conventional HD representation of the dataset, for substantially enhanced computational efficiency and inference. The proposed technique has been applied to data across various disciplines for both classification and regression tasks. Our results demonstrate that DWL surpasses state-of-the-art DNNs in accuracy by a substantial margin with limited training data and improves the computational efficiency by order(s) of magnitude. The proposed DWL strategy dramatically alters the data-driven learning techniques, including emerging large foundation models, and sheds significant insights into the evolving field of AI.
STERLING: Synergistic Representation Learning on Bipartite Graphs
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Northwestern University(西北大学);Korea Advanced Institute of Science & Technology(韩国科学技术院);MIT-IBM Watson AI Lab, IBM Research(麻省理工学院-IBM沃森人工智能实验室,IBM研究院);Arizona State University(亚利桑那州立大学)
InfMasking: Unleashing Synergistic Information by Contrastive Multimodal Interactions
School of Computing and Artificial Intelligence(计算与人工智能学院);Engineering Research Center of Intelligent Finance Ministry of Education(教育部长智能金融工程研究中心);Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Electronic Science and Technology of China(电子科技大学);Shanghai Academy of AI for Science(上海人工智能科学研究院);Artificial Intelligence Innovation and Incubation Institute Fudan University(复旦大学人工智能创新与孵化院);Artificial Intelligence and Digital Finance Key Laboratory of Sichuan Province(四川省人工智能与数字金融重点实验室)
HRIL: Learning Multimodal Synergy via Higher-Order Tensor Modeling
School of Computing and Artificial Intelligence, Southwestern University of Finance and Economics(西南财经大学计算机与人工智能学院);Chengdu Everimaging Science and Technology Co., Ltd(成都依米光电科技有限公司);X-Humanoid(X-人形机器人(X-Humanoid));Hong Kong Institute of AI for Science, City University of Hong Kong(香港城市大学香港人工智能科学研究院);Zhejiang Sci-Tech University(浙江理工大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Electronic Science and Technology of China(电子科技大学);Artificial Intelligence and Digital Finance Key Laboratory of Sichuan Province(四川省人工智能与数字金融重点实验室)
MD-Syn: Synergistic drug combination prediction based on the multidimensional feature fusion method and attention mechanisms
School of Medicine, National Tsing Hua University(国立清华大学医学院);Institute of Bioinformatics and Structural Biology, National Tsing Hua University(国立清华大学生物信息与结构生物学研究所);Department of Life Science, National Tsing Hua University(国立清华大学生命科学系)
Generating Synergistic Formulaic Alpha Collections via Reinforcement Learning
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Huawei EI Innovation Lab(华为EI创新实验室);Institute of Intelligent Computing Technology(智能计算技术研究所)
Deep Active Learning based Experimental Design to Uncover Synergistic Genetic Interactions for Host Targeted Therapeutics
Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室);University of Guelph(圭尔夫大学);Vector Institute(向量研究所);University of California San Francisco(加州大学旧金山分校)
Combining feature-based approaches with graph neural networks and symbolic regression for synergistic performance and interpretability
Laboratory of Applied Materials and Interfaces, Federal University of Rio Grande do Sul(南里奥格兰德联邦大学应用材料与界面实验室);Institute of Condensed Matter and Nanosciences, Université Catholique de Louvain(鲁汶天主教大学凝聚态与纳米科学研究所);Ruhr-Universität Bochum(波鸿鲁尔大学)