Accurate identification of protein active sites at the residue level is crucial for understanding protein function and advancing drug discovery. However, current methods face two critical challenges: vulnerability in single-instance prediction due to sparse training data, and inadequate modality reliability estimation that leads to performance degradation when unreliable modalities dominate fusion processes. To address these challenges, we introduce Multimodal Mixture-of-Experts with Retrieval Augmentation (MERA), the first retrieval-augmented framework for protein active site identification. MERA employs hierarchical multi-expert retrieval that dynamically aggregates contextual information from chain, sequence, and active-site perspectives through residue-level mixture-of-experts gating. To prevent modality degradation, we propose a reliability-aware fusion strategy based on Dempster-Shafer evidence theory that quantifies modality trustworthiness through belief mass functions and learnable discounting coefficients, enabling principled multimodal integration. Extensive experiments on ProTAD-Gen and TS125 datasets demonstrate that MERA achieves state-of-the-art performance, with 90% AUPRC on active site prediction and significant gains on peptide-binding site identification, validating the effectiveness of retrieval-augmented multi-expert modeling and reliability-guided fusion.
Curriculum-guided multimodal representation learning enables generalizable prediction of nanomaterial-protein interactions
School of Engineering, Westlake University(西湖大学工程学院);Institute of Advanced Technology, Westlake Institute for Advanced Study(西湖研究所在先进科技研究院);Centre for BioNano Interactions, School of Chemistry, University College Dublin(都柏林大学学院化学系生物纳米相互作用中心);School of Biomolecular and Biomedical Science, UCD Conway Institute of Biomolecular and Biomedical Research(都柏林大学学院生物分子与生物医学科学系,康沃利斯生物分子与生物医学研究学院)
Enhancing Protein Representation Learning via Manifold Restore Mixing
Software College, Northeastern University(东北大学软件学院);Tianjin University(天津大学);School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);Information Systems Technology and Design, Singapore University of Technology and Design(新加坡科技设计大学信息系统技术与设计)
ProtRLSearch: A Multi-Round Multimodal Protein Search Agent with Large Language Models Trained via Reinforcement Learning
University of Chinese Academy of Sciences(中国科学院大学);Hangzhou Institute for Advanced Study(杭州高等研究院);Shenzhen Institutes of Advanced Technology(深圳先进技术研究所);Institute of Information Engineering(信息工程研究所);Johns Hopkins University(约翰霍普金斯大学);Henan University(河南大学)
EvoLlama: Enhancing LLMs' Understanding of Proteins via Multimodal Structure and Sequence Representations
School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));School of Computer Science, Fudan University(复旦大学计算机学院);Xiaohongshu Inc(小红书科技有限公司);Innovation Center for AI and Drug Discovery, School of Pharmacy, East China Normal University(华东师范大学药学院人工智能与药物发现创新中心)
Multimodal Data Augmentation for Image Captioning using Diffusion Models
School of Economics and Management, Tsinghua University(清华大学经济管理学院);Department of Decision, Operations & Information Technologies, University of Maryland(马里兰大学决策、运营与信息技术系)
Cross-Modal Augmentation for Few-Shot Multimodal Fake News Detection
College of Information Science and Technology, Qingdao University of Science and Technology(青岛科技大学信息科学与技术学院);College of Data Science, Qingdao University of Science and Technology(青岛科技大学数据科学学院);University of Sheffield(谢菲尔德大学)
Aligning Large Language Models and Geometric Deep Models for Protein Representation
Northwestern University(西北大学);University of Pittsburgh(匹兹堡大学);Michigan State University(密歇根州立大学);North Carolina State University(北卡罗来纳州立大学);New Jersey Institute of Technology(新泽西理工学院)
InstructPLM-mu: 1-Hour Fine-Tuning of ESM2 Beats ESM3 in Protein Mutation Predictions
The Chinese University of Hong Kong(香港中文大学);Hangzhou Institute of Medicine, CAS(杭州医学研究所,中国科学院);Hangzhou Institute for Advanced Study, UCAS(杭州先进研究 institute,中国科学院大学);University of Chinese Academy of Sciences(中国科学院大学);Tianjin University(天津大学)
XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags
Ahsanullah University of Science & Technology(阿萨努拉科技大学);University of Alberta(阿尔伯塔大学);Université de Sherbrooke(谢布鲁克大学);Salesforce Research(Salesforce研究院);Nanyang Technological University(南洋理工大学)
Stitch and Tell: A Structured Multimodal Data Augmentation Method for Spatial Understanding
School of Computer Science, Beijing Institute of Technology(北京理工大学计算机科学学院);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);Xiaohongshu Inc(小红书公司)
Stitch and Tell通过结构化空间监督提升视觉-语言模型的空间理解能力,有效缓解空间幻觉并提高相关任务性能。
BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Language
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);OpenDataLab, Shanghai Artificial Intelligence Laboratory(上海人工智能实验室 OpenDataLab);Zhejiang University(浙江大学);Shanghai Innovation Institute(上海创新研究院);East China Normal University(华东师范大学);Zhongguancun Academy(中关村学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院)