The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based architectures that do not treat molecule and text modalities equally and lack a supervision signal for the molecule modality. To address these issues, we introduce UniMoT, a Unified Molecule-Text LLM adopting a tokenizer-based architecture that expands the vocabulary of LLM with molecule tokens. Specifically, we introduce a Vector Quantization-driven tokenizer that incorporates a Q-Former to bridge the modality gap between molecule and text. This tokenizer transforms molecules into sequences of molecule tokens with causal dependency, encapsulating high-level molecular and textual information. Equipped with this tokenizer, UniMoT can unify molecule and text modalities under a shared token representation and an autoregressive training paradigm, enabling it to interpret molecules as a foreign language and generate them as text. Following a four-stage training scheme, UniMoT emerges as a multi-modal generalist capable of performing both molecule-to-text and text-to-molecule tasks. Extensive experiments demonstrate that UniMoT achieves state-of-the-art performance across a wide range of molecule comprehension and generation tasks.
HIGHT: Hierarchical Graph Tokenization for Molecule-Language Alignment
MBZUAI(穆罕默德·本·扎耶德人工智能大学);Carnegie Mellon University(卡内基梅隆大学);The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学);University of Maryland, College Park(马里兰大学学院市分校);National University of Singapore(新加坡国立大学)
mCLM: A Modular Chemical Language Model that Generates Functional and Makeable Molecules
Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校Siebel计算与数据科学学院);Department of Chemistry, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校化学系);Allchemy Inc.(Allchemy公司);Department of Chemical and Biomolecular Engineering, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校化学与生物分子工程系);Ulsan National Institute of Science and Technology(乌山国立科学技术研究院);Institute of Organic Chemistry, Polish Academy of Sciences(波兰科学院有机化学研究所)
3D-MolT5: Leveraging Discrete Structural Information for Molecule-Text Modeling
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Computer Science, Wuhan University(武汉大学计算机学院);Huazhong University of Science and Technology(华中科技大学);University of Science and Technology of China(中国科学技术大学);Shanghai AI Laboratory(上海人工智能实验室)
BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Language
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);OpenDataLab, Shanghai Artificial Intelligence Laboratory(上海人工智能实验室 OpenDataLab);Zhejiang University(浙江大学);Shanghai Innovation Institute(上海创新研究院);East China Normal University(华东师范大学);Zhongguancun Academy(中关村学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院)
From Words to Molecules: A Survey of Large Language Models in Chemistry
School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);City University of Hong Kong(香港城市大学);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Models
Changping Laboratory(昌平实验室);School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);College of Chemistry and Molecular Engineering, Peking University(北京大学化学与分子工程学院)
Enhancing Chemical Reaction and Retrosynthesis Prediction with Large Language Model and Dual-task Learning
School of Computer Science, Xiangtan University(湘潭大学计算机科学学院);College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);Institute of AI and Targeted International Communication, Hunan Normal University(湖南师范大学人工智能与定向国际传播研究院)
Copy-Augmented Representation for Structure Invariant Template-Free Retrosynthesis
School of Computer Science and Technology, East China Normal University(东华大学计算机科学与技术学院);Shanghai Institute of Artificial Intelligence for Education, East China Normal University(东华大学上海人工智能教育研究所)
MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Cancer Science Institute, National University of Singapore(新加坡国立大学癌症科学研究所)
DeepMoLM: Leveraging Visual and Geometric Structural Information for Molecule-Text Modeling
Department of Health Technology and Informatics, The Hong Kong Polytechnic University(健康科技与信息学系,香港理工大学);Department of Nuclear Medicine and PET, Hong Kong Sanatorium and Hospital(核医学与PET部,香港疗养院及医院);Department of Diagnostic and Interventional Radiology, Queen Elizabeth Hospital Hong Kong SAR, China(诊断与介入放射学部,香港特别行政区中国女王医院)