Large Language Models (LLMs) demonstrate remarkable generalizability across diverse tasks, yet genomic foundation models (GFMs) still require separate finetuning for each downstream application, creating significant overhead as model sizes grow. Moreover, existing GFMs are constrained by rigid output formats, limiting their applicability to various genomic tasks. In this work, we revisit the transformer-based auto-regressive models and introduce Omni-DNA, a family of cross-modal multi-task models ranging from 20 million to 1 billion parameters. Our approach consists of two stages: (i) pretraining on DNA sequences with next token prediction objective, and (ii) expanding the multi-modal task-specific tokens and finetuning for multiple downstream tasks simultaneously. When evaluated on the Nucleotide Transformer and GB benchmarks, Omni-DNA achieves state-of-the-art performance on 18 out of 26 tasks. Through multi-task finetuning, Omni-DNA addresses 10 acetylation and methylation tasks at once, surpassing models trained on each task individually. Finally, we design two complex genomic tasks, DNA2Function and Needle-in-DNA, which map DNA sequences to textual functional descriptions and images, respectively, indicating Omni-DNA's cross-modal capabilities to broaden the scope of genomic applications. All the models are available through https://huggingface.co/collections/zehui127
dnaGrinder: a lightweight and high-capacity genomic foundation model
Hong Kong Jockey Club STEM Laboratory of Genomics and AI in Healthcare（香港赛马会基因组学与医疗人工智能 STEM 实验室）；Department of Health Technology and Informatics（健康技术与信息学系）；Department of Data Science and Artificial Intelligence（数据科学与人工智能系）；Department of Computing（计算机系）；The Hong Kong Polytechnic University（香港理工大学）
How Private Are DNA Embeddings? Inverting Foundation Model Representations of Genomic Sequences
Methods in Medical Informatics, Department of Computer Science, University of Tuebingen, Germany（图宾根大学医学信息学方法系，计算机科学系）；Institute for Bioinformatics and Medical Informatics (IBMI), University of Tuebingen, Germany（图宾根大学生物信息学与医学信息学研究所）
JEPA-DNA: Grounding Genomic Foundation Models through Joint-Embedding Predictive Architectures
Applied AI Architecture, NVIDIA, Israel（NVIDIA应用人工智能架构，以色列）；Worldwide Field Ops, NVIDIA, Israel（NVIDIA全球现场运营，以色列）；Developer Programs, NVIDIA, Israel（NVIDIA开发者计划，以色列）；Cancer Research Center and Wohl Institute of Translational Medicine, Sheba Medical Center, Tel Hashomer, Israel（癌症研究中心和Wohl转化医学研究所，Sheba医疗中心，Tel Hashomer，以色列）；Windreich Department of AI and Human Health, Icahn School of Medicine at Mount Sinai, New York, USA（AI与人类健康风reich部门，Mount Sinai医学中心，纽约，美国）
Phenotypic divergence of Homo sapiens is driven by the evolution of human-specific genomic regulatory networks via two mechanistically distinct pathways of creation of divergent regulatory DNA sequences
Evaluating DNA function understanding in genomic language models using evolutionarily implausible sequences
Center for Interdisciplinary Studies, School of Science, Westlake University, Hangzhou, China（西湖大学交叉科学中心，理学院，杭州，中国）；Department of Quantitative and Computational Biology, University of Southern California, Los Angeles, CA, United States（定量与计算生物学系，南加州大学，洛杉矶，CA，美国）
Cancer-inspired Genomics Mapper Model for the Generation of Synthetic DNA Sequences with Desired Genomics Signatures
School of Mechanical Engineering, Tel Aviv University（特拉维夫大学机械工程学院）；Department of Cancer Biology, Cancer Institute, University College London（伦敦大学学院癌症研究所癌症生物学系）
Model Decides How to Tokenize: Adaptive DNA Sequence Tokenization with MxDNA
Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；Shanghai Jiao Tong University（上海交通大学）；The Chinese University of Hong Kong（香港中文大学）；The University of Sydney（悉尼大学）
本文提出 MxDNA 框架，通过稀疏卷积专家混合与可变形卷积使模型自主梯度学习 DNA 分词策略，考虑基因组片段特性，以更少数据时间超越现有方法并捕获基因组功能。
Highly conserved sequence-specific double-stranded DNA binding networks contributing to divergent genomic evolution of human and chimpanzee brain development
Institute of Engineering in Medicine University of California, San Diego（加州大学圣地亚哥分校工程医学院）
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA
Department of Computer Science, School of Engineering, Stanford University（计算机科学系，工程学院，斯坦福大学）；Department of Genetics, School of Medicine, Stanford University（遗传学系，医学院，斯坦福大学）；Department of Pathology, School of Medicine, Stanford University（病理学系，医学院，斯坦福大学）
Entropy, Disagreement, and the Limits of Foundation Models in Genomics
Genome Institute of Singapore, A*STAR（新加坡基因组研究院，A*STAR）；KU Leuven（卢森堡大学）；Faculty of Electrical Engineering and Computing, University of Zagreb（扎格雷布大学电子工程与计算学院）
Genome-Factory: A Library for Tuning, Deploying, and Interpreting Genomic Foundation Models
Center for Foundation Models；Generative AI \& Department of Computer Science, Northwestern University, USA；School of Natural Sciences, University of California at Merced, USA；Department of Energy Joint Genome Institute, Lawrence Berkeley National Laboratory, USA；Systems Biology Division, Lawrence Berkeley National Laboratory, USA；Department of Statistics；Data Science, Northwestern University, USA
JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model
Berlin Institute of Health, Charité – Universitätsmedizin Berlin（柏林健康研究所，柏林夏里特大学医学中心）；College of Big Data and Internet, Shenzhen Technology University（大数据与互联网学院，深圳技术大学）；Language Technologies Institute, Carnegie Mellon University（语言技术研究所，卡内基梅隆大学）；Epigenetics Laboratory, Max Planck Institute for Heart and Lung Research（表观遗传学实验室，马克斯·普朗克心脏病和肺部研究所以）；Department of Mathematics and Computer Science, Freie Universität Berlin（数学与计算机科学系，柏林自由大学）；Health Data Science Unit, Heidelberg University Hospital and BioQuant（健康数据科学单元，海德堡大学医院和BioQuant）；Intelligent Medicine Institute, Fudan University（智能医学研究所，复旦大学）
