Qiong Zhang is Assistant Professor, Institute of Statistics \& Big Data, Renmin University of China, China e1 .;Yan Shuo Tan is Assistant Professor, Department of Statistics \& Data Science, National University of Singapore, Singapore e2 .;Qinglong Tian is Assistant Professor, Department of Statistics \& Actuarial Science, University or Waterloo, Canada e3 .;Pengfei Li is Professor, Department of Statistics \& Actuarial Science, University or Waterloo, Canada e4 .
Qiong Zhang, Yan Shuo Tan, Qinglong Tian, Pengfei Li
Hollmann et al. (Nature 637 (2025) 319-326) recently introduced TabPFN, a transformer-based deep learning model for regression and classification on tabular data, which they claim "outperforms all previous methods on datasets with up to 10,000 samples by a wide margin, using substantially less training time." Furthermore, they have called TabPFN a "foundation model" for tabular data, as it can support "data generation, density estimation, learning reusable embeddings and fine-tuning". In this paper, we provide a tailored explanation of how TabPFN works for a statistics audience, by emphasizing its interpretation as approximate Bayesian inference. We then explore the significance of TabPFN to the field of statistics: We show that an out-of-the-box application of TabPFN can sometimes outperform specialized state-of-the-art methods for semi-supervised parameter estimation, prediction under covariate shift, and heterogeneous treatment effect estimation. As a partial explanation for the predictive effectiveness of TabPFN, we show that it can simultaneously adapt to both nonparametric structure and parametric structure, for instance, sometimes outperforming LASSO even when assumptions are correctly specified. All experiments can be reproduced using the code provided at https://github.com/qinglong-tian/tabpfn_study (https://github.com/qinglong-tian/tabpfn_study).
From field-scale to large-scale spectral libraries: Tabular foundation models in soil spectroscopy
Osnabrück University(奥斯纳布吕克大学);Leibniz Institute for Agricultural Engineering and Bioeconomy (ATB)(莱布尼茨农业工程与生物经济研究所);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
Technical University of Darmstadt(达姆施塔特工业大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);Hessian Center for Artificial Intelligence (hessian.AI)(黑森人工智能中心);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
Effortless, Simulation-Efficient Bayesian Inference using Tabular Foundation Models
Machine Learning in Science, University of Tübingen(图宾根大学机器学习与科学系);Tübingen AI Center(图宾根人工智能中心);Department Empirical Inference, Max Planck Institute for Intelligent Systems(智能系统研究所经验推断部门)
Explaining Tabular Foundation Model Differences Through Meta-Features
Clausthal University of Technology, Clausthal-Zellerfeld, Germany(Clausthal技术大学,Clausthal-Zellerfeld,德国);University of Mannheim, Mannheim, Germany(曼海姆大学,曼海姆,德国)
Text Classification using the Concept of Association Rule of Data Mining
Stamford University Bangladesh(孟加拉国斯坦福德大学);International Islamic University Chittagong(吉大港国际伊斯兰大学);Bangladesh University of Engineering & Technology(孟加拉工程技术大学)
One Operator to Rule Them All? On Boundary-Indexed Operator Families in Neural PDE Solvers
College of Computing, Georgia Institute of Technology(佐治亚理工学院计算机学院);Department of Mathematics and Systems Engineering, Florida Institute of Technology(佛罗里达理工学院数学与系统工程系)