Table modeling has progressed for decades. In this work, we revisit this trajectory and highlight emerging challenges in the LLM era, particularly the paradox of choice: the difficulty of attributing performance gains amid diverse base models and training sets in the context of table instruction tuning. We replicate four table LLMs by instruction-tuning three foundation models on four existing datasets, yielding 12 models. We then evaluate these models across 16 table benchmarks. Our study is the first to quantitatively disentangle the effects of training data and base model selection, revealing that base model choice plays a more dominant role than the training data itself. Generalization and reasoning remain challenging, inviting future effort on table modeling. Based on our findings, we share our thoughts on the future directions for table modeling.
Does Burrows' Delta really confirm that Rowling and Galbraith are the same author?
School of Linguistics(语言学学院);HSE University(高等经济大学);Institute of Russian Literature (Pushkin House)(俄罗斯文学研究所(普希金之家));Russian Academy of Sciences(俄罗斯科学院)
Matching Table Metadata with Business Glossaries Using Large Language Models
IBM Research(IBM研究院);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学)
CORE-T: COherent REtrieval of Tables for Text-to-SQL
Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science TU Darmstadt and National Research Center for Applied Cybersecurity ATHENE, Germany(普适知识处理实验室(UKP实验室),计算机科学系 TU Darmstadt 和应用网络安全国家研究中心 ATHENE,德国);Arizona State University(亚利桑那州立大学);University of Pennsylvania(宾夕法尼亚大学)