We present a study on the integration of Large Language Models (LLMs) in tabular data classification, emphasizing an efficient framework. Building upon existing work done in TabLLM (arXiv:2210.10723), we introduce three novel serialization techniques, including the standout LaTeX serialization method. This method significantly boosts the performance of LLMs in processing domain-specific datasets, Our method stands out for its memory efficiency and ability to fully utilize complex data structures. Through extensive experimentation, including various serialization approaches like feature combination and importance, we demonstrate our work's superiority in accuracy and efficiency over traditional models.
Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches
Saarland University(萨尔兰大学);CISPA Helmholtz Center for Information Security(CISPA海德堡中心 for 信息安全);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)
本文评估三种地区贷款审批数据在不同表到文本序列化方式下的 LLM 零样本与 ICL 表现,发现格式显著影响 F1 与公平性。
Summarize-Exemplify-Reflect: Data-driven Insight Distillation Empowers LLMs for Few-shot Tabular Classification
ETH Zürich(苏黎世联邦理工学院);University of Copenhagen(哥本哈根大学);University of Science and Technology of China(中国科学技术大学);University of Amsterdam(阿姆斯特丹大学);East China Normal University(东华大学)
Enabling Few-Shot Alzheimer's Disease Diagnosis on Biomarker Data with Tabular LLMs
University of Pennsylvania(宾夕法尼亚大学);United States Naval Academy(美国海军学院);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Cedars Sinai Medical Center(西好莱坞 Cedars Sinai 医院)
Tabular LLMs for Interpretable Few-Shot Alzheimer's Disease Prediction with Multimodal Biomedical Data
University of Pennsylvania(宾夕法尼亚大学);Stony Brook University(石溪大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Medical University of South Carolina(南卡罗来纳医科大学);Cedars-Sinai Medical Center(西格拉姆山医疗中心)
Unlock the Potential of Large Language Models for Predictive Tabular Tasks in Data Science with Table-Specific Pretraining
Department of Computer Science, The University of Hong Kong(香港大学计算机科学系);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院);Department of Information Systems and Management Engineering, Southern University of Science and Technology(南方科技大学信息 systems 和管理工程系)
TableLoRA: Low-rank Adaptation on Table Structure Understanding for Large Language Models
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(人机混合增强智能国家重点实验室,人工智能与机器人研究院,西安交通大学);Peking University(北京大学);Microsoft(微软公司)
TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoning
National University of Singapore(新加坡国立大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft(微软);Xi’an Jiaotong University(西安交通大学);Ant Research(蚂蚁研究院)
Evaluating LLM Abilities to Understand Tabular Electronic Health Records: A Comprehensive Study of Patient Data Extraction and Retrieval
Université Paul Sabatier(保罗·萨巴蒂埃大学);IRIT(信息论与电信研究所);Centre Hospitalier Universitaire de Toulouse(图卢兹大学医院中心);INSERM(法国国家健康与医学研究院);Université de Toulouse(图卢兹大学);Faculté de Médecine(医学院)
Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Dataset
Microsoft(微软公司);School of Software & Microelectronics, Peking University(北京大学软件与微电子学院);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);Ant Group(蚂蚁集团)
MediTab: Scaling Medical Tabular Data Predictors via Data Consolidation, Enrichment, and Refinement
GE Healthcare(GE医疗);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Carle Illinois College of Medicine, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校卡尔伊利诺伊医学院)
When Raw Data Prevails: Are Large Language Model Embeddings Effective in Numerical Data Representation for Medical Machine Learning Applications?
University of Colorado(科罗拉多大学);University of Wisconsin Madison(威斯康星大学麦迪逊分校);Mass General Brigham, Harvard Medical School(哈佛医学院麻省总医院);Boston Children Hospital, Harvard Medical School(哈佛医学院波士顿儿童医院);Loyola University Chicago(芝加哥洛约拉大学);Dana-Farber Cancer Institute(达纳-法伯癌症研究所)
Multilingual Cognitive Impairment Detection in the Era of Foundation Models
Jožef Stefan Institute(约瑟夫·斯特凡研究所);Jožef Stefan International Postgraduate School(约瑟夫·斯特凡国际研究生院);Institute of Synergetics and Psychotherapy Research, Paracelsus Medical University(协同与心理治疗研究所,帕拉塞尔苏斯医科大学);University of Ljubljana(卢布尔雅那大学);Queen Mary University of London(伦敦玛丽女王大学)
Large Language Models versus Classical Machine Learning: Performance in COVID-19 Mortality Prediction Using High-Dimensional Tabular Data
Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学胃肠病与肝病研究所);Faculty of Medicine, Isfahan University of Medical Sciences(伊斯法罕医科大学医学院);Faculty of Business and Information Technology, Ontario Tech University(安大略理工大学商业与信息技术学院);School of Medicine, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学医学院);Digestive Disease Research Institute, Tehran University of Medical Sciences(德黑兰医科大学消化疾病研究所);Department of Surgery, The Johns Hopkins University(约翰霍普金斯大学外科学系);Student Research Committee, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学护理与助产学院学生研究委员会);MPH department, Shiraz University of Medical Sciences(设拉子医科大学公共卫生硕士系);Department of Emergency Medicine, School of Medicine, Safety Promotion and Injury Prevention Research Center, Imam Hossein Hospital, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学伊玛目侯赛因医院医学院急诊医学系安全促进与伤害预防研究中心);Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center(西达赛奈医疗中心卡什胃肠病与肝病科);Department of Medicine, Stanford University(斯坦福大学医学系);Division of Data Driven and Digital Health (D3M), The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院查尔斯·布朗夫曼个性化医学研究所数据驱动与数字健康部);Infectious Diseases and Tropical Medicine Research Center, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学传染病与热带医学研究中心);Department of Infectious Diseases, Loghman Hakim Hospital, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学洛格曼·哈基姆医院传染病科);National Institute for Health and Care Research (NIHR), Nottingham Biomedical Research Centre, Hearing Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham(诺丁汉大学医学院国家健康与护理研究所诺丁汉生物医学研究中心听力科学、心理健康与临床神经科学)