We investigate the application of large language models (LLMs), specifically GPT-4, to scenarios involving the tradeoff between privacy and utility in tabular data. Our approach entails prompting GPT-4 by transforming tabular data points into textual format, followed by the inclusion of precise sanitization instructions in a zero-shot manner. The primary objective is to sanitize the tabular data in such a way that it hinders existing machine learning models from accurately inferring private features while allowing models to accurately infer utility-related attributes. We explore various sanitization instructions. Notably, we discover that this relatively simple approach yields performance comparable to more complex adversarial optimization methods used for managing privacy-utility tradeoffs. Furthermore, while the prompts successfully obscure private features from the detection capabilities of existing machine learning models, we observe that this obscuration alone does not necessarily meet a range of fairness metrics. Nevertheless, our research indicates the potential effectiveness of LLMs in adhering to these fairness metrics, with some of our experimental results aligning with those achieved by well-established adversarial optimization techniques.
Tabular LLMs for Interpretable Few-Shot Alzheimer's Disease Prediction with Multimodal Biomedical Data
University of Pennsylvania(宾夕法尼亚大学);Stony Brook University(石溪大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Medical University of South Carolina(南卡罗来纳医科大学);Cedars-Sinai Medical Center(西格拉姆山医疗中心)
Enabling Few-Shot Alzheimer's Disease Diagnosis on Biomarker Data with Tabular LLMs
University of Pennsylvania(宾夕法尼亚大学);United States Naval Academy(美国海军学院);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Cedars Sinai Medical Center(西好莱坞 Cedars Sinai 医院)
Small Models are LLM Knowledge Triggers on Medical Tabular Prediction
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Thrust of Artificial Intelligence, Information Hub, HKUST (GZ)(香港科技大学(广州)信息枢纽人工智能方向);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Second Affiliated Hospital Zhejiang University School of Medicine(浙江大学医学院附属第二医院);Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence(浙江省医学影像人工智能重点实验室)
Large Language Models versus Classical Machine Learning: Performance in COVID-19 Mortality Prediction Using High-Dimensional Tabular Data
Research Institute for Gastroenterology and Liver Diseases, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学胃肠病与肝病研究所);Faculty of Medicine, Isfahan University of Medical Sciences(伊斯法罕医科大学医学院);Faculty of Business and Information Technology, Ontario Tech University(安大略理工大学商业与信息技术学院);School of Medicine, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学医学院);Digestive Disease Research Institute, Tehran University of Medical Sciences(德黑兰医科大学消化疾病研究所);Department of Surgery, The Johns Hopkins University(约翰霍普金斯大学外科学系);Student Research Committee, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学护理与助产学院学生研究委员会);MPH department, Shiraz University of Medical Sciences(设拉子医科大学公共卫生硕士系);Department of Emergency Medicine, School of Medicine, Safety Promotion and Injury Prevention Research Center, Imam Hossein Hospital, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学伊玛目侯赛因医院医学院急诊医学系安全促进与伤害预防研究中心);Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center(西达赛奈医疗中心卡什胃肠病与肝病科);Department of Medicine, Stanford University(斯坦福大学医学系);Division of Data Driven and Digital Health (D3M), The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院查尔斯·布朗夫曼个性化医学研究所数据驱动与数字健康部);Infectious Diseases and Tropical Medicine Research Center, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学传染病与热带医学研究中心);Department of Infectious Diseases, Loghman Hakim Hospital, Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学洛格曼·哈基姆医院传染病科);National Institute for Health and Care Research (NIHR), Nottingham Biomedical Research Centre, Hearing Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham(诺丁汉大学医学院国家健康与护理研究所诺丁汉生物医学研究中心听力科学、心理健康与临床神经科学)
Differentially Private Fine-tuning of Language Models
Sun Yat-sen University(中山大学);Microsoft Research Asia(微软亚洲研究院);Microsoft(微软);Microsoft Research(微软研究院);University of Waterloo(滑铁卢大学);University of Washington(华盛顿大学)
Zero-shot generation of synthetic neurosurgical data with large language models
Cumming School of Medicine University of Calgary(卡莱尔大学Cumming医学院);The Abigail Wexner Research Institute Nationwide Children’s Hospital Department of Pediatrics The Ohio State University College of Medicine(阿比盖尔·韦克斯纳研究所全国儿童医院儿科部俄亥俄州立大学医学院)