Predicting phenotypes with complex genetic bases based on a small, interpretable set of variant features remains a challenging task. Conventionally, data-driven approaches are utilized for this task, yet the high dimensional nature of genotype data makes the analysis and prediction difficult. Motivated by the extensive knowledge encoded in pre-trained LLMs and their success in processing complex biomedical concepts, we set to examine the ability of LLMs in feature selection and engineering for tabular genotype data, with a novel knowledge-driven framework. We develop FREEFORM, Free-flow Reasoning and Ensembling for Enhanced Feature Output and Robust Modeling, designed with chain-of-thought and ensembling principles, to select and engineer features with the intrinsic knowledge of LLMs. Evaluated on two distinct genotype-phenotype datasets, genetic ancestry and hereditary hearing loss, we find this framework outperforms several data-driven methods, particularly on low-shot regimes. FREEFORM is available as open-source framework at GitHub: https://github.com/PennShenLab/FREEFORM.
SNPgen: Phenotype-Supervised Genotype Representation and Synthetic Data Generation via Latent Diffusion
DEIB, Politecnico di Milano(米兰理工学院DEIB部门);Politecnico di Milano(米兰理工学院);Health Data Science Centre, Human Technopole(人类技术pole健康数据科学中心);Genomics Research Centre, Human Technopole(人类技术pole基因组研究中心);MOX - Department of Mathematics, Politecnico di Milano(米兰理工学院数学系);Department of Public Health and Primary Care, University of Cambridge(剑桥大学公共卫生与初级护理系)
Importance of feature engineering and database selection in a machine learning model: A case study on carbon crystal structures
Graz University of Technology(格拉茨工业大学);Know-Center GmbH, Research Center for Data-Driven Business & Big Data Analytics(知识中心有限公司(数据驱动业务与大数据分析研究中心));Università di Roma La Sapienza(罗马第一大学)