arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.01795cs.LGcs.CLq-bio.GN
收藏

基于大语言模型的基因型数据知识驱动特征选择与工程

Knowledge-Driven Feature Selection and Engineering for Genotype Data with Large Language Models

RIKEN(理化学研究所);Arizona State University(亚利桑那州立大学);United States Naval Academy(美国海军学院);The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)

Joseph Lee, Shu Yang, Jae Young Baik, Xiaoxi Liu, Zhen Tan, Dawei Li, Zixuan Wen, Bojian Hou, Duy Duong-Tran, Tianlong Chen, Li Shen

AI总结:

针对基于少量可解释变异特征预测复杂遗传基础表型的挑战,提出知识驱动框架FREEFORM,利用LLM的内在知识进行特征选择与工程,在少样本情况下优于数据驱动方法。

摘要:

基于少量可解释的变异特征集预测具有复杂遗传基础的表型仍是一项挑战。传统上采用数据驱动方法,但基因型数据的高维特性使分析和预测困难。受预训练LLM编码的广泛知识及其处理复杂生物医学概念的成功启发,我们通过新颖的知识驱动框架,研究LLM在表格基因型数据特征选择与工程中的能力。我们开发了FREEFORM(增强特征输出与稳健建模的自由流推理与集成),该框架基于思维链和集成原则设计,利用LLM的内在知识进行特征选择与工程。在遗传 ancestry和遗传性听力损失两个不同的基因型-表型数据集上评估,发现该框架优于多种数据驱动方法,尤其在少样本情况下。FREEFORM作为开源框架可在GitHub获取:https://github.com/PennShenLab/FREEFORM。

英文摘要:

Predicting phenotypes with complex genetic bases based on a small, interpretable set of variant features remains a challenging task. Conventionally, data-driven approaches are utilized for this task, yet the high dimensional nature of genotype data makes the analysis and prediction difficult. Motivated by the extensive knowledge encoded in pre-trained LLMs and their success in processing complex biomedical concepts, we set to examine the ability of LLMs in feature selection and engineering for tabular genotype data, with a novel knowledge-driven framework. We develop FREEFORM, Free-flow Reasoning and Ensembling for Enhanced Feature Output and Robust Modeling, designed with chain-of-thought and ensembling principles, to select and engineer features with the intrinsic knowledge of LLMs. Evaluated on two distinct genotype-phenotype datasets, genetic ancestry and hereditary hearing loss, we find this framework outperforms several data-driven methods, particularly on low-shot regimes. FREEFORM is available as open-source framework at GitHub: https://github.com/PennShenLab/FREEFORM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑