基于数据的glmnet配置调优:在准确性和计算效率之间取得平衡
Data-driven configuration tuning of glmnet for balancing accuracy and computational efficiency
AI总结:
本文提出一种数据驱动框架,通过生成大规模训练数据并构建神经网络,预测glmnet的准确性和计算时间,从而在新数据集上自动选择最优配置以平衡准确性和效率。
摘要:
R中的glmnet包因其计算效率而广泛用于lasso估计。尽管流行,glmnet有时由于算法默认配置不当而产生与真实解相差较大的解。通过适当调整配置可以提高解的准确性,但通常会增加计算时间,导致准确性和计算效率之间的权衡。因此,需要系统的方法来确定合适的配置。为此,我们提出了一种统一的数据驱动框架,专门设计用于通过平衡解路径的准确性和计算成本来优化配置。具体来说,我们通过测量glmnet的准确性和计算时间生成大规模训练数据集。利用该数据集,我们构建神经网络来从数据特征和配置预测准确性和计算时间。对于新数据集,所提框架使用训练好的网络探索配置空间,并推导出代表准确性和计算成本权衡的帕累托前沿。该前沿使用户能够在指定时间内自动选择最大化准确性的配置。所提方法实现于R包glmnetconf中,可在https://github.com/Shuhei-Muroya/glmnetconf.git获取。
英文摘要:
The glmnet package in R is widely used for lasso estimation because of its computational efficiency. Despite its popularity, glmnet occasionally yields solutions that deviate substantially from the true ones because of the inappropriate default configuration of the algorithm. The accuracy of the obtained solutions can be improved by appropriately tuning the configuration. However, such improvements typically increase computational time, resulting in a tradeoff between accuracy and computational efficiency. Therefore, a systematic approach is required to determine the appropriate configuration. To address this need, we propose a unified data-driven framework specifically designed to optimize the configuration by balancing solution path accuracy and computational cost. Specifically, we generate a large-scale training dataset by measuring the accuracy and computation time of glmnet. Using this dataset, we construct neural networks to predict accuracy and computation time from data characteristics and configuration. For a new dataset, the proposed framework uses the trained networks to explore the configuration space and derive a Pareto front that represents the tradeoff between accuracy and computational cost. This front enables automatic selection of the configuration that maximizes accuracy under a user-specified time constraint. The proposed method is implemented in the R package glmnetconf, available at https://github.com/Shuhei-Muroya/glmnetconf.git.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。