DoubleEnsemble:一种基于样本重加权和特征选择的金融数据包络分析方法
DoubleEnsemble: A New Ensemble Method Based on Sample Reweighting and Feature Selection for Financial Data Analysis
摘要:
现代机器学习模型(如深度神经网络和提升决策树模型)由于其提取复杂非线性模式的卓越能力,在金融市场预测中越来越受欢迎。然而,由于金融数据集具有非常低的信噪比并且是非平稳的,因此复杂的模型通常非常容易过拟合并且遭受不稳定问题。此外,随着各种机器学习和数据采掘工具在量化交易中的应用越来越广泛,许多交易公司已经产生了越来越多的特征(又名因素)。因此,如何自动选择有效的特征成为一个迫在眉睫的问题。为了解决这些问题,我们提出了DoubleEntrance,一个集成框架,利用学习轨迹为基础的样本重新加权和洗牌为基础的特征选择。具体来说,我们根据每个样本的训练动态来识别关键样本,并通过洗牌根据每个特征的消融影响来引出关键特征。我们的模型适用于广泛的基础模型,能够提取复杂的模式,同时减轻金融市场预测的过拟合和不稳定问题。我们进行了广泛的实验,包括加密货币和股票交易的价格预测,使用DNN和梯度提升决策树作为基础模型。我们的实验结果表明,DoubleEntrance实现了优越的性能相比,几个基线方法。
英文摘要:
Modern machine learning models (such as deep neural networks and boosting decision tree models) have become increasingly popular in financial market prediction, due to their superior capacity to extract complex non-linear patterns. However, since financial datasets have very low signal-to-noise ratio and are non-stationary, complex models are often very prone to overfitting and suffer from instability issues. Moreover, as various machine learning and data mining tools become more widely used in quantitative trading, many trading firms have been producing an increasing number of features (aka factors). Therefore, how to automatically select effective features becomes an imminent problem. To address these issues, we propose DoubleEnsemble, an ensemble framework leveraging learning trajectory based sample reweighting and shuffling based feature selection. Specifically, we identify the key samples based on the training dynamics on each sample and elicit key features based on the ablation impact of each feature via shuffling. Our model is applicable to a wide range of base models, capable of extracting complex patterns, while mitigating the overfitting and instability issues for financial market prediction. We conduct extensive experiments, including price prediction for cryptocurrencies and stock trading, using both DNN and gradient boosting decision tree as base models. Our experiment results demonstrate that DoubleEnsemble achieves a superior performance compared with several baseline methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。