arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.05979q-fin.STcs.CLcs.LG
收藏

金融监管申报中使用层次化Reformer模型发现重要信息

Discovering material information using hierarchical Reformer model on financial regulatory filings

Autorité des Marchés Financiers(金融市场管理局);Mila(米拉)

Francois Mercier, Makesh Narsimhan

摘要:

机器学习在金融领域的大多数应用都与投资决策的预测任务有关。相反,我们的目标是通过机器学习技术促进对金融市场的更好理解。利用深度学习模型在自然语言处理方面的巨大进步,我们构建了一个分层的Reformer([15])模型,能够处理来自加拿大金融监管文件的大型文档级数据集SEDAR。使用这个模型,我们表明,它是可能的,以预测贸易量的变化,使用监管备案。我们调整了HiBERT([36])的预训练任务,以使用大型未标记文档数据集获得良好的句子级表示。对模型进行微调以成功预测交易量变化表明,该模型捕捉了金融市场的观点,处理监管备案是有益的。分析我们的模型的注意力模式表明,它能够检测到一些迹象的重大信息,没有明确的培训,这是高度相关的投资者,也为市场监管机构的监管任务。

英文摘要:

Most applications of machine learning for finance are related to forecasting tasks for investment decisions. Instead, we aim to promote a better understanding of financial markets with machine learning techniques. Leveraging the tremendous progress in deep learning models for natural language processing, we construct a hierarchical Reformer ([15]) model capable of processing a large document level dataset, SEDAR, from canadian financial regulatory filings. Using this model, we show that it is possible to predict trade volume changes using regulatory filings. We adapt the pretraining task of HiBERT ([36]) to obtain good sentence level representations using a large unlabelled document dataset. Finetuning the model to successfully predict trade volume changes indicates that the model captures a view from financial markets and processing regulatory filings is beneficial. Analyzing the attention patterns of our model reveals that it is able to detect some indications of material information without explicit training, which is highly relevant for investors and also for the market surveillance mandate of financial regulators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑