arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.30652cs.LG
收藏

弥合自然语言与市场动态之间的差距:基于高维表示学习

Bridging the Gap Between Natural Language and Market Dynamics via High-Dimensional Representation Learning

Yujin Jeong, Noelle Jung, Brian Y. C. Leung

AI总结:

本文通过用密集FinBERT嵌入替代离散情感评分,在Transformer架构中探索高维表示学习,以提升金融新闻对短期股价预测的准确性。

摘要:

传统的多模态金融预测通常依赖于标量情感分数,这无法捕捉金融新闻的细微差别。为了解决这一信息损失问题,本文通过在基于Transformer的预测架构中用密集的FinBERT嵌入替代离散极性评分,探索高维表示学习。我们在FNSPID数据集上对各种嵌入策略进行了基准测试,包括原始嵌入、注意力加权聚合和自定义孪生网络。虽然基于注意力的机制在处理金融数据典型的低信噪比时表现不佳,但集成孪生优化嵌入的方法在预测短期股价走势方面优于标量基线和原始嵌入方法,表明保留高维叙事背景能提高预测准确性。

英文摘要:

Traditional multi-modal financial forecasting often relies on scalar sentiment scores, which fail to capture the nuances of financial news. To address this information loss, this paper explores high-dimensional representation learning by replacing discrete polarity ratings with dense FinBERT embeddings within a Transformer-based forecasting architecture. We benchmarked various embedding strategies on the FNSPID dataset, including raw embeddings, attention-weighted aggregation, and a custom Siamese network. While the attention-based mechanism struggled with the low signal-to-noise ratio typical of financial data, the integration of Siamese-optimized embeddings outperformed both the scalar baseline and raw embedding approaches, demonstrating that preserving high-dimensional narrative context yields improved predictive accuracy for short-term stock price movements.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑