Traditional multi-modal financial forecasting often relies on scalar sentiment scores, which fail to capture the nuances of financial news. To address this information loss, this paper explores high-dimensional representation learning by replacing discrete polarity ratings with dense FinBERT embeddings within a Transformer-based forecasting architecture. We benchmarked various embedding strategies on the FNSPID dataset, including raw embeddings, attention-weighted aggregation, and a custom Siamese network. While the attention-based mechanism struggled with the low signal-to-noise ratio typical of financial data, the integration of Siamese-optimized embeddings outperformed both the scalar baseline and raw embedding approaches, demonstrating that preserving high-dimensional narrative context yields improved predictive accuracy for short-term stock price movements.
EmotionRankCLAP: Bridging Natural Language Speaking Styles and Ordinal Speech Emotion via Rank-N-Contrast
Center for Language and Speech Processing (CLSP), Johns Hopkins UniversityUSA(语言与语音处理中心(CLSP),约翰霍普金斯大学);The University of Texas at Dallas, USA(德克萨斯大学达拉斯分校);Amazon, USA(亚马逊);NUSSingapore(南洋理工大学);Language Technologies Institute (LTI), Carnegie Mellon UniversityUSA(语言技术研究所(LTI),卡内基梅隆大学)
Text2Weight: Bridging Natural Language and Neural Network Weight Spaces
Deep Interdisciplinary Intelligence Lab(深度跨学科智能实验室);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The University of Cambridge(剑桥大学);Zhejiang University(浙江大学);Institute of Deep Perception Technology(深度感知技术研究所);Jiangsu Industrial Technology Research Institute(江苏省工业技术研究所)
BondBERT: What we learn when assigning sentiment in the bond market
School of Engineering Mathematics and Technology, University of Bristol, Bristol, UK(工程数学与技术学院,布里斯托尔大学,布里斯托尔,英国);School of Mathematics, Cardiff University, Cardiff, UK(数学学院,卡迪夫大学,卡迪夫,英国)
Bridging the Semantic Gap for Categorical Data Clustering via Large Language Models
School of Computer Science and Technology(计算机科学与技术学院);Guangdong University of Technology(广东技术大学);Department of Computer Science(计算机科学系);Hong Kong Baptist University(香港 Baptist 大学)