arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.11573cs.LGcs.CLstat.ML
收藏

面向100种语言的多标签情感分析及针对标签不平衡的动态加权方法

Multi-Label Sentiment Analysis on 100 Languages with Dynamic Weighting for Label Imbalance

Bilkent University(比尔肯特大学);National Magnetic Resonance Center UMRAM(国家磁共振中心UMRAM);DataBoss A.S.(DataBoss股份公司)

Selim F. Yilmaz, E. Batuhan Kaynak, Aykut Koç, Hamdi Dibeklioğlu, Suleyman S. Kozat

AI总结:

该研究针对100种语言的多标签情感分析,提出动态加权方法、适配多标签的焦点损失及线性时间复杂度的最优阈值选择方法,在3种语言的9项指标中7项达最优,公开代码以推动相关研究。

摘要:

我们研究跨语言情感分析,该领域因在市场调研、政治学和社会科学等多个领域的应用而受到广泛关注。特别地,我们引入了多标签设置下的情感分析框架,因为其符合Plutchik情绪轮理论。我们提出了一种新颖的动态加权方法,用于在训练过程中平衡各类别的贡献,这与以往基于类别频率分配固定权重的静态加权方法不同。此外,我们将单标签目标识别文献中用于侧重难例的焦点损失(focal loss)适配到我们的多标签设置中。进一步地,我们推导了一种选择最优类别特定阈值的方法,该方法可在线性时间复杂度下最大化宏F1值(macro-f1 score)。通过大量实验,我们表明,与常见基线方法及SemEval竞赛中表现最佳的方法相比,我们的单模型在3种不同语言的9项指标中,有7项达到了当前最优性能。我们公开分享了模型代码,该代码可实现100种语言的情感分析,以推动后续研究。

英文摘要:

We investigate cross-lingual sentiment analysis, which has attracted significant attention due to its applications in various areas including market research, politics and social sciences. In particular, we introduce a sentiment analysis framework in multi-label setting as it obeys Plutchik's wheel of emotions. We introduce a novel dynamic weighting method that balances the contribution from each class during training, unlike previous static weighting methods that assign non-changing weights based on their class frequency. Moreover, we adapt the focal loss that favors harder instances from single-label object recognition literature to our multi-label setting. Furthermore, we derive a method to choose optimal class-specific thresholds that maximize the macro-f1 score in linear time complexity. Through an extensive set of experiments, we show that our method obtains the state-of-the-art performance in 7 of 9 metrics in 3 different languages using a single model compared to the common baselines and the best-performing methods in the SemEval competition. We publicly share our code for our model, which can perform sentiment analysis in 100 languages, to facilitate further research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑