Yseop在FinSim-3 2021年共享任务:使用短语表示专业化金融领域学习
Yseop at FinSim-3 Shared Task 2021: Specializing Financial Domain Learning with Phrase Representations
摘要:
在本文中,我们提出了我们的方法FinSim-3共享任务2021:学习金融领域的语义相似性。这个共享任务的目的是将来自金融领域的给定术语列表正确分类为外部本体中最相关的上位词(或顶级)概念。对于我们的系统提交,我们评估了两种方法:在自定义语料库上预训练的句子-RoBERTa(SRoBERTa)嵌入模型,以及基于第一种方法的双单词-句子嵌入模型,该模型通过使用FastText模型改进所提出的基线词嵌入构造来提高分类性能。我们的系统在这两个指标上都排名第二,平均准确率为0.917,平均排名为1.141。
英文摘要:
In this paper, we present our approaches for the FinSim-3 Shared Task 2021: Learning Semantic Similarities for the Financial Domain. The aim of this shared task is to correctly classify a list of given terms from the financial domain into the most relevant hypernym (or top-level) concept in an external ontology. For our system submission, we evaluate two methods: a Sentence-RoBERTa (SRoBERTa) embeddings model pre-trained on a custom corpus, and a dual word-sentence embeddings model that builds on the first method by improving the proposed baseline word embeddings construction using the FastText model to boost the classification performance. Our system ranks 2nd overall on both metrics, scoring 0.917 on Average Accuracy and 1.141 on Mean Rank.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。