利用标签语义在噪声标签下提取更高的性能,用于公司到行业的匹配
Harnessing label semantics to extract higher performance under noisy label for Company to Industry matching
摘要:
为公司提供适当的行业标签是金融机构的一项关键任务,因为它会影响各种金融机构。然而,这仍然是一项复杂的任务。通常,此类行业标签由主题专家(SME)在根据行业定义评估公司业务线后分配。随着公司不断增加新业务和形成新的行业定义,它变得更具挑战性。考虑到任务的周期性,可以合理地假设可以开发人工智能(AI)代理来以有效的方式执行任务。虽然这是一个令人兴奋的前景,但挑战来自对这种标签分配(或标签)的历史模式的需求。标记通常被认为是机器学习(ML)中最昂贵的任务,因为它依赖于SME和人工工作。因此,在企业设置中,ML项目通常会遇到嘈杂和依赖的标签。这样的标签为ML模型产生强大的标签分配带来了技术障碍。我们提出了一个ML管道,它使用语义相似性匹配作为多标签文本分类的替代方案,同时使用标签相似性矩阵和最小标签策略。我们证明了这种管道实现了显着的改善噪声,并表现出强大的预测能力。
英文摘要:
Assigning appropriate industry tag(s) to a company is a critical task in a financial institution as it impacts various financial machineries. Yet, it remains a complex task. Typically, such industry tags are to be assigned by Subject Matter Experts (SME) after evaluating company business lines against the industry definitions. It becomes even more challenging as companies continue to add new businesses and newer industry definitions are formed. Given the periodicity of the task it is reasonable to assume that an Artificial Intelligent (AI) agent could be developed to carry it out in an efficient manner. While this is an exciting prospect, the challenges appear from the need of historical patterns of such tag assignments (or Labeling). Labeling is often considered the most expensive task in Machine Learning (ML) due its dependency on SMEs and manual efforts. Therefore, often, in enterprise set up, an ML project encounters noisy and dependent labels. Such labels create technical hindrances for ML Models to produce robust tag assignments. We propose an ML pipeline which uses semantic similarity matching as an alternative to multi label text classification, while making use of a Label Similarity Matrix and a minimum labeling strategy. We demonstrate this pipeline achieves significant improvements over the noise and exhibit robust predictive capabilities.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。