arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2208.05152cs.CLcs.IR
收藏

TagRec ++:用于问题分类的层次标签感知注意力网络

TagRec++: Hierarchical Label Aware Attention Network for Question Categorization

IIIT-Delhi(德里英迪拉甘地信息技术学院)

Venktesh Viswanathan, Mukesh Mohania, Vikram Goyal

摘要:

在线学习系统有多种形式的数据存储库,包括成绩单、书籍和问题。为了便于访问,这种系统根据明确定义的分层性质的分类法(主题-章节-主题)组织内容。将输入分类到分层标签的任务通常被转换为平面多类分类问题。这种方法忽略了输入中的术语与分层标签中的标记之间的语义相关性。当替代方法仅将叶级节点视为标签时,它们也遭受类不平衡。为了解决这个问题,我们制定了一个稠密检索的问题,为每个内容检索适当的层次标签的任务。在本文中,我们处理分类问题。我们将分层标签建模为它们的令牌的组合,并使用有效的交叉注意力机制来融合信息与内容的术语表示。我们还提出了一种自适应的批量硬负采样方法,随着训练的进行,该方法可以对更好的负采样。我们证明了所提出的方法\textit{TagRec++}优于现有的最先进的方法的问题数据集上的召回@k。此外,我们还证明了\textit{TagRec++}的zero-shot功能和适应标签变化的能力。

英文摘要:

Online learning systems have multiple data repositories in the form of transcripts, books and questions. To enable ease of access, such systems organize the content according to a well defined taxonomy of hierarchical nature (subject-chapter-topic). The task of categorizing inputs to the hierarchical labels is usually cast as a flat multi-class classification problem. Such approaches ignore the semantic relatedness between the terms in the input and the tokens in the hierarchical labels. Alternate approaches also suffer from class imbalance when they only consider leaf level nodes as labels. To tackle the issues, we formulate the task as a dense retrieval problem to retrieve the appropriate hierarchical labels for each content. In this paper, we deal with categorizing questions. We model the hierarchical labels as a composition of their tokens and use an efficient cross-attention mechanism to fuse the information with the term representations of the content. We also propose an adaptive in-batch hard negative sampling approach which samples better negatives as the training progresses. We demonstrate that the proposed approach \textit{TagRec++} outperforms existing state-of-the-art approaches on question datasets as measured by Recall@k. In addition, we demonstrate zero-shot capabilities of \textit{TagRec++} and ability to adapt to label changes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑