Neural-Hidden-CRF:一种鲁棒的弱监督序列标注器
Neural-Hidden-CRF: A Robust Weakly-Supervised Sequence Labeler
AI总结:
提出结合 BERT 与隐藏 CRF 层的 Neural-Hidden-CRF,以全局无向图建模弱监督序列标注,并在四个基准上取得最先进结果。
摘要:
我们提出一种称为 Neural-Hidden-CRF 的神经化无向图模型,用于解决弱监督序列标注问题。在概率无向图理论框架下,所提出的嵌入隐藏 CRF 层的 Neural-Hidden-CRF,以无向图模型尤其具备的全局视角,对词序列、潜在真实标签序列和弱标签序列的变量进行建模。在 Neural-Hidden-CRF 中,我们可以利用强大的语言模型 BERT 或其他深度模型,为潜在真实标签序列提供丰富的上下文语义知识,并使用隐藏 CRF 层捕获标签内部依赖关系。Neural-Hidden-CRF 在概念上简单,在实证上表现强大。它在一个众包基准和三个弱监督基准上取得了新的最先进结果,包括在平均泛化性能和推理性能上分别比近期先进模型 CHMM 高出 2.80 个 F1 点和 2.23 个 F1 点。
英文摘要:
We propose a neuralized undirected graphical model called Neural-Hidden-CRF to solve the weakly-supervised sequence labeling problem. Under the umbrella of probabilistic undirected graph theory, the proposed Neural-Hidden-CRF embedded with a hidden CRF layer models the variables of word sequence, latent ground truth sequence, and weak label sequence with the global perspective that undirected graphical models particularly enjoy. In Neural-Hidden-CRF, we can capitalize on the powerful language model BERT or other deep models to provide rich contextual semantic knowledge to the latent ground truth sequence, and use the hidden CRF layer to capture the internal label dependencies. Neural-Hidden-CRF is conceptually simple and empirically powerful. It obtains new state-of-the-art results on one crowdsourcing benchmark and three weak-supervision benchmarks, including outperforming the recent advanced model CHMM by 2.80 F1 points and 2.23 F1 points in average generalization and inference performance, respectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。