arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1508.04525cs.CLcs.LG
收藏

基于主动训练平均感知器集成的扩展时空表达式识别

Recognizing Extended Spatiotemporal Expressions by Actively Trained Average Perceptron Ensembles

Carnegie Mellon University(卡内基梅隆大学);IBM Watson(IBM 沃森);Indian Institute of Technology(印度理工学院)

Wei Zhang, Yang Yu, Osho Gupta, Judith Gelernter

摘要:

文本的精确地理编码和时间标准化要求识别位置和时间短语。许多最先进的地理解析器和时态解析器都存在召回率低的问题。语法分析器经常漏掉的类别有:非时空意义上的名词、形容词和状语短语、介词短语和数字短语。我们收集和注释的数据集查询商业网络搜索API与这样的时空表达式错过了国家的最先进的解析器。针对句子标注代价高的问题,采用主动学习的方法对训练数据进行标注,并设计了一种新的策略来更好地选择训练样本以降低标注代价。对于学习算法,我们应用了平均感知器训练的特征化隐马尔可夫模型(FHMM)。使用五个FHMM实例来创建集成,通过投票选择输出短语。我们的集成模型进行了测试,在一系列的顺序标记任务,并表现出竞争力的性能。我们的贡献包括(1)用命名实体和扩展的时空表达式注释的新数据集;(2)集成模型推理算法的比较,显示置信传播优于维特比解码的准确性;(3)一种新的示例重新加权方法,用于主动集成学习,“记住”最新的训练示例;(4)时空解析器,其联合识别扩展的时空表达式以及命名实体。

英文摘要:

Precise geocoding and time normalization for text requires that location and time phrases be identified. Many state-of-the-art geoparsers and temporal parsers suffer from low recall. Categories commonly missed by parsers are: nouns used in a non- spatiotemporal sense, adjectival and adverbial phrases, prepositional phrases, and numerical phrases. We collected and annotated data set by querying commercial web searches API with such spatiotemporal expressions as were missed by state-of-the- art parsers. Due to the high cost of sentence annotation, active learning was used to label training data, and a new strategy was designed to better select training examples to reduce labeling cost. For the learning algorithm, we applied an average perceptron trained Featurized Hidden Markov Model (FHMM). Five FHMM instances were used to create an ensemble, with the output phrase selected by voting. Our ensemble model was tested on a range of sequential labeling tasks, and has shown competitive performance. Our contributions include (1) an new dataset annotated with named entities and expanded spatiotemporal expressions; (2) a comparison of inference algorithms for ensemble models showing the superior accuracy of Belief Propagation over Viterbi Decoding; (3) a new example re-weighting method for active ensemble learning that 'memorizes' the latest examples trained; (4) a spatiotemporal parser that jointly recognizes expanded spatiotemporal expressions as well as named entities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑