arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1107.1805stat.MLcs.AI
收藏

概率条件随机场的损失敏感训练

Loss-sensitive Training of Probabilistic Conditional Random Fields

University of Toronto(多伦多大学);Université de Sherbrooke(舍布鲁克大学)

Maksims N. Volkovs, Hugo Larochelle, Richard S. Zemel

摘要:

我们考虑的问题,训练概率条件随机场(CRF)的情况下,使用一个特定的损失函数的性能进行测量的任务。虽然极大似然是训练CRF的最常见方法,但它忽略了任务损失函数的固有结构。我们描述的替代品,极大似然考虑到这种损失。这些措施包括一个新的适应性的损失上限从结构化的支持向量机文献的CRF上下文,以及一个新的损失启发库尔贝克-莱布勒散度目标,依赖于CRF的概率性质。这些损失敏感的目标相比,极大似然使用排名作为基准任务。这种比较证实了在CRF的概率训练中纳入损失信息的重要性,损失启发的KL优于所有其他目标。

英文摘要:

We consider the problem of training probabilistic conditional random fields (CRFs) in the context of a task where performance is measured using a specific loss function. While maximum likelihood is the most common approach to training CRFs, it ignores the inherent structure of the task's loss function. We describe alternatives to maximum likelihood which take that loss into account. These include a novel adaptation of a loss upper bound from the structured SVMs literature to the CRF context, as well as a new loss-inspired KL divergence objective which relies on the probabilistic nature of CRFs. These loss-sensitive objectives are compared to maximum likelihood using ranking as a benchmark task. This comparison confirms the importance of incorporating loss information in the probabilistic training of CRFs, with the loss-inspired KL outperforming all other objectives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑