arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.03210cs.IRcs.CLcs.LG

Sentence Compression as Deletion with Contextual Embeddings

CINNAMON LAB(肉桂实验室);Hung Yen University of Technology and Education(兴安技术教育大学);The University of Queensland(昆士兰大学)

Minh-Tien Nguyen, Bui Cong Minh, Dung Tien Le, Le Thai Linh

英文摘要:

Sentence compression is the task of creating a shorter version of an input sentence while keeping important information. In this paper, we extend the task of compression by deletion with the use of contextual embeddings. Different from prior work usually using non-contextual embeddings (Glove or Word2Vec), we exploit contextual embeddings that enable our model capturing the context of inputs. More precisely, we utilize contextual embeddings stacked by bidirectional Long-short Term Memory and Conditional Random Fields for dealing with sequence labeling. Experimental results on a benchmark Google dataset show that by utilizing contextual embeddings, our model achieves a new state-of-the-art F-score compared to strong methods reported on the leader board.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑