arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.09451cs.LGcs.CLstat.ML
收藏

Improving Neural Story Generation by Targeted Common Sense Grounding

UC San Diego(加州大学圣地亚哥分校)

Huanru Henry Mao, Bodhisattwa Prasad Majumder, Julian McAuley, Garrison W. Cottrell

英文摘要:

Stories generated with neural language models have shown promise in grammatical and stylistic consistency. However, the generated stories are still lacking in common sense reasoning, e.g., they often contain sentences deprived of world knowledge. We propose a simple multi-task learning scheme to achieve quantitatively better common sense reasoning in language models by leveraging auxiliary training signals from datasets designed to provide common sense grounding. When combined with our two-stage fine-tuning pipeline, our method achieves improved common sense reasoning and state-of-the-art perplexity on the Writing Prompts (Fan et al., 2018) story generation dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑