arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 1808.03747cs.CL

Dropout during inference as a model for neurological degeneration in an image captioning network

University of Toronto(多伦多大学);Vector Institute(向量研究所);Toronto Rehabilitation Institute(多伦多康复研究所)

Bai Li, Ran Zhang, Frank Rudzicz

英文摘要:

We replicate a variation of the image captioning architecture by Vinyals et al. (2015), then introduce dropout during inference mode to simulate the effects of neurodegenerative diseases like Alzheimer's disease (AD) and Wernicke's aphasia (WA). We evaluate the effects of dropout on language production by measuring the KL-divergence of word frequency distributions and other linguistic metrics as dropout is added. We find that the generated sentences most closely approximate the word frequency distribution of the training corpus when using a moderate dropout of 0.4 during inference.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑