Dropout during inference as a model for neurological degeneration in an image captioning network
University of Toronto(多伦多大学);Vector Institute(向量研究所);Toronto Rehabilitation Institute(多伦多康复研究所)
英文摘要:
We replicate a variation of the image captioning architecture by Vinyals et al. (2015), then introduce dropout during inference mode to simulate the effects of neurodegenerative diseases like Alzheimer's disease (AD) and Wernicke's aphasia (WA). We evaluate the effects of dropout on language production by measuring the KL-divergence of word frequency distributions and other linguistic metrics as dropout is added. We find that the generated sentences most closely approximate the word frequency distribution of the training corpus when using a moderate dropout of 0.4 during inference.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。