arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.00567cs.CVcs.AI

PathGAN: Visual Scanpath Prediction with Generative Adversarial Networks

Dublin City University(都柏林城市大学);Universitat Politecnica de Catalunya(加泰罗尼亚理工大学)

Marc Assens, Xavier Giro-i-Nieto, Kevin McGuinness, Noel E. O'Connor

英文摘要:

We introduce PathGAN, a deep neural network for visual scanpath prediction trained on adversarial examples. A visual scanpath is defined as the sequence of fixation points over an image defined by a human observer with its gaze. PathGAN is composed of two parts, the generator and the discriminator. Both parts extract features from images using off-the-shelf networks, and train recurrent layers to generate or discriminate scanpaths accordingly. In scanpath prediction, the stochastic nature of the data makes it very difficult to generate realistic predictions using supervised learning strategies, but we adopt adversarial training as a suitable alternative. Our experiments prove how PathGAN improves the state of the art of visual scanpath prediction on the iSUN and Salient360! datasets. Source code and models are available at https://imatge-upc.github.io/pathgan/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑