首页/论文/2005.04370

arXiv 2005.043702021-04-26cs.CV

ICE-GAN: Identity-aware and Capsule-Enhanced GAN with Graph-based Reasoning for Micro-Expression Recognition and Synthesis

University of Sydney（悉尼大学）；University of New South Wales（新南威尔士大学）

Jianhui Yu, Chaoyi Zhang, Yang Song, Weidong Cai

备注：: 9 pages, 5 figures

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

Micro-expressions are reflections of people's true feelings and motives, which attract an increasing number of researchers into the study of automatic facial micro-expression recognition. The short detection window, the subtle facial muscle movements, and the limited training samples make micro-expression recognition challenging. To this end, we propose a novel Identity-aware and Capsule-Enhanced Generative Adversarial Network with graph-based reasoning (ICE-GAN), introducing micro-expression synthesis as an auxiliary task to assist recognition. The generator produces synthetic faces with controllable micro-expressions and identity-aware features, whose long-ranged dependencies are captured through the graph reasoning module (GRM), and the discriminator detects the image authenticity and expression classes. Our ICE-GAN was evaluated on Micro-Expression Grand Challenge 2019 (MEGC2019) with a significant improvement (12.9%) over the winner and surpassed other state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Capsule GAN Using Capsule Network for Generator Architecture

Graduate School of Fundamental Science and Engineering, Waseda University（早稻田大学基础科学与工程研究院）

This paper presents Capsule GAN, a Generative adversarial network using Capsule Network not only in the discriminator but also in the generator. Recently, Generative adversarial networks (GANs) has been intensively studied. However, generating images by GANs is difficult. Therefore, GANs sometimes generate poor quality images. These GANs use convolutional neural networks (CNNs). However, CNNs have the defect that the relational information between features of the image may be lost. Capsule Network, proposed by Hinton in 2017, overcomes the defect of CNNs. Capsule GAN reported previously uses C…

2020-03-18cs.CVcs.LGeess.IV

CapST：利用胶囊网络与时间注意力实现深度伪造视频的精准模型归因

CapST: Leveraging Capsule Networks and Temporal Attention for Accurate Model Attribution in Deep-fake Videos

Institute of Information Science, Academia Sinica（资讯研究所）；Social Networks and Human-Centred Computing, Taiwan International Graduate Program（人本计算与社交网络，台湾国际研究生计划）；Department of Computer Science, National Chengchi University（计算机科学系，国立成功大学）；Member IEEE, National Chengchi University（IEEE会员，国立成功大学）；Fellow IEEE, Institute of Information Science, Academia Sinica（IEEE会士，资讯研究所）；Dire Dawa University（迪雷达瓦大学）；Research Center for Information Technology Innovation, Academia Sinica（资讯科技创新研究中心，学术院）

针对深度伪造视频的模型归因需求，提出融合截断VGG19、胶囊网络与时空注意力的CapST模型，在两个数据集上实现了优于基线的归因准确率，且计算成本更低。

2025-06-12cs.CV

Generative Adversarial Network Architectures For Image Synthesis Using Capsule Networks

University of Minnesota, Twin Cities（明尼苏达大学双城分校）

In this paper, we propose Generative Adversarial Network (GAN) architectures that use Capsule Networks for image-synthesis. Based on the principal of positional-equivariance of features, Capsule Network's ability to encode spatial relationships between the features of the image helps it become a more powerful critic in comparison to Convolutional Neural Networks (CNNs) used in current architectures for image synthesis. Our proposed GAN architectures learn the data manifold much faster and therefore, synthesize visually accurate images in significantly lesser number of training samples and trai…

2018-11-20cs.CVcs.LGcs.NE

Subspace Capsule Network

Center for Research in Computer Vision（计算机视觉研究中心）；University of Central Florida（中佛罗里达大学）

Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among different parts of an entity. As a remedy to this problem, the idea of capsules was proposed by Hinton. In this paper, we propose the SubSpace Capsule Network (SCN) that exploits the idea of capsule networks to model possible variations in the appearance or implicitly defined properties of an entity through a group of capsule subspaces instead of simply grouping neurons to crea…

2020-02-07cs.CV

CapsGAN: Using Dynamic Routing for Generative Adversarial Networks

University of Toronto（多伦多大学）

In this paper, we propose a novel technique for generating images in the 3D domain from images with high degree of geometrical transformations. By coalescing two popular concurrent methods that have seen rapid ascension to the machine learning zeitgeist in recent years: GANs (Goodfellow et. al.) and Capsule networks (Sabour, Hinton et. al.) - we present: \textbf{CapsGAN}. We show that CapsGAN performs better than or equal to traditional CNN based GANs in generating images with high geometric transformations using rotated MNIST. In the process, we also show the efficacy of using capsules archit…

2018-06-07cs.CVcs.LG

局部病灶生成在有限数据设置下对胶囊内镜图像数据增强有效

Local Lesion Generation is Effective for Capsule Endoscopy Image Data Augmentation in a Limited Data Setting

Wroclaw University of Science and Technology（弗罗茨瓦夫理工大学）；BioCam LLC（BioCam有限责任公司）

针对胶囊内镜小样本病灶分类，本文提出基于泊松图像编辑与微调 Image Inpainting GAN 的局部病灶生成增强方法，在 Kvasir Capsule Dataset 上将宏 F1 提升至 33.07%。

2024-12-04cs.AIcs.CVcs.LG

更多相关论文收起更多论文

Comparing Generative Adversarial Network Techniques for Image Creation and Modification

Institute of Artificial Intelligence（人工智能研究所）；University of Groningen（格罗宁根大学）

Generative adversarial networks (GANs) have demonstrated to be successful at generating realistic real-world images. In this paper we compare various GAN techniques, both supervised and unsupervised. The effects on training stability of different objective functions are compared. We add an encoder to the network, making it possible to encode images to the latent space of the GAN. The generator, discriminator and encoder are parameterized by deep convolutional neural networks. For the discriminator network we experimented with using the novel Capsule Network, a state-of-the-art technique for de…

2018-03-24cs.CVcs.LGstat.ML

这条肠道并不存在：用于生成逼真无线胶囊内窥镜图像的多尺度残差变分自编码器

This Intestine Does Not Exist: Multiscale Residual Variational Autoencoder for Realistic Wireless Capsule Endoscopy Image Generation

University of Thessaly（塞萨利大学）；Svendborg Hospital（斯文堡医院）；University of Southern Denmark（南丹麦大学）

针对无线胶囊内窥镜带标注数据稀缺导致GAN训练不稳的问题，提出多尺度残差变分自编码器TIDE，可生成逼真且多样的图像并完全替代真实数据用于分类。

2023-02-07cs.CVcs.LGeess.IV

利用空间和语义特征提取结合胶囊网络与图神经网络进行皮肤癌诊断

Leveraging Spatial and Semantic Feature Extraction for Skin Cancer Diagnosis with Capsule Networks and Graph Neural Networks

Sepuluh Nopember Institute of Technology（泗水十一月理工学院）

针对皮肤病变图像分类中空间语义特征复杂及数据不平衡问题，提出将图神经网络与胶囊网络结合的混合模型，在MNIST:HAM10000数据集上准确率达95.52%，显著超越多种主流基准模型。

2024-03-19cs.AIcs.CV

基于扩散模型的医学图像超分辨率增强：一种用于低分辨率胃部图像的优化方案

Super-Resolution Enhancement of Medical Images Based on Diffusion Model: An Optimization Scheme for Low-Resolution Gastric Images

Boston University（波士顿大学）

本文提出基于扩散模型的超分辨率增强方法，用于提升低分辨率胃部图像的质量，通过SR3框架实现更稳定的训练和更高的结构保真度。

2025-12-22cs.AIcs.CVeess.IV

Multi-Agent Diverse Generative Adversarial Networks

University of Oxford（牛津大学）；IIT Kanpur（印度理工学院坎普尔分校）

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating multiple generators and one discriminator. Second, to enforce that different generators capture diverse high probability modes, the discriminator of MAD-GAN is designed such that along with finding the real and fake samples, it is also required to identify the generator that generated the given fake sample. Intuitively, to succeed in this task, the discriminat…

2018-07-16cs.AIcs.CVcs.GR