首页/论文/2001.11409

arXiv 2001.114092020-04-15cs.LGstat.ML

Analysing Affective Behavior in the First ABAW 2020 Competition

Imperial College London（帝国理工学院）；Realeyes

Dimitrios Kollias, Attila Schulc, Elnar Hajiyev, Stefanos Zafeiriou

英文摘要：

The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks of valence-arousal estimation, basic expression recognition and action unit detection. It is split into three Challenges, each one addressing a respective behavior task. For the Challenges, we provide a common benchmark database, Aff-Wild2, which is a large scale in-the-wild database and the first one annotated for all these three tasks. In this paper, we describe this Competition, to be held in conjunction with the IEEE Conference on Face and Gesture Recognition, May 2020, in Buenos Aires, Argentina. We present the three Challenges, with the utilized Competition corpora. We outline the evaluation metrics, present both the baseline system and the top-3 performing teams' methodologies per Challenge and finally present their obtained results. More information regarding the Competition, the leaderboard of each Challenge and details for accessing the utilized database, are provided in the Competition site: http://ibug.doc.ic.ac.uk/resources/fg-2020-competition-affective-behavior-analysis.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challenges

Queen Mary University of London（伦敦玛丽女王大学）

This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a continuation of the Competitions held at ICCV 2021, IEEE FG 2020 and IEEE CVPR 2017 Conferences, and aims at automatically analyzing affect. This year the Competition encompasses four Challenges: i) uni-task Valence-Arousal Estimation, ii) uni-task Expression Classification, iii) uni-task Action Unit Detection, and iv) Multi-Task-Learning. All the Challenges are ba…

2022-02-28cs.CVcs.LG

ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challenges

The fifth Affective Behavior Analysis in-the-wild (ABAW) Competition is part of the respective ABAW Workshop which will be held in conjunction with IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2023. The 5th ABAW Competition is a continuation of the Competitions held at ECCV 2022, IEEE CVPR 2022, ICCV 2021, IEEE FG 2020 and CVPR 2017 Conferences, and is dedicated at automatically analyzing affect. For this year's Competition, we feature two corpora: i) an extended version of the Aff-Wild2 database and ii) the Hume-Reaction dataset. The former database is an audiovisual one of…

2023-03-20cs.CVcs.LG

Adversarial-based neural networks for affect estimations in the wild

Pompeu Fabra University（庞培法布拉大学）；University of Augsburg（奥格斯堡大学）；Imperial College London（帝国理工学院）

There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has been recently accelerated due to the emergence of bigger data. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this …

2020-02-09cs.CVcs.LG

自然场景下情绪反应强度的计算机视觉估计

Computer Vision Estimation of Emotion Reaction Intensity in the Wild

University of Hawai’i at Manoa（夏威夷大学马诺阿分校）；Stanford University（斯坦福大学）

本文提出在ABAW竞赛的ERI估计挑战中，利用视觉及多模态深度神经网络预测情绪反应强度，最佳模型在Hume-Reaction测试集上取得0.4080平均皮尔逊相关系数，为迈向非离散情绪的生产级模型奠定基础。

2023-08-03cs.CVcs.LG

SUN团队在ABAW 2024竞赛中的贡献：音视频效价-唤醒度估计与表情识别

SUN Team's Contribution to ABAW 2024 Competition: Audio-visual Valence-Arousal Estimation and Expression Recognition

Ulm University（乌尔姆大学）；ITMO University（ITMO大学）；Utrecht University（乌得勒支大学）

本研究提出基于微调CNN和PDEM的音视频深度学习方法，用于野外情绪识别，并在ABAW'24挑战的AffWild2数据集上验证了其有效性。

2024-03-19cs.LG

Two-Stream Aural-Visual Affect Analysis in the Wild

Leibniz University Hannover（莱布尼茨汉诺威大学）

Human affect recognition is an essential part of natural human-computer interaction. However, current methods are still in their infancy, especially for in-the-wild data. In this work, we introduce our submission to the Affective Behavior Analysis in-the-wild (ABAW) 2020 competition. We propose a two-stream aural-visual analysis model to recognize affective behavior from videos. Audio and image streams are first processed separately and fed into a convolutional neural network. Instead of applying recurrent architectures for temporal analysis we only use temporal convolutions. Furthermore, the …

2020-03-03cs.CVcs.LGstat.ML

更多相关论文收起更多论文

Facial Affect Analysis: Learning from Synthetic Data & Multi-Task Learning Challenges

Huazhong University of Science and Technology（华中科技大学）；Ant Group（蚂蚁集团）

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis In-The-Wild (ABAW) competition: i) Multi-Task-Learning (MTL) Challenge and ii) Learning from Synthetic Data (LSD) Challenge. For MTL challenge, we adopt the SMM-EmotionNet with a better ensemble strategy of feature vectors. For LSD challenge, we propose respective methods to combat the problems of single labels, imbalanced distribution, fine-tuning limitations…

2022-07-20cs.CVcs.LG

Multitask Multi-database Emotion Recognition

Lucine；LaBRI（波尔多计算机科学实验室）

In this work, we introduce our submission to the 2nd Affective Behavior Analysis in-the-wild (ABAW) 2021 competition. We train a unified deep learning model on multi-databases to perform two tasks: seven basic facial expressions prediction and valence-arousal estimation. Since these databases do not contains labels for all the two tasks, we have applied the distillation knowledge technique to train two networks: one teacher and one student model. The student model will be trained using both ground truth labels and soft labels derived from the pretrained teacher model. During the training, we a…

2021-07-12cs.CVcs.LG

Continuous-Time Audiovisual Fusion with Recurrence vs. Attention for In-The-Wild Affect Recognition

University of Augsburg（奥格斯堡大学）；University of Nottingham（诺丁汉大学）

In this paper, we present our submission to 3rd Affective Behavior Analysis in-the-wild (ABAW) challenge. Learningcomplex interactions among multimodal sequences is critical to recognise dimensional affect from in-the-wild audiovisual data. Recurrence and attention are the two widely used sequence modelling mechanisms in the literature. To clearly understand the performance differences between recurrent and attention models in audiovisual affect recognition, we present a comprehensive evaluation of fusion models based on LSTM-RNNs, self-attention and cross-modal attention, trained for valence …

2022-03-29cs.CVcs.LGcs.SD

Expression Recognition Analysis in the Wild

ISTI-CNR（意大利国家研究委员会信息科学与技术研究所）；University of Pisa（比萨大学）

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art methods. We fine-tuned a SeNet deep learning architecture pre-trained on the well-known VGGFace2 dataset, on the AffWild2 facial expression recognition dataset. The main goal of this work is to define a baseline for a novel method we are going to propose in the near future. This paper is also required by the Affective Behavior Analysis in-the-wild (ABAW) competiti…

2021-01-22cs.CVcs.HCcs.LG