首页/论文/1701.04540

arXiv 1701.045402017-01-17cs.CV

Fusing Deep Learned and Hand-Crafted Features of Appearance, Shape, and Dynamics for Automatic Pain Estimation

University of Nottingham（诺丁汉大学）

Joy Egede, Michel Valstar, Brais Martinez

备注：: 8 pages, 5 figures

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

Automatic continuous time, continuous value assessment of a patient's pain from face video is highly sought after by the medical profession. Despite the recent advances in deep learning that attain impressive results in many domains, pain estimation risks not being able to benefit from this due to the difficulty in obtaining data sets of considerable size. In this work we propose a combination of hand-crafted and deep-learned features that makes the most of deep learning techniques in small sample settings. Encoding shape, appearance, and dynamics, our method significantly outperforms the current state of the art, attaining a RMSE error of less than 1 point on a 16-level pain scale, whilst simultaneously scoring a 67.3% Pearson correlation coefficient between our predicted pain level time series and the ground truth.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

将手工知识与学习表示融合何时有效？一种针对堆叠、替代和干扰的成本归一化基准

When does fusing hand-crafted knowledge with learned representations pay? A cost-normalized benchmark of stacking, substitution, and interference

Universitat de Barcelona（巴塞罗那大学）；Technical University of Munich（慕尼黑工业大学）；Universitat Pompeu Fabra（庞培法布拉大学）

该研究以成本归一化基准分析手工知识与学习表示融合的效果，发现三种结果并提出可预测端到端增益的分解式。

2026-08-24cs.CV

Non-contact Pain Recognition from Video Sequences with Remote Physiological Measurements Prediction

Northwest University（西北大学）；University of Oulu（奥卢大学）；Northwestern Polytechnical University（西北工业大学）

Automatic pain recognition is paramount for medical diagnosis and treatment. The existing works fall into three categories: assessing facial appearance changes, exploiting physiological cues, or fusing them in a multi-modal manner. However, (1) appearance changes are easily affected by subjective factors which impedes objective pain recognition. Besides, the appearance-based approaches ignore long-range spatial-temporal dependencies that are important for modeling expressions over time; (2) the physiological cues are obtained by attaching sensors on human body, which is inconvenient and uncomf…

2021-12-25cs.CV

Learning Multi-level Deep Representations for Image Emotion Classification

University of Sydney（悉尼大学）

In this paper, we propose a new deep network that learns multi-level deep representations for image emotion classification (MldrNet). Image emotion can be recognized through image semantics, image aesthetics and low-level visual features from both global and local views. Existing image emotion classification works using hand-crafted features or deep features mainly focus on either low-level visual features or semantic-level image representations without taking all factors into consideration. The proposed MldrNet combines deep representations of different levels, i.e. image semantics, image aes…

2018-09-25cs.CV

通过可解释计算建模对疼痛定位进行探索性分析

An Exploratory Analysis of Pain Localization via Explainable Computational Modeling

针对自动疼痛定位问题，利用AI4Pain 2026挑战数据集，比较经典特征工程与深度序列学习用于独立于受试者的三类疼痛定位，极端随机树表现最佳，发现疼痛检测与定位存在差距，揭示外周自主神经通路解剖扩散性的基本上限。

2026-07-23cs.CV

DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain

Computer Science and Artificial Intelligence Laboratory, MIT（麻省理工学院计算机科学与人工智能实验室）；Department of Electrical Engineering and Computer Science, MIT（麻省理工学院电气工程与计算机科学系）；Media Lab, MIT（麻省理工学院媒体实验室）

Previous research on automatic pain estimation from facial expressions has focused primarily on "one-size-fits-all" metrics (such as PSPI). In this work, we focus on directly estimating each individual's self-reported visual-analog scale (VAS) pain metric, as this is considered the gold standard for pain measurement. The VAS pain score is highly subjective and context-dependent, and its range can vary significantly among different persons. To tackle these issues, we propose a novel two-stage personalized model, named DeepFaceLIFT, for automatic estimation of VAS. This model is based on (1) Neu…

2017-08-09cs.AIcs.CVcs.LG

Deep Motion Features for Visual Tracking

Linköping University（林雪平大学）

Robust visual tracking is a challenging computer vision problem, with many real-world applications. Most existing approaches employ hand-crafted appearance features, such as HOG or Color Names. Recently, deep RGB features extracted from convolutional neural networks have been successfully applied for tracking. Despite their success, these features only capture appearance information. On the other hand, motion cues provide discriminative and complementary information that can improve tracking performance. Contrary to visual tracking, deep motion features have been successfully applied for actio…

2016-12-20cs.CV

更多相关论文收起更多论文

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition

Ecole Centrale de Lyon（里昂中央理工学院）

In this paper, we present a novel approach to automatic 3D Facial Expression Recognition (FER) based on deep representation of facial 3D geometric and 2D photometric attributes. A 3D face is firstly represented by its geometric and photometric attributes, including the geometry map, normal maps, normalized curvature map and texture map. These maps are then fed into a pre-trained deep convolutional neural network to generate the deep representation. Then the facial expression prediction is simplyachieved by training linear SVMs over the deep representation for different maps and fusing these SV…

2015-11-10cs.CV

Deep Convolutional Neural Networks for Imaging Data Based Survival Analysis of Rectal Cancer

Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）

Recent radiomic studies have witnessed promising performance of deep learning techniques in learning radiomic features and fusing multimodal imaging data. Most existing deep learning based radiomic studies build predictive models in a setting of pattern classification, not appropriate for survival analysis studies where some data samples have incomplete observations. To improve existing survival analysis techniques whose performance is hinged on imaging features, we propose a deep learning method to build survival regression models by optimizing imaging features with deep convolutional neural …

2019-01-05cs.CV

Video Salient Object Detection Using Spatiotemporal Deep Features

SOKENDAI (Graduate University for Advanced Studies)（综合研究大学院大学）；National Institute of Informatics（国立信息学研究所）

This paper presents a method for detecting salient objects in videos where temporal information in addition to spatial information is fully taken into account. Following recent reports on the advantage of deep features over conventional hand-crafted features, we propose a new set of SpatioTemporal Deep (STD) features that utilize local and global contexts over frames. We also propose new SpatioTemporal Conditional Random Field (STCRF) to compute saliency from STD features. STCRF is our extension of CRF to the temporal domain and describes the relationships among neighboring regions both in a f…

2018-06-18cs.CV

面向类增量分割的进化知识挖掘

Evolving Knowledge Mining for Class Incremental Segmentation

National University of Singapore（新加坡国立大学）；Kunlun 2050 Research（昆仑2050研究院）；Skywork AI（天工智能）

本文提出进化知识挖掘方法ENDING，通过冻结骨干网络并结合进化融合与语义增强模块，高效重用多粒度特征知识，在类增量语义分割中取得新的最先进性能。

2023-11-28cs.CV

MeshAdv: Adversarial Meshes for Visual Recognition

University of Michigan, Ann Arbor（密歇根大学安娜堡分校）；Princeton University（普林斯顿大学）；UIUC（伊利诺伊大学厄巴纳-香槟分校）

Highly expressive models such as deep neural networks (DNNs) have been widely applied to various applications. However, recent studies show that DNNs are vulnerable to adversarial examples, which are carefully crafted inputs aiming to mislead the predictions. Currently, the majority of these studies have focused on perturbation added to image pixels, while such manipulation is not physically realistic. Some works have tried to overcome this limitation by attaching printable 2D patches or painting patterns onto surfaces, but can be potentially defended because 3D shape features are intact. In t…

2019-06-29cs.CRcs.CVcs.LG

A Compact Deep Learning Model for Face Spoofing Detection

Amirkabir University of Technology（阿米尔卡比尔理工大学）

In recent years, face biometric security systems are rapidly increasing, therefore, the presentation attack detection (PAD) has received significant attention from research communities and has become a major field of research. Researchers have tackled the problem with various methods, from exploiting conventional texture feature extraction such as LBP, BSIF, and LPQ to using deep neural networks with different architectures. Despite the results each of these techniques has achieved for a certain attack scenario or dataset, most of them still failed to generalized the problem for unseen conditi…

2021-01-12cs.CVcs.MM

SuperPoint-SLAM3：通过深度特征、自适应NMS和基于学习的回环闭合增强ORB-SLAM3

SuperPoint-SLAM3: Augmenting ORB-SLAM3 with Deep Features, Adaptive NMS, and Learning-Based Loop Closure

SuperPoint-SLAM3通过深度特征、自适应NMS和学习回环闭合提升ORB-SLAM3的精度和实时性能。

2026-01-29cs.CVcs.RO