Computer vision has achieved great success in interpreting semantic meanings from images, yet estimating underlying (non-visual) physical properties of an object is often limited to their bulk values rather than reconstructing a dense map. In this work, we present our pressure eye (PEye) approach to estimate contact pressure between a human body and the surface she is lying on with high resolution from vision signals directly. PEye approach could ultimately enable the prediction and early detection of pressure ulcers in bed-bound patients, that currently depends on the use of expensive pressure mats. Our PEye network is configured in a dual encoding shared decoding form to fuse visual cues and some relevant physical parameters in order to reconstruct high resolution pressure maps (PMs). We also present a pixel-wise resampling approach based on Naive Bayes assumption to further enhance the PM regression performance. A percentage of correct sensing (PCS) tailored for sensing estimation accuracy evaluation is also proposed which provides another perspective for performance evaluation under varying error tolerances. We tested our approach via a series of extensive experiments using multimodal sensing technologies to collect data from 102 subjects while lying on a bed. The individual's high resolution contact pressure data could be estimated from their RGB or long wavelength infrared (LWIR) images with 91.8% and 91.2% estimation accuracies in $PCS_{efs0.1}$ criteria, superior to state-of-the-art methods in the related image regression/translation tasks.
MutualEyeContact: A conversation analysis tool with focus on eye contact
TU Kaiserslautern（凯泽斯劳滕工业大学）；Waseda University（早稻田大学）；German Research Center for Artificial Intelligence（德国人工智能研究中心）；University of New South Wales（新南威尔士大学）
Data Augmentation for Human Behavior Analysis in Multi-Person Conversations
Hefei University of Technology（合肥工业大学）；Hefei University of Technology Institute of Artificial Intelligence（合肥工业大学人工智能研究院）；Hefei Comprehensive National Science Center（合肥综合性国家科学中心）
