The recently developed Equine Facial Action Coding System (EquiFACS) provides a precise and exhaustive, but laborious, manual labelling method of facial action units of the horse. To automate parts of this process, we propose a Deep Learning-based method to detect EquiFACS units automatically from images. We use a cascade framework; we firstly train several object detectors to detect the predefined Region-of-Interest (ROI), and secondly apply binary classifiers for each action unit in related regions. We experiment with both regular CNNs and a more tailored model transferred from human facial action unit recognition. Promising initial results are presented for nine action units in the eye and lower face regions. Code for the project is publicly available.
Read My Ears! Horse Ear Movement Detection for Equine Affective State Assessment
Visual Analysis and Perception Lab, Aalborg University(奥尔堡大学视觉分析与感知实验室);Department of Veterinary Clinical Sciences, University of Copenhagen(哥本哈根大学兽医临床科学系)
Horse Eye Blink Detection and Classification for Equine Affective State Assessment
Visual Analysis and Perception Lab, Aalborg University(视觉分析与感知实验室,奥尔堡大学);Department of Animal Biosciences, Swedish University of Agricultural Sciences(动物生物科学系,瑞典农业科学大学)
PAL-Net: A Point-Wise CNN with Patch-Attention for 3D Facial Landmark Localization
Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy.(电子、信息与生物工程系,米兰理工学院,米兰,意大利);Department of Biomedical Sciences for Health, University of Milan, Milan, Italy.(健康生物医学科学系,米兰大学,米兰,意大利);U.O. Laboratory of Applied Morphology, IRCCS Policlinico San Donato, 20097 San Donato Milanese, Italy.(应用形态学实验室,IRCCS圣丹诺多临床医院,意大利);Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy.(生物医学、外科和牙科学系,米兰大学,米兰,意大利)
PainSeeker: An Automated Method for Assessing Pain in Rats Through Facial Expressions
Affiliated Stomatological Hospital, Nanjing Medical University(南京医科大学附属口腔医院);School of Biological Science and Medical Engineering, Southeast University(东南大学生物科学与医学工程学院)
Deep Learning Models for Automated Classification of Dog Emotional States from Facial Expressions
Open University(开放大学);Weizmann Institute of Science(魏茨曼科学研究所);University of Bern(伯尔尼大学);University of Lincoln(林肯大学);dogs and science - Institute for Canine Science and Applied Cynology(狗与科学——犬类科学与应用犬学研究所);University of Haifa(海法大学)
Automated facial recognition system using deep learning for pain assessment in adults with cerebral palsy
Balearic ASPACE Foundation(巴利阿里ASPACE基金会);University of the Balearic Islands(巴利阿里群岛大学);Research Institute on Health Sciences (IUNICS)(健康科学研究所 (IUNICS));Health Research Institute of the Balearic Islands (IdISBa)(巴利阿里群岛健康研究所 (IdISBa));Federal University of ABC(ABC联邦大学)
Assessing the Influencing Factors on the Accuracy of Underage Facial Age Estimation
University College Dublin(都柏林大学学院)
对发现濒危未成年人的迅速反应是执法部门持续关注的问题。许多以儿童为中心的调查取决于数字证据的发现和分析。需要自动年龄估计技术来帮助这些调查,以加快证据发现过程,并减少调查人员接触创伤材料。自动化技术也显示出减少从越来越多的设备和在线服务中获得的证据积压的希望。长期以来,缺乏足够的训练数据加上自然的人类差异一直阻碍着准确的自动年龄估计-特别是对于未成年人。本文对两种云年龄估计服务(Amazon Web Service的Rekognition服务和Microsoft Azure的Face API)的性能进行了全面评估,针对超过21,800名未成年受试者的数据集。这项工作的目的是评估某些人类生物特征因素,面部表情和图像质量(即模糊,噪声,曝光和分辨率)对自动年龄估计服务结果的影响。一个彻底的评估,使我们能够确定最有影响力的因素,以克服在未来的年龄估计系统。
Beyond FACS: Data-driven Facial Expression Dictionaries, with Application to Predicting Autism
Center for Autism Research, The Children’s Hospital of Philadelphia(儿童医院费城医院自闭症研究中心);Department of Psychiatry, University of Pennsylvania(宾夕法尼亚大学精神病学系);Deliberate AI
Pain in 3D: Generating Controllable Synthetic Faces for Automated Pain Assessment
Vector Institute(向量研究所);KITE Research Institute(KITE研究机构);University Health Network(大学健康网络);Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Department of Medical Imaging, University of Toronto(多伦多大学医学成像系);Institute of Biomedical Engineering, University of Toronto(多伦多大学生物医学工程研究所)
Toward an Automatic System for Computer-Aided Assessment in Facial Palsy
Toronto Rehabilitation Institute – University Health Network(多伦多康复研究所 - 大学健康网络);Massachusetts Eye and Ear Infirmary(麻省眼耳医院);Harvard Medical School(哈佛医学院);University of Toronto(多伦多大学);Sunnybrook Research Institute(桑尼布鲁克研究所);Royal Australasian College of Surgeons(澳大利亚皇家外科医师学院);University of Sydney(悉尼大学);Brasilia University(巴西利亚大学)
重要性:用于面部标志定位的机器学习(ML)方法对于面部功能的定量评估具有巨大的临床潜力,因为它们能够从照片中高通量地自动量化相关面部指标。然而,从研究环境到临床应用的转化需要重大的改进。目的:开发一种ML算法,用于精确定位面瘫患者照片中的面部标志,并将其用作自动计算机辅助诊断系统的一部分。设计,设置,和参与者:面部标志被手动定位在肖像照片的八个表情,从200名面瘫患者和10名对照。使用该疾病特异性数据库训练用于自动面部标志定位的新型ML模型。将模型输出与手动注释和使用仅由健康受试者组成的较大数据库训练的模型的输出进行比较。模型精度通过算法预测值与人工标注值之间的归一化均方根误差(NRMSE)进行评价。结果如下:与健康对照相比,公开可用的算法在应用于患者时提供较差的结果(NRMSE,8.56 +/- 2.16 vs. 7.09 +/- 2.34,p << 0.01)。我们发现,与使用数千张健康面部图像训练的模型相比,使用相对较少数量的患者照片(1440)训练的模型在临床人群中面部标志定位准确性方面有显着提高(NRMSE,6.03 +/- 2.43 vs. 8.56 +/- 2.16,p << 0.01)。结论:用少量临床图像重新训练界标检测模型显著提高了临床人群正面视图照片中的界标检测性能。这些结果代表了第一步走向自动化系统的计算机辅助评估面瘫。
Unsupervised learning of Data-driven Facial Expression Coding System (DFECS) using keypoint tracking
Indian Institute of Technology Delhi(印度理工学院德里分校);Amar Nath and Shashi Khosla School of Information Technology, Indian Institute of Technology Delhi(印度理工学院德里分校阿马尔·纳特和夏希·霍斯拉信息技术学院);National Resource Centre for Value Education in Engineering, Indian Institute of Technology Delhi(印度理工学院德里分校工程价值教育国家资源中心)
A Novel Evolutionary Method for Automated Skull-Face Overlay in Computer-Aided Craniofacial Superimposition
Department of Computer Science and Artificial Intelligence, University of Granada(计算机科学与人工智能系,格拉纳达大学);Andalusian Research Institute in Data Science and Computational Intelligence, University of Granada(数据科学与计算智能安达卢西亚研究机构,格拉纳达大学);Panacea Cooperative Research S. Coop.(Panacea合作研究公司);Department of Software Engineering, University of Granada(软件工程系,格拉纳达大学)
Towards an Automated Multimodal Approach for Video Summarization: Building a Bridge Between Text, Audio and Facial Cue-Based Summarization
Center for Machine Vision and Signal Analysis, Faculty of ITEE, University of Oulu, Finland(机器视觉与信号分析中心,ITEE学院,奥卢大学,芬兰);Center for Machine Vision(机器视觉与信号分析中心);Signal Analysis, Faculty of ITEE, University of Oulu, Finland(信号分析,ITEE学院,奥卢大学,芬兰)
Neonatal Face and Facial Landmark Detection from Video Recordings
Monash University(莫纳什大学);University British Columbia(不列颠哥伦比亚大学);Monash Newborn(莫纳什新生儿中心);Monash Institute of Medical Engineering(莫纳什医学工程研究所);Monash Data Future Institute(莫纳什数据未来研究所)
SynPAIN: A Synthetic Dataset of Pain and Non-Pain Facial Expressions
KITE Research Institute, Toronto Rehabilitation Institute, University Health Network(KITE研究 institute、多伦多康复研究所、大学健康网络);Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Institute of Biomedical Engineering, University of Toronto(多伦多大学生物医学工程研究所);Vector Institute(向量研究所);Department of Occupational Science and Occupational Therapy, University of Toronto(多伦多大学职业科学与职业治疗系);University of Regina(Regina 多伦多大学)
Towards large-scale, automated, accurate detection of CCTV camera objects using computer vision. Applications and implications for privacy, safety, and cybersecurity. (Preprint)