Close menu

SURE

Sunderland Repository records the research produced by the University of Sunderland including practice-based research and theses.

Human Centric Facial Expression Recognition

Clawson, Kathy, Delicato, Louise and Bowerman, Chris (2018) Human Centric Facial Expression Recognition. In: HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction Conference 2018. Proceedings of the BCS Human Computer Interaction Conference (32). ACM, pp. 1-12.

Item Type: Book Section

Abstract

Facial expression recognition (FER) is an area of active research, both in computer science and in behavioural science. Across these domains there is evidence to suggest that humans and machines find it easier to recognise certain emotions, for example happiness, in comparison to others. Recent behavioural studies have explored human perceptions of emotion further, by evaluating the relative contribution of features in the face when evaluating human sensitivity to emotion. It has been identified that certain facial regions have more salient features for certain expressions of emotion, especially when emotions are subtle in nature. For example, it is easier to detect fearful expressions when the eyes are expressive. Using this observation as a starting point for analysis, we similarly examine the effectiveness with which knowledge of facial feature saliency may be integrated into current approaches to automated FER. Specifically, we compare and evaluate the accuracy of ‘full-face’ versus upper and lower facial area convolutional neural network (CNN) modelling for emotion recognition in static images, and propose a human centric CNN hierarchy which uses regional image inputs to leverage current understanding of how humans recognise emotions across the face. Evaluations using the CK+ dataset demonstrate that our hierarchy can enhance classification accuracy in comparison to individual CNN architectures, achieving overall true positive classification in 93.3% of cases.

[img]
Preview
PDF
BHCI_2018_Submitted.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview
[img]
Preview
PDF
A_Final_BHCI_2018_CameraReady.pdf - Published Version

Download (1MB) | Preview

More Information

Depositing User: Kathy Clawson

Identifiers

Item ID: 9584
Identification Number: https://doi.org/10.14236/ewic/HCI2018.44
URI: http://sure.sunderland.ac.uk/id/eprint/9584
Official URL: https://dl.acm.org/doi/10.14236/ewic/HCI2018.44

Users with ORCIDS

ORCID for Kathy Clawson: ORCID iD orcid.org/0000-0001-8431-1524
ORCID for Louise Delicato: ORCID iD orcid.org/0000-0001-8271-2324

Catalogue record

Date Deposited: 06 Jul 2018 13:07
Last Modified: 30 Sep 2020 11:17

Contributors

Author: Kathy Clawson ORCID iD
Author: Louise Delicato ORCID iD
Author: Chris Bowerman

University Divisions

Faculty of Technology
Faculty of Technology > FOT Executive
Faculty of Technology > School of Computer Science

Subjects

Computing > Artificial Intelligence
Computing > Human-Computer Interaction
Computing

Actions (login required)

View Item (Repository Staff Only) View Item (Repository Staff Only)