The usage of grayscale or color images for facial expression recognition with deep neural networks

Dmitry A. Yudin, Alexandr V. Dolzhenko, Ekaterina O. Kapustina

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

The paper describes usage of modern deep neural network architectures such as ResNet, DenseNet and Xception for the classification of facial expressions on color and grayscale images. Each image may contain one of eight facial expression categories: “Neutral”, “Happiness”, “Sadness”, “Surprise”, “Fear”, “Disgust”, “Anger”, “Contempt”. As the dataset was used AffectNet. The most accurate architecture is Xception. It gave classification accuracy on training sample 97.65%, on cleaned testing sample 57.48% and top-2 accuracy on cleaned testing sample 76.70%. The category “Contempt” is worst recognized by all the types of neural networks considered, which indicates its ambiguity and similarity with other types of facial expressions. Experimental results show that for the considered task it does not matter, the color or grayscale image is fed to the input of the algorithm. This fact can save a significant amount of memory when storing data sets and training neural networks. The computing experiments was performed using graphics processor using NVidia CUDA technology with Keras and Tensorflow deep learning frameworks. It showed that the average processing time of one image varies from 4 ms to 30 ms for different architectures. Obtained results can be used in software for neural network training for face recognition systems.

Original languageEnglish
Title of host publicationAdvances in Neural Computation, Machine Learning, and Cognitive Research III - Selected Papers from the XXI International Conference on Neuroinformatics, 2019
EditorsBoris Kryzhanovsky, Witali Dunin-Barkowski, Vladimir Redko, Yury Tiumentsev
PublisherSpringer Verlag
Pages271-281
Number of pages11
ISBN (Print)9783030304249
DOIs
Publication statusPublished - 2020
Externally publishedYes
Event21st International Conference on Neuroinformatics, 2019 - Dolgoprudny, Russian Federation
Duration: 7 Oct 201911 Oct 2019

Publication series

NameStudies in Computational Intelligence
Volume856
ISSN (Print)1860-949X
ISSN (Electronic)1860-9503

Conference

Conference21st International Conference on Neuroinformatics, 2019
Country/TerritoryRussian Federation
CityDolgoprudny
Period7/10/1911/10/19

Keywords

  • Classification
  • Convolutional neural network
  • Deep learning
  • Emotion
  • Face
  • Facial expression
  • Image recognition

Fingerprint

Dive into the research topics of 'The usage of grayscale or color images for facial expression recognition with deep neural networks'. Together they form a unique fingerprint.

Cite this