Skip to main content
Multimedia Tools and ApplicationsVolume 78, Issue 16, 30 August 2019, Pages 23161-23178

Going deeper in hidden sadness recognition using spontaneous micro expressions database(Article)

  Save all to author list
  • aiCV Lab, Institute of Technology, University of Tartu, Tartu, Estonia
  • bSingidunum University, Belgrade, Serbia
  • cInstitute of Digital Technologies, Loughborough University London, London, United Kingdom
  • dFaculty of Engineering, Hasan Kalyoncu University, Gaziantep, Turkey

Abstract

Recognition of facial micro-expressions (MEs), which indicates conscious or unconscious suppressing of true emotions, is still a challenging task in the affective computing and computer vision. There are two main reasons for that: First, the lack of spontaneous MEs databases, preferably focused on one emotion. So far, posed facial MEs databases were developed, and in the most cases, machines were trained on this posed MEs, which are stronger and more visible than spontaneous ones. Second, in order to achieve high recognition rate, deep learning structures are required that can achieve the best performance with very large number of data. To address these challenges, we make the following contributions: (i) extension of our MEs spontaneous database by adding new subjects; (ii) We analysed spontaneous MEs in long videos only for hidden sadness; (iii) We presented deeper analysis for automatic hidden sadness detection algorithm with deep learning architecture and compared results with standard machine learning techniques for hidden sadness detection. It is shown that with our method 99.08% recognition performance has been achieved observing only the eye region of the face. © 2019, Springer Science+Business Media, LLC, part of Springer Nature.

Author keywords

Deep learningEmotion recognitionHidden sadnessMicro-expressions

Indexed keywords

Engineering controlled terms:Database systemsMachine learning
Engineering uncontrolled termsAffective ComputingDetection algorithmEmotion recognitionHidden sadnessLearning architecturesLearning structureMicro-expressionsStandard machines
Engineering main heading:Deep learning

Funding details

Funding sponsor Funding number Acronym
Nvidia
Eesti Teadusagentuur
See opportunities by ETAg
PUT638ETAg
Türkiye Bilimsel ve Teknolojik Araştirma Kurumu1001 - 116E097TÜBITAK
European Regional Development FundERDF
  • 1

    This work is supported Estonian Research Council Grant (PUT638), the Scientific and Technological Research Council of Turkey (TÜBITAK) (Project 1001 - 116E097), and the Estonian Centre of Excellence in IT (EXCITE) funded by the European Regional Development Fund. The authors also gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan X and Titan V Pascal GPUs. The author would like to thank Miss Dariia Temirova for helping with deep neural network codes.

  • ISSN: 13807501
  • CODEN: MTAPF
  • Source Type: Journal
  • Original language: English
  • DOI: 10.1007/s11042-019-7658-5
  • Document Type: Article
  • Publisher: Springer New York LLC

  Anbarjafari, G.; Faculty of Engineering, Hasan Kalyoncu University, Gaziantep, Turkey;
© Copyright 2019 Elsevier B.V., All rights reserved.

Cited by 11 documents

Singh, J. , Sharma, D.
Automated detection of mental disorders using physiological signals and machine learning: A systematic review and scientometric analysis
(2024) Multimedia Tools and Applications
Sharma, D. , Singh, J. , Sehra, S.S.
Demystifying Mental Health by Decoding Facial Action Unit Sequences
(2024) Big Data and Cognitive Computing
Pereira, R. , Mendes, C. , Ribeiro, J.
Systematic Review of Emotion Detection with Computer Vision and Deep Learning
(2024) Sensors
View details of all 11 citations
{"topic":{"name":"Facial Expression; Deep Learning; Deep Neural Network","id":34115,"uri":"Topic/34115","prominencePercentile":94.79539,"prominencePercentileString":"94.795","overallScholarlyOutput":0},"dig":"042aaff48d3e1217e9ff69f410e69bdfebfbaf574e78e77e6c149c3558a3d892"}

SciVal Topic Prominence

Topic:
Prominence percentile: