

Recognition of facial micro-expressions (MEs), which indicates conscious or unconscious suppressing of true emotions, is still a challenging task in the affective computing and computer vision. There are two main reasons for that: First, the lack of spontaneous MEs databases, preferably focused on one emotion. So far, posed facial MEs databases were developed, and in the most cases, machines were trained on this posed MEs, which are stronger and more visible than spontaneous ones. Second, in order to achieve high recognition rate, deep learning structures are required that can achieve the best performance with very large number of data. To address these challenges, we make the following contributions: (i) extension of our MEs spontaneous database by adding new subjects; (ii) We analysed spontaneous MEs in long videos only for hidden sadness; (iii) We presented deeper analysis for automatic hidden sadness detection algorithm with deep learning architecture and compared results with standard machine learning techniques for hidden sadness detection. It is shown that with our method 99.08% recognition performance has been achieved observing only the eye region of the face. © 2019, Springer Science+Business Media, LLC, part of Springer Nature.
| Engineering controlled terms: | Database systemsMachine learning |
|---|---|
| Engineering uncontrolled terms | Affective ComputingDetection algorithmEmotion recognitionHidden sadnessLearning architecturesLearning structureMicro-expressionsStandard machines |
| Engineering main heading: | Deep learning |
| Funding sponsor | Funding number | Acronym |
|---|---|---|
| Nvidia | ||
| Eesti Teadusagentuur See opportunities by ETAg | PUT638 | ETAg |
| Türkiye Bilimsel ve Teknolojik Araştirma Kurumu | 1001 - 116E097 | TÜBITAK |
| European Regional Development Fund | ERDF |
This work is supported Estonian Research Council Grant (PUT638), the Scientific and Technological Research Council of Turkey (TÜBITAK) (Project 1001 - 116E097), and the Estonian Centre of Excellence in IT (EXCITE) funded by the European Regional Development Fund. The authors also gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan X and Titan V Pascal GPUs. The author would like to thank Miss Dariia Temirova for helping with deep neural network codes.
Anbarjafari, G.; Faculty of Engineering, Hasan Kalyoncu University, Gaziantep, Turkey;
© Copyright 2019 Elsevier B.V., All rights reserved.