Skip to main content
Springer Nature Link
Log in

Facial expression analysis and the affect space

  • Applied Problems
  • Published:
Pattern Recognition and Image Analysis Aims and scope Submit manuscript

Abstract

In this paper we present a technique for facial expression analysis and representing the underlying emotions in the affect space. We develop a purely appearance based approach using Multi-scale Gaussian derivatives and Support Vector Machines. The technique is validated on two different databases. The system is shown to generalize well and performs better than the baseline method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. P. Ekman, “An argument for basic emotions,” Cognition Emotion 6 (3–4), 169–200 (1992).

    Article  Google Scholar 

  2. P. Ekman and W. Friesen, Facial Action Coding System: a Technique for the Measurement of Facial Movement (Consulting Psychologists Press, Palo Alto, 1978).

    Google Scholar 

  3. G. Littlewort, J. Whitehill, T. Wuand, I. Fasel, M. Frank, J. Movellan, and M. Bartlett, “The computer expression recognition toolbox (cert),” in Proc. 2011 IEEE Int. Conf. on Automatic Face and Gesture Recognition (Santa Barbara, 2011), pp. 298–305.

    Google Scholar 

  4. Young-suk Shin, “Recognizing facial expressions with pca and ica onto dimension of the emotion,” in Proc. 2006 Joint IAPR Int. Conf. on Structural, Syntactic, and Statistical Pattern Recognition SSPR’06/SPR’06 (Springer-Verlag, Berlin, Heidelberg, 2006), pp. 916–922.

    Google Scholar 

  5. M. Dahmane and J. Meunier, “The computer expression recognition toolbox (cert),” in Proc. Affective Computing and Intelligent Interaction 2011 (Memphis, TN, 2011), pp. 351–358.

    Google Scholar 

  6. G. McKeown, M. Valstar, R. Cowie, M. Pantic, and M. Schroder, The semaine database: annotated multimodal records of emotionally colored conversations between a person and a limited agent,” IEEE Trans. Affective Comput. 3 (1), 5–17 (2012).

    Article  Google Scholar 

  7. J. A. Russell and A. Mehrabian, “Evidence for a threefactor theory of emotions,” J. Res. Person. 11 (3), 273–294 (1977).

    Article  Google Scholar 

  8. C. Becker-Asano, “WASABI: affect simulation for agents with believable interactivity,” PhD Thesis (Univ. of Bielefeld, 2008).

    Google Scholar 

  9. J. Cohn, T. Kanade, and Y.-L. Tian, “Comprehensive database for facial expression analysis,” in Proc. 4th IEEE Int. Conf. on Automatic Face and Gesture Recognition (Grenoble, 2000), pp. 46–53.

    Google Scholar 

  10. F. Wallhoff, Facial expressions and emotion database (Techn. Univ. of Munich, 2006). http:// www.mmk.ei.tum.de/ af/fgnet/feedtum.html

    Google Scholar 

  11. Face and gesture recognition working group. http://www prima.inrialpes.fr/FGnet/

  12. J. Varun and J. L. Crowley, “Smile detection using multi-scale Gaussian derivatives,” in Proc. 12th WSEAS Int. Conf. on Signal Processing, Robotics and Automation (Cambridge, 2013), pp. 149–154.

    Google Scholar 

  13. T. Lindeberg, Scale-Space Theory in Computer Vision (Kluwer Acad. Press, 1994).

    Book  Google Scholar 

  14. D. G. Lowe, “Object recognition from local scaleinvariant features,” in Proc. Int. Conf. on Computer Vision (Kerkyra, 1999), pp. 1150–1157.

    Google Scholar 

  15. J. L. Crowley and O. Riff, Springer Lecture Notes on Computer Science, Vol. 2695, Chapter Fast Computation of Scale Normalized Gaussian Receptive Fields (2003), pp. 584–598.

    Google Scholar 

  16. I. T. Jolliffe, Principal Component Analysis (SpringerVerlag, 2002).

    MATH  Google Scholar 

  17. V. N. Vapnik, Statistical Learning Theory (Wiley, New York, 1998).

    MATH  Google Scholar 

  18. C. Cortes and V. N. Vapnik, Machine Learning, Vol. 20, Chapter Support-Vector Networks (Springer, 1995), pp. 273–297.

    Google Scholar 

  19. P. Viola and M. J. Jones, “Robust real-time face detection,” Int. J. Computer Vision, 20 (17), 137–154 (2004).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. INRIA, Grenoble Rhône-Alpes Research Center, Paris, France

    V. Jain, E. Mavridou, J. L. Crowley & A. Lux

Authors
  1. V. Jain
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. E. Mavridou
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. J. L. Crowley
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. A. Lux
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to V. Jain.

Additional information

The article is published in the original.

This paper uses the materials of the report submitted at the 11th International Conference “Pattern Recognition and Image Analysis: New Information Technologies,” Samara, Russia, September 23–28, 2013.

Varun Jain has a Bachelors degree in Electronics Engineering and a Masters in System Engineering. He has been pursuing his PhD at the INRIA Grenoble RhôneAlpes Research Center since October 2011. He works on facial expression analysis and Affective computing. His areas of interest include Image Processing, Machine Learning and HumanComputer Interaction.

James L. Crowley directs the PRIMA Research Project group of the LIG laboratory at the INRIA Grenoble research center in Montbonnot, France. He holds the post of Professor at the Institut National Polytechnique de Grenoble (INPG), where he teaches courses in Computer Vision, Signal Processing, Pattern Recognition and Artificial Intelligence at l’ENSIMAG (Ecole National Superieure d’Informatique et de Mathematiques Appliques). From 2003 through 2006, Professor Crowley has served as director for the UMR GRAVIR laboratory. Professor Crowley has edited two books, five special issues of journals, and authored over 300 articles on computer vision and mobile robotics.

Evanthia Mavridou received her BA in applied informatics at the University of Macedonia, Greece, in 2007. During her BA studies, she performed one semester in 2005 at the University of Joensuu, Finland. From 2007 to 2010, she worked as a web programmer in Thessaloniki, Greece. In 2011, she received the MS in image, computer vision and robotics at the University of Crete, Greece. In 2011, she has started her research career in computer vision at the INRIA Grenoble RhoneAlpes research center, France, where she is currently pursuing her PhD under the supervision of Prof. James L. Crowley. She is working on the exploration and development of efficient compact and robust image description methods. Her research interests include image description, feature detection and recognition.

Augustin Lux Augustin LUX now is professor ermeritus, his last position being Professor in Computer Science at the Ensimag (Ecole National Superieure d’Informatique et de Mathematiques Appliques) department of the Institut Polytechnique de Grenoble (Grenoble-Inp), France, where he had been teaching courses on algorithmic studies, programming, Artificial Intelligence, and machine vision. His university studies took place at the unversities of Gttingen (Vordiplom in Physik) and Grenoble (Maitrise d’Informatique), where he obtained his PhD in 1986 (Thse d’tat). Professor Lux works with the PRIMA team belonging to the LIG Laboratory and Inria, Grenoble. Research interests concern “Artificial Intelligence” in a broad sense, more particularly vision and image understanding.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jain, V., Mavridou, E., Crowley, J.L. et al. Facial expression analysis and the affect space. Pattern Recognit. Image Anal. 25, 430–436 (2015). https://doi.org/10.1134/S1054661815030086

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1054661815030086

Keywords