RealSmileNet: A Deep End-to-End Network for Spontaneous and Posed Smile Recognition

Yan Yang*, Md Zakir Hossain, Tom Gedeon, Shafin Rahman

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    6 Citations (Scopus)

    Abstract

    Smiles play a vital role in the understanding of social interactions within different communities, and reveal the physical state of mind of people in both real and deceptive ways. Several methods have been proposed to recognize spontaneous and posed smiles. All follow a feature-engineering based pipeline requiring costly pre-processing steps such as manual annotation of face landmarks, tracking, segmentation of smile phases, and hand-crafted features. The resulting computation is expensive, and strongly dependent on pre-processing steps. We investigate an end-to-end deep learning model to address these problems, the first end-to-end model for spontaneous and posed smile recognition. Our fully automated model is fast and learns the feature extraction processes by training a series of convolution and ConvLSTM layer from scratch. Our experiments on four datasets demonstrate the robustness and generalization of the proposed model by achieving state-of-the-art performances.

    Original languageEnglish
    Title of host publicationComputer Vision – ACCV 2020 - 15th Asian Conference on Computer Vision, 2020, Revised Selected Papers
    EditorsHiroshi Ishikawa, Cheng-Lin Liu, Tomas Pajdla, Jianbo Shi
    PublisherSpringer Science and Business Media Deutschland GmbH
    Pages21-37
    Number of pages17
    ISBN (Print)9783030695408
    DOIs
    Publication statusPublished - 2021
    Event15th Asian Conference on Computer Vision, ACCV 2020 - Virtual, Online
    Duration: 30 Nov 20204 Dec 2020

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume12626 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference15th Asian Conference on Computer Vision, ACCV 2020
    CityVirtual, Online
    Period30/11/204/12/20

    Fingerprint

    Dive into the research topics of 'RealSmileNet: A Deep End-to-End Network for Spontaneous and Posed Smile Recognition'. Together they form a unique fingerprint.

    Cite this