The more the merrier: Analysing the affect of a group of people in images

Abhinav Dhall, Jyoti Joshi, Karan Sikka, Roland Goecke, Nicu Sebe

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    75 Citations (Scopus)

    Abstract

    The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.

    Original languageEnglish
    Title of host publication2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9781479960262
    DOIs
    Publication statusPublished - 17 Jul 2015
    Event11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015 - Ljubljana, Slovenia
    Duration: 4 May 20158 May 2015

    Publication series

    Name2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015

    Conference

    Conference11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015
    Country/TerritorySlovenia
    CityLjubljana
    Period4/05/158/05/15

    Fingerprint

    Dive into the research topics of 'The more the merrier: Analysing the affect of a group of people in images'. Together they form a unique fingerprint.

    Cite this