Determining interacting objects in human-centric activities via qualitative spatio-temporal reasoning

Hajar Sadeghi Sokeh*, Stephen Gould, Jochen Renz

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    Abstract

    Understanding the activities taking place in a video is a challenging problem in Artificial Intelligence. Complex video sequences contain many activities and involve a multitude of interacting objects. Determining which objects are relevant to a particular activity is the first step in understanding the activity. Indeed many objects in the scene are irrelevant to the main activity taking place. In this work, we consider human-centric activities and look to identify which objects in the scene are involved in the activity. We take an activity-agnostic approach and rank every moving object in the scene with how likely it is to be involved in the activity. We use a comprehensive spatio-temporal representation that captures the joint movement between humans and each object. We then use supervised machine learning techniques to recognize relevant objects based on these features. Our approach is tested on the challenging Mind’s Eye dataset.

    Original languageEnglish
    Title of host publicationComputer Vision - ACCV 2014 - 12th Asian Conference on Computer Vision, Revised Selected Papers
    EditorsDaniel Cremers, Hideo Saito, Ian Reid, Ming-Hsuan Yang
    PublisherSpringer Verlag
    Pages550-563
    Number of pages14
    ISBN (Electronic)9783319168135
    DOIs
    Publication statusPublished - 2015
    Event12th Asian Conference on Computer Vision, ACCV 2014 - Singapore, Singapore
    Duration: 1 Nov 20145 Nov 2014

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume9007
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference12th Asian Conference on Computer Vision, ACCV 2014
    Country/TerritorySingapore
    CitySingapore
    Period1/11/145/11/14

    Fingerprint

    Dive into the research topics of 'Determining interacting objects in human-centric activities via qualitative spatio-temporal reasoning'. Together they form a unique fingerprint.

    Cite this