Thumbs up: 3D gesture input on mobile phones using the front facing camera

Paul Schmieder, John Hosking, Andrew Luxton-Reilly, Beryl Plimmer

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    8 Citations (Scopus)

    Abstract

    We use the front facing camera in a smart phone to capture gesture input. Thumb gestures performed above the camera are recognized and used to invoke commands. In contrast to other input modalities the camera requires no device movements and no valuable screen space is used. To be viable, this type of interaction requires gestures which are comfortable and memorable for the user and real-time accurate recognition of those gestures. Given the performance constraints of phones and their cameras we needed to determine whether accurate and reliable recognition is possible and identify types of gestures that are recognizable and user appropriate. As a proof of concept, we conducted a user study testing three gestures for performance and user satisfaction. The results demonstrate that the 3D gestural input is successful and we provide detailed insights into successful recognition strategies for this novel interaction modality.

    Original languageEnglish
    Title of host publicationHuman-Computer Interaction, INTERACT 2013 - 14th IFIP TC 13 International Conference, Proceedings
    Pages318-336
    Number of pages19
    EditionPART 2
    DOIs
    Publication statusPublished - 2013
    Event14th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2013 - Cape Town, South Africa
    Duration: 2 Sept 20136 Sept 2013

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    NumberPART 2
    Volume8118 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference14th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2013
    Country/TerritorySouth Africa
    CityCape Town
    Period2/09/136/09/13

    Fingerprint

    Dive into the research topics of 'Thumbs up: 3D gesture input on mobile phones using the front facing camera'. Together they form a unique fingerprint.

    Cite this