Developing a situated virtual reality simulation for telerobotic control and training

Tom Gedeon*, Dingyun Zhu, Stephane Bersot

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    1 Citation (Scopus)

    Abstract

    In this paper, we present the development of a situated virtual reality simulation for control and training in a telerobotic mining setting. The original research scenario is derived from a real-world rock breaking task in mining teleoperation. With the intention of having better situational awareness and user control model for this application, we simulate the entire setting in a 3D Virtual Reality (VR) environment. Therefore, users are able to obtain more information (e.g. depth information) and feedback from the remote environment in this simulation than only working with real video streams from the remote camera(s). In addition, the concept of natural interaction has been applied in building more intuitive user control interfaces than conventional manual modes. Both human eye gaze and head movements have been used to develop natural and interactive viewpoint control models for users to complete the teleoperation task. By using such a 3D simulation, training in the complex teletobotic control process can be effectively carried out with the capability of changing visual and control conditions easily. A user study has also been conducted as the preliminary evaluation of the simulation. Encouraging feedback has been provided by the experimental participants regarding task learning, which suggests the effectiveness of using the simulation.

    Original languageEnglish
    Title of host publicationE-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings
    Pages13-22
    Number of pages10
    DOIs
    Publication statusPublished - 2012
    Event7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012 - Darmstadt, Germany
    Duration: 18 Sept 201220 Sept 2012

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume7516 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012
    Country/TerritoryGermany
    CityDarmstadt
    Period18/09/1220/09/12

    Fingerprint

    Dive into the research topics of 'Developing a situated virtual reality simulation for telerobotic control and training'. Together they form a unique fingerprint.

    Cite this