Developing a situated virtual reality simulation for telerobotic control and training

Tom Gedeon; Dingyun Zhu; Stephane Bersot

doi:10.1007/978-3-642-33466-5_2

Developing a situated virtual reality simulation for telerobotic control and training

Tom Gedeon^*, Dingyun Zhu, Stephane Bersot

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › peer-review

2 Citations (Scopus)

Abstract

In this paper, we present the development of a situated virtual reality simulation for control and training in a telerobotic mining setting. The original research scenario is derived from a real-world rock breaking task in mining teleoperation. With the intention of having better situational awareness and user control model for this application, we simulate the entire setting in a 3D Virtual Reality (VR) environment. Therefore, users are able to obtain more information (e.g. depth information) and feedback from the remote environment in this simulation than only working with real video streams from the remote camera(s). In addition, the concept of natural interaction has been applied in building more intuitive user control interfaces than conventional manual modes. Both human eye gaze and head movements have been used to develop natural and interactive viewpoint control models for users to complete the teleoperation task. By using such a 3D simulation, training in the complex teletobotic control process can be effectively carried out with the capability of changing visual and control conditions easily. A user study has also been conducted as the preliminary evaluation of the simulation. Encouraging feedback has been provided by the experimental participants regarding task learning, which suggests the effectiveness of using the simulation.

Original language	English
Title of host publication	E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings
Pages	13-22
Number of pages	10
DOIs	https://doi.org/10.1007/978-3-642-33466-5_2
Publication status	Published - 2012
Event	7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012 - Darmstadt, Germany Duration: 18 Sept 2012 → 20 Sept 2012

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	7516 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012
Country/Territory	Germany
City	Darmstadt
Period	18/09/12 → 20/09/12

Access to Document

10.1007/978-3-642-33466-5_2

Cite this

Gedeon, T., Zhu, D., & Bersot, S. (2012). Developing a situated virtual reality simulation for telerobotic control and training. In E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings (pp. 13-22). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7516 LNCS). https://doi.org/10.1007/978-3-642-33466-5_2

Gedeon, Tom ; Zhu, Dingyun ; Bersot, Stephane. / Developing a situated virtual reality simulation for telerobotic control and training. E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings. 2012. pp. 13-22 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{c6cd2b1f0cd7414fa8bdef4b1f2fb613,

title = "Developing a situated virtual reality simulation for telerobotic control and training",

abstract = "In this paper, we present the development of a situated virtual reality simulation for control and training in a telerobotic mining setting. The original research scenario is derived from a real-world rock breaking task in mining teleoperation. With the intention of having better situational awareness and user control model for this application, we simulate the entire setting in a 3D Virtual Reality (VR) environment. Therefore, users are able to obtain more information (e.g. depth information) and feedback from the remote environment in this simulation than only working with real video streams from the remote camera(s). In addition, the concept of natural interaction has been applied in building more intuitive user control interfaces than conventional manual modes. Both human eye gaze and head movements have been used to develop natural and interactive viewpoint control models for users to complete the teleoperation task. By using such a 3D simulation, training in the complex teletobotic control process can be effectively carried out with the capability of changing visual and control conditions easily. A user study has also been conducted as the preliminary evaluation of the simulation. Encouraging feedback has been provided by the experimental participants regarding task learning, which suggests the effectiveness of using the simulation.",

keywords = "3D models, eye tracking, head tracking, natural interaction, simulation, situated virtual reality, teleoperation, telerobotic control, training",

author = "Tom Gedeon and Dingyun Zhu and Stephane Bersot",

year = "2012",

doi = "10.1007/978-3-642-33466-5\_2",

language = "English",

isbn = "9783642334658",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "13--22",

booktitle = "E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings",

note = "7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012 ; Conference date: 18-09-2012 Through 20-09-2012",

}

Gedeon, T, Zhu, D & Bersot, S 2012, Developing a situated virtual reality simulation for telerobotic control and training. in E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7516 LNCS, pp. 13-22, 7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012, Darmstadt, Germany, 18/09/12. https://doi.org/10.1007/978-3-642-33466-5_2

Developing a situated virtual reality simulation for telerobotic control and training. / Gedeon, Tom; Zhu, Dingyun; Bersot, Stephane.
E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings. 2012. p. 13-22 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7516 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › peer-review

TY - GEN

T1 - Developing a situated virtual reality simulation for telerobotic control and training

AU - Gedeon, Tom

AU - Zhu, Dingyun

AU - Bersot, Stephane

PY - 2012

Y1 - 2012

N2 - In this paper, we present the development of a situated virtual reality simulation for control and training in a telerobotic mining setting. The original research scenario is derived from a real-world rock breaking task in mining teleoperation. With the intention of having better situational awareness and user control model for this application, we simulate the entire setting in a 3D Virtual Reality (VR) environment. Therefore, users are able to obtain more information (e.g. depth information) and feedback from the remote environment in this simulation than only working with real video streams from the remote camera(s). In addition, the concept of natural interaction has been applied in building more intuitive user control interfaces than conventional manual modes. Both human eye gaze and head movements have been used to develop natural and interactive viewpoint control models for users to complete the teleoperation task. By using such a 3D simulation, training in the complex teletobotic control process can be effectively carried out with the capability of changing visual and control conditions easily. A user study has also been conducted as the preliminary evaluation of the simulation. Encouraging feedback has been provided by the experimental participants regarding task learning, which suggests the effectiveness of using the simulation.

AB - In this paper, we present the development of a situated virtual reality simulation for control and training in a telerobotic mining setting. The original research scenario is derived from a real-world rock breaking task in mining teleoperation. With the intention of having better situational awareness and user control model for this application, we simulate the entire setting in a 3D Virtual Reality (VR) environment. Therefore, users are able to obtain more information (e.g. depth information) and feedback from the remote environment in this simulation than only working with real video streams from the remote camera(s). In addition, the concept of natural interaction has been applied in building more intuitive user control interfaces than conventional manual modes. Both human eye gaze and head movements have been used to develop natural and interactive viewpoint control models for users to complete the teleoperation task. By using such a 3D simulation, training in the complex teletobotic control process can be effectively carried out with the capability of changing visual and control conditions easily. A user study has also been conducted as the preliminary evaluation of the simulation. Encouraging feedback has been provided by the experimental participants regarding task learning, which suggests the effectiveness of using the simulation.

KW - 3D models

KW - eye tracking

KW - head tracking

KW - natural interaction

KW - simulation

KW - situated virtual reality

KW - teleoperation

KW - telerobotic control

KW - training

UR - https://www.scopus.com/pages/publications/84871458928

U2 - 10.1007/978-3-642-33466-5_2

DO - 10.1007/978-3-642-33466-5_2

M3 - Conference Paper

SN - 9783642334658

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 13

EP - 22

BT - E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings

T2 - 7th International Conference on E-Learning and Games for Training, Education, Health and Sports, Edutainment 2012 and 3rd International Conference on Serious Games for Sports and Health, GameDays 2012

Y2 - 18 September 2012 through 20 September 2012

ER -

Gedeon T, Zhu D, Bersot S. Developing a situated virtual reality simulation for telerobotic control and training. In E-Learning and Games for Training, Education, Health and Sports - 7th International Conference, Edutainment 2012 and 3rd International Conference, GameDays 2012, Proceedings. 2012. p. 13-22. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-33466-5_2

Developing a situated virtual reality simulation for telerobotic control and training

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this