Augmenting VR/AR applications with EEG/EOG monitoring and oculo-vestibular recoupling

John K. Zao*, Tzyy Ping Jung, Hung Ming Chang, Tchin Tze Gan, Yu Te Wang, Yuan Pin Lin, Wen Hao Liu, Guang Yu Zheng, Chin Kuo Lin, Chia Hung Lin, Yu Yi Chien, Fang Cheng Lin, Yi Pai Huang, Sergio José Rodríguez Méndez, Felipe A. Medeiros

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

15 Citations (Scopus)

Abstract

Head-mounted virtual reality and augmented reality displays (a.k.a. VR/AR goggles) created a revolutionary multimedia genre that is seeking ever-broadening applications and novel natural human interfaces. Adding neuromonitoring and neurofeedback to this genre is expected to introduce a new dimension to user interaction with the cyber-world. This study presents the development of a Neuromonitoring VR/AR Goggle armed with electroencephalo- gram and electrooculogram sensors, programmable milli-Ampere current stimulators and wireless fog/cloud computing support. Beside of its potential use in mitigating cybersickness, this device may have potential applications in augmented cognition ranging from feedback-controlled perceptual training to on-line learning and virtual social interactions. A prototype of the device has been made from a Samsung Gear VR for S6. This study explains its technical design to ensure precision data sampling, synchronous event marking, real-time signal processing and big data cloud computing support. This study also demonstrates the effective-ness in measuring the event-related potentials during a visual oddball experiment.

Original languageEnglish
Title of host publicationFoundations of Augmented Cognition
Subtitle of host publicationNeuroergonomics and Operational Neuroscience - 10th International Conference, AC 2016 and Held as Part of HCI International 2016, Proceedings
EditorsCali M. Fidopiastis, Dylan D. Schmorrow
PublisherSpringer Verlag
Pages121-131
Number of pages11
ISBN (Print)9783319399546
DOIs
Publication statusPublished - 2016
Externally publishedYes
Event10th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience, AC 2016 and Held as Part of 18th International Conference on Human-Computer Interaction, HCI International 2016 - Toronto, Canada
Duration: 17 Jul 201622 Jul 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9743
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience, AC 2016 and Held as Part of 18th International Conference on Human-Computer Interaction, HCI International 2016
Country/TerritoryCanada
CityToronto
Period17/07/1622/07/16

Fingerprint

Dive into the research topics of 'Augmenting VR/AR applications with EEG/EOG monitoring and oculo-vestibular recoupling'. Together they form a unique fingerprint.

Cite this