Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking

Zhuqing Zhang, Dongxuan Li, Jiayao Ma, Yijia He*, Pan Ji, Rong Xiong, Hongdong Li, Yue Wang*

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    Abstract

    Ensuring robust tracking of controllers' movement is critical for human-robot interaction in virtual reality (VR) scenarios. This paper proposes a robust tracking algorithm based on a novel wearable ring-shaped controller equipped with an inertial measurement unit (IMU) and a light-emitting diode (LED). This novel controller design allows users to free up their hands for more immersive experiences. To track the controller's motion accurately and robustly, we resort to various forms of visual measurements, including 6 DoF and 5 DoF pose measurements from hand gesture detection, as well as 3 DoF position measurement and 2 DoF image measurement derived from the LED. We theoretically analyze the performances of these observation models and propose an optimal observation model combination scheme. Moreover, the necessity and rationale of online estimating system gravity are illustrated. The effectiveness of our tracking method is validated through extensive experiments.

    Original languageEnglish
    Title of host publication2024 IEEE International Conference on Robotics and Automation, ICRA 2024
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages3341-3347
    Number of pages7
    ISBN (Electronic)9798350384574
    DOIs
    Publication statusPublished - 2024
    Event2024 IEEE International Conference on Robotics and Automation, ICRA 2024 - Yokohama, Japan
    Duration: 13 May 202417 May 2024

    Publication series

    NameProceedings - IEEE International Conference on Robotics and Automation
    ISSN (Print)1050-4729

    Conference

    Conference2024 IEEE International Conference on Robotics and Automation, ICRA 2024
    Country/TerritoryJapan
    CityYokohama
    Period13/05/2417/05/24

    Fingerprint

    Dive into the research topics of 'Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking'. Together they form a unique fingerprint.

    Cite this