TY - GEN
T1 - Advancing Virtual Reality Interaction
T2 - 2024 IEEE International Conference on Robotics and Automation, ICRA 2024
AU - Zhang, Zhuqing
AU - Li, Dongxuan
AU - Ma, Jiayao
AU - He, Yijia
AU - Ji, Pan
AU - Xiong, Rong
AU - Li, Hongdong
AU - Wang, Yue
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Ensuring robust tracking of controllers' movement is critical for human-robot interaction in virtual reality (VR) scenarios. This paper proposes a robust tracking algorithm based on a novel wearable ring-shaped controller equipped with an inertial measurement unit (IMU) and a light-emitting diode (LED). This novel controller design allows users to free up their hands for more immersive experiences. To track the controller's motion accurately and robustly, we resort to various forms of visual measurements, including 6 DoF and 5 DoF pose measurements from hand gesture detection, as well as 3 DoF position measurement and 2 DoF image measurement derived from the LED. We theoretically analyze the performances of these observation models and propose an optimal observation model combination scheme. Moreover, the necessity and rationale of online estimating system gravity are illustrated. The effectiveness of our tracking method is validated through extensive experiments.
AB - Ensuring robust tracking of controllers' movement is critical for human-robot interaction in virtual reality (VR) scenarios. This paper proposes a robust tracking algorithm based on a novel wearable ring-shaped controller equipped with an inertial measurement unit (IMU) and a light-emitting diode (LED). This novel controller design allows users to free up their hands for more immersive experiences. To track the controller's motion accurately and robustly, we resort to various forms of visual measurements, including 6 DoF and 5 DoF pose measurements from hand gesture detection, as well as 3 DoF position measurement and 2 DoF image measurement derived from the LED. We theoretically analyze the performances of these observation models and propose an optimal observation model combination scheme. Moreover, the necessity and rationale of online estimating system gravity are illustrated. The effectiveness of our tracking method is validated through extensive experiments.
UR - http://www.scopus.com/inward/record.url?scp=85202434666&partnerID=8YFLogxK
U2 - 10.1109/ICRA57147.2024.10610313
DO - 10.1109/ICRA57147.2024.10610313
M3 - Conference contribution
AN - SCOPUS:85202434666
T3 - Proceedings - IEEE International Conference on Robotics and Automation
SP - 3341
EP - 3347
BT - 2024 IEEE International Conference on Robotics and Automation, ICRA 2024
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 13 May 2024 through 17 May 2024
ER -