Lean and Elegant Motion Cueing in VR

profile
By bernhard riecke, ernst kruijff, daniel feuereissen, alex kitson, timofey grechkin, markus von der heyde, jake freiberg, abraham hashemian, thinh nguyen vo & katerina stepanova

How do we best design loco­mo­tion inter­faces for VR that pro­vide “enough” phys­i­cal motion cues (vestibular/proprioceptive) while still being effec­tive, afford­able, com­pact, and safe?

Despite amaz­ing progress in com­puter graph­ics and VR dis­plays, most afford­able and room-sized VR loco­mo­tion inter­faces pro­vide only little phys­i­cal motion cues (e.g., vestibu­lar & pro­pri­o­cep­tive cues). To pro­vide a more com­pelling and nat­ural sen­sa­tion of being in and moving through vir­tual envi­ron­ments, and reduced motion sick­ness and dis­ori­en­ta­tion, we design and eval­u­ate novel approaches towards more embod­ied yet afford­able, safe, and com­pact loco­mo­tion inter­faces for VR. In par­tic­u­lar, we design and inves­ti­gate novel user-powered min­i­mal motion cueing inter­faces that can enhance self-motion per­cep­tion in vir­tual reality.

Video of how such motion cueing could be applied in VR simulations

Below is an exam­ple of how one can con­trol the self-motion sim­u­lated in Virtual Reality by simply lean­ing into the direc­tion of intended travel using a lean­ing chair (Gyroxus). No motors, actu­a­tors, or com­plex motion cueing algo­rithms needed.

YouTube Preview Image YouTube Preview Image

Below are 2 recent posters pre­sented at IEEE VR 2017:

Sorry, there’s no items to display.

Freiberg, J., Kitson, A., & Riecke, B. E. (2017). Development and Evaluation of a Hands-Free Motion Cueing Interface for Ground-Based Navigation. Presented at the IEEE Virtual Reality

Click to view Poster

Sorry, there’s no items to display.

Kitson, A., Hashemian, A. M., Stepanova, E. R., Kruijff, E., & Riecke, B. E. (2017). Lean Into It: Exploring Leaning-Based Motion Cueing Interfaces for Virtual Reality Movement. Presented at the IEEE Virtual Reality (accepted 2-page extended abstract), Los Angeles, CA, USA.

 

Media Gallery

  • image
  • image
  • image
  • image
  • image
  • image

Related Publications

Hashemian, Abraham M., and Bernhard E. Riecke. 2017. “Rotate and Lean: Does Leaning toward the Target Direction Improves the Virtual Reality Navigation?” Poster pre­sented at the Second International Workshop on Models and Representations in Spatial Cognition, Tübingen, Germany, April 6. (Download)
Kitson, Alexandra, Timofey Y. Grechkin, Markus von der Heyde, and Bernhard E. Riecke. 2017. “Navigating Virtual Environments – Do Physical Rotations Aid in Orientation?” Poster pre­sented at the Second International Workshop on Models and Representations in Spatial Cognition, Tübingen, Germany, April 6. (Download)
Nguyen-Vo, Thinh, Bernhard E. Riecke, and Wolfgang Stuerzlinger. 2017. “Investigating the Effect of Simulated Reference Frames on Spatial Orientation in Virtual Reality.” Poster pre­sented at the Second International Workshop on Models and Representations in Spatial Cognition, Tübingen, Germany, April 6. (Download)
Nguyen-Vo, Thinh, Bernhard E. Riecke, Wolfgang Stuerzlinger, Duc-Minh Pham, and Ernst Kruijff. 2019. “NaviBoard and NaviChair: Limited Translation Combined with Full Rotation for Efficient Virtual Locomotion.” IEEE Transactions on Visualization and Computer Graphics (TVCG) 27 (1): 165–77. https://doi.org/10.1109/TVCG.2019.2935730. (Download)
Hashemian, Abraham M, Ashu Adhikari, Ivan A Aguilar, Ernst Kruijff, Markus von der Heyde, and Bernhard E. Riecke. 2023. “Leaning-Based Interfaces Improve Simultaneous Locomotion and Object Interaction in VR Compared to the Handheld Controller.” IEEE Transactions on Visualization and Computer Graphics (TVCG), 1–18. https://doi.org/10.1109/TVCG.2023.3275111. (Download)
Adhikari, Ashu, Daniel Zielasko, Ivan Aguilar, Alexander Bretin, Ernst Kruijff, Markus von der Heyde, and Bernhard E. Riecke. 2022. “Integrating Continuous and Teleporting VR Locomotion into a Seamless ‘HyperJump’ Paradigm.” IEEE Transaction on Visualization and Computer Graphics TVCG 29 (12): 5265–81. https://doi.org/10.1109/TVCG.2022.3207157. (Download)
Hashemian, Abraham M. 2022. “Providing Embodied Self-Motion Cues Improve Flying and Ground-Based Locomotion Experience and Performance.” PhD Thesis, Vancouver, BC, Canada: Simon Fraser University. https://summit.sfu.ca/item/35698. (Download)
Adhikari, Ashu. 2021. “Improving Spatial Orientation in Virtual Reality with Leaning-Based Interfaces.” MSc Thesis, Vancouver, BC, Canada: Simon Fraser University. https://summit.sfu.ca/item/34755. (Download)
Adhikari, Ashu, Abraham M. Hashemian, Thinh Nguyen-Vo, Ernst Kruijff, Markus von der Heyde, and Bernhard E. Riecke. 2021. “Lean to Fly: Leaning-Based Embodied Flying Can Improve Performance and User Experience in 3D Navigation.” Frontiers in Virtual Reality 2: 1–22. https://doi.org/10.3389/frvir.2021.730334.
Adhikari, Ashu, Bernhard E. Riecke, Abraham M. Hashemian, Thinh Nguyen-Vo, Ernst Kruijff, and Markus von der Heyde. 2021. “Embodied VR Flying Improves Spatial Orientation While Reducing Cybersickness.” Talk pre­sented at the ICSC 2021: 8th International Conference on Spatial Cognition, Rome, Italy. https://youtu.be/FbmE4SEISWU. (Download)
Hashemian, Abraham M., Ashu Adhikari, Alexander Bretin, Ivan Aguilar, Ernst Kruijff, Markus von der Heyde, and Bernhard E. Riecke. 2021. “Is Walking Necessary for Effective Locomotion and Interaction in VR?” In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 395–96. Lisbon, Portugal: IEEE. https://doi.org/10.1109/VRW52623.2021.00084. (Download)
Hashemian, Abraham M., Ashu Adhikari, Ernst Kruijff, Markus von der Heyde, and Bernhard E. Riecke. 2021. “Leaning-Based Interfaces Improve Ground-Based VR Locomotion in Reach-the-Target, Follow-the-Path, and Racing Tasks.” IEEE Transaction on Visualization and Computer Graphics TVCG, 1–22. https://doi.org/10.1109/TVCG.2021.3131422. (Download)
Riecke, Bernhard E., Ashu Adhikari, Daniel Zielasko, Alexander Bretin, Markus von der Heyde, and Ernst Kruijff. 2021. “HyperJump: Merging Teleporting and Continuous VR Locomotion into One Paradigm.” Talk pre­sented at the ICSC 2021: 8th International Conference on Spatial Cognition, Rome, Italy. (Download)
Riecke, Bernhard E, Abraham M Hashemian, Ashu Adhikari, Ivan Aguilar, Ernst Kruijff, and Markus von der Heyde. 2021. “Simultaneous Locomotion and Interaction in VR: Walking > Leaning > Controller.” Talk pre­sented at the ICSC 2021: 8th International Conference on Spatial Cognition, Rome, Italy. https://youtu.be/jzoaBAd6gPY. (Download)
Hashemian, A., M. Lotfaliei, A. Adhikari, E. Kruijff, and Bernhard E. Riecke. 2020. “HeadJoystick: Improving Flying in VR Using a Novel Leaning-Based Interface.” IEEE Transactions on Visualization and Computer Graphics 28 (4): 1792–1809. https://doi.org/10.1109/TVCG.2020.3025084.
Nguyen-Vo, Thinh, Bernhard E. Riecke, Wolfgang Stuerzlinger, Duc-Minh Pham, Ernst Kruijff, and Riecke. 2020. “NaviBoard and NaviChair: Limited Translation Combined with Full Rotation for Efficient Virtual Locomotion.” Talk pre­sented at the IEEE Virtual Reality 2020, Atlanta, GA, USA. https://youtu.be/JCYL2qVFO6M.
Kruijff, E., & Riecke, B. E. (2018). Navigation Interfaces for Virtual Reality and Gaming: Theory and Practice. CHI ’18 Extended Abstracts on Human Factors in Computing Systems, 4 pages (half-day course). https://doi.org/10.1145/3170427.3170643 (Download)
Hashemian, Abraham M., Alexandra Kitson, Thinh Nguyen-Vo, Hrvoje Benko, Wolfgang Stuerzlinger, and Bernhard E. Riecke. 2018. “Investigating a Sparse Peripheral Display in a Head-Mounted Display for VR Locomotion.” In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 571–72. Reutlingen, Germany: IEEE. https://doi.org/10.1109/VR.2018.8446345. (Download)
Kruijff, E., & Riecke, B. E. (2018). Navigation Interfaces for Virtual Reality and Gaming: Theory and Practice. 2 pages (half-day course). (Download)
Nguyen-Vo, Thinh, Bernhard E. Riecke, Wolfgang Stuerzlinger, Duc-Minh Pham, and Ernst Kruijff. 2018. “Do We Need Actual Walking in VR? Leaning with Actual Rotation Might Suffice for Efficient Locomotion.” Poster pre­sented at the Spatial Cognition 2018. (Download)
Kitson, Alexandra, Thinh Nguyen-Vo, Abraham M. Hashemian, Ekaterina R. Stepanova, and Bernhard E. Riecke. 2017. “A User Study Comparing Two Low-Cost Chair Interfaces for Embodied Virtual Locomotion.” Talk pre­sented at the Psychonomic Society 58th Annual Meeting, Vancouver, BC, Canada, November.
Stepanova, Ekaterina R., Denise Quesnel, Alexandra Kitson, Mirjana Prpa, and Bernhard E. Riecke. 2017. “Virtual Reality as a Tool for Inducing and Understanding Transformative Experiences.” Poster pre­sented at the Psychonomic Society 58th Annual Meeting, Vancouver, BC, Canada, November. (Download)
Hashemian, Abraham M., and Bernhard E. Riecke. 2017. “Leaning-Based 360° Interfaces: Investigating Virtual Reality Navigation Interfaces with Leaning-Based-Translation and Full-Rotation.” In Virtual, Augmented and Mixed Reality (VAMR 2017), edited by S. Lackey and J. Chen, 10280:15–32. Lecture Notes in Computer Science. Cham: Springer. https://youtu.be/7IT9EODJn3c. (Download)
Kruijff, E., & Riecke, B. E. (2017). Navigation Interfaces for Virtual Reality and Gaming: Theory and Practice. Course, 433–434. https://doi.org/10.1109/VR.2017.7892362 (Download)
Nguyen-Vo, T., Riecke, B. E., & Stuerzlinger, W. (2017). Moving in a Box: Improving Spatial Orientation in Virtual Reality using Simulated Reference Frames. 207–208. https://doi.org/10.1109/3DUI.2017.7893344 (Download)
Kitson, Alexandra, Timofey Y. Grechkin, M. von der Heyde, and Bernhard E Riecke. 2016. “Effect of Physical Rotations and Gender for Navigation Performance in Virtual Environments.” Poster pre­sented at the International Meeting of the Psychonomic Society, Granada, Spain, May. http://www.ps2016.org/. (Download)
Freiberg, Jacob. 2015. “Experience Before Construction: Immersive Virtual Reality Design Tools for Architectural Practice.” MSc Thesis, Surrey, BC, Canada: Simon Fraser University. https://summit.sfu.ca/item/16052. (Download)
Feuereissen, Daniel. 2013. “Self-Motion Illusions (Vection) in Virtual Environments: Do Active Control and User– Generated Motion Cueing Enhance Visually Induced Vection?” MSc Thesis, Surrey, BC, Canada: Simon Fraser University. https://summit.sfu.ca/item/13651. (Download)