Yu-Cheng Chang, Yen-Pu Wang, Chiao-Ju Chang, Wei Tian Mireille Tan, Yu Lun Hsu, Yu Chen, Mike Y. Chen
This repository is the opensource project for MobileHCI'24 paper: "Experience from Designing Augmented Reality Browsing Interfaces for Real-world Walking Scenarios"
This paper presents the first exploration of AR browsing interface design and extended usage while walking in the wild. To achieve this goal, we developed a system providing easy-to-use browsing and UI adjustment interaction to facilitate UI design exploration and refinement. Our system was developed using Unity and consists of two key modules: 1) the browsing interface module and 2) UI adjustment module.
For the browsing module, we implemented a browser window using Vuplex, which enables connection to commercial applications (e.g. web browsers). The interaction was implemented with the pinch and raycast interactors provided by the Oculus Interaction SDK, to enable clicking and scrolling of content using hand gestures, respectively.
For the UI adjustment module, we defined an additional set of hand gestures using the hand pose detection provided by the SDK as well as AR panels to allow window parameters adjustment.
- Required Version
- Required Packages
- Oculus XR Plugin 3.0.2
- XR Plugin Management 4.2.0
- Vuplex 3D WebView for Android and iOS 4.2.2 (for building APK running on headsets)
- Vuplex 3D WebView for Windows and macOS 4.2 (for development on PC)
- Required Running Devices
- Meta Quest 2, Pro and 3