abilityVR
Unity Developer
VR
abilityVR is a VR-based mobility training solution for individuals who are blind or visually impaired. Using Meta’s Spatial Audio SDK and haptic feedback, it provides immersive auditory experiences to enhance navigation skills. The project includes a forest experience for auditory training, a mobility module for road safety, and an interactive drum experience for musical exploration. By offering a safe, controlled learning space, abilityVR helps users build confidence and independence in real-world navigation.
Technical Details
Unity Engine – Core development platform
Meta's Spatial Audio SDK – Provides immersive 3D sound for navigation
Haptic Feedback – Enhances interaction with objects in the virtual space
Key Modules:
Environment Module: A virtual forest where users locate animals using spatial audio.
Mobility Module: Simulates urban environments to teach road safety using auditory and haptic cues.
Experience Zone: A drum-playing simulation to improve auditory coordination.
Onboarding Module: Guides users through app features and interactions.
My Contribution
I contributed to the design and development of the forest experience and drum experience in abilityVR. The forest experience serves as both an introduction to the application and an immersive environment where users can navigate using spatial audio and haptic feedback, helping them familiarize themselves with the system. I also developed the drum experience as an interactive zone where visually impaired users can play a virtual drum set, offering a fun and engaging activity that many would not typically have access to in real life.