Augmented Reality Visualizer with Haptic Interfaces
Additional Team Members
Matt Haeger
Project Description
Ho'ohui is an augmented reality experiment done for a Haptic Interface class at CU Boulder.
Using the Open source Leap Motion device, we assembled a head mounted augmented reality device that was run off of the Unity software. We also designed and built a basic haptic glove that could receive serial communication from Unity and create haptic feedback for the user.
This allowed us to "feel" objects in a virtual environment and give real time feedback to the user.
Today, mixed reality is an emerging technology and is expected to have high demands in various applications. Therefore, we wanted to give the example on how others can experiment with this technology, in our case with augmented reality to build this open sourced project. Augmented reality technologies right now are expensive and with this type of project it can become more accessible to anyone.
Moreover, most applications in augmented reality do not offer enough kinesthetic communication or the sense of touch by applying forces, vibrations, or motions to the user. Therefore, in our use case scenario we implement haptics to our example of using augmented reality to visualize 3D objects as a designer, in this case on a car that can be manipulated using your hands and feel vibrations on your fingers as response for an object appearing in front of your lenses in physical space.
We enjoyed working on every aspect of this project. Special thanks to the ATLAS Community at CU Boulder and professor Daniel Leithinger for his guidance and advice.
Set Up
Process
Step 1: Headset Assembly
First Parts
3D Printer Parts
3D Printed Component Mount
Matt holding head mount
Step 2: Lenses
Custom made lenses specifically designed for our headset
Polish the lenses for 3 hours first with waterproof sand paper. Starting at 350 Grit to 1600 Grit, incrementing.
Apply plastic polish Novus 2 scratch remover compound using a drill if you have, for 10 minutes.
Step 3: Gloves
3 Vibration motors embedded on the inside of the glove
Arduino Schematic
Final Product
Resources
Leap Motion Repository: https://github.com/leapmotion/ProjectNorthStar
Project North Star Simplified Version Assembly Tutorial: https://exiii.jp/2018/07/25/project_north_star_en/
Print SLA Lenses: https://github.com/mdrjjn/northStarAssemblyGuide
3D Print Parts and Materials:
https://docs.google.com/spreadsheets/d/17OPl2oNZefMu_XfwKp9CA5PygzD6_z3uMTJ1lndurGw/edit?usp=sharing
Mirror Film:
Display Screens:
Plastic Polish:
Previous Github Page: https://github.com/arafferty10/hapticLeapMotion