Ukulele Hero
A PC game designed to teach Ukulele chords using sound recognition from an actual instrument.
RULES & RESPONSABILITIES
-
Lead Programmer
-
Develop a sound recognition algorithm tailored for the Ukulele
-
Implement user interface and flow
-
Ideation with teammates, user testing and bug fixes
CHALLENGES
-
Being able to retrieve the data from the devices microphone
-
Being able to identify Ukulele strings sound, including multiple strings at the same time (chord)
-
Dealing with hardware specific features (microphone on different devices)
-
Creating a fun learning experience for non-gamers
LEARNINGS
-
Limitation of sound recognition in Unity
-
Using Fourier Analysis in Unity to recognize Ukulele strings frequency
-
How sound is translated to data in different devices
-
Standard rhythm game core loop