This project acts as a real-time musical synthesizer instrument. It is based entirely on hand motions rather than physical strings or buttons. It accomplishes that by using and ultrasonic sensor to determine the distance that the hand is away.
Based on the distance, we determine the corresponding note. The note is displayed on the OLED screen as well as sent to the AWS IoT Cloud Service. The second board then gets the note from the cloud, and, when its built-in accelerometer is triggered by a strumming motion, the notes from the cloud are played via a MIDI audio codec.