Robotic Art is a culminating engineering project for my BSc, part of the ELEC 490/498 Computer Engineering Project for the academic year FW21/22.
Robotic Art is a piano playing animatronic which can play piano keys on a real keyboard using digital input from machine vision software and pre-loaded songs.
The system contains three subsystems:
- A macOS application responsible for converting camera feed data into MIDI data, and then sending that data to an Arduino
- An Arduino circuit that is responsible for controlling solenoids
- 3D printed mechanical keys that are pushed by the solenoids to play the piano key
Potential applications of this system include as people with accessibility issues, helping with a musician’s dexterity and simply providing a captivating and entertaining piece of art.
A deeper explanation of the project can be found in ELEC49X_CapstoneProjectFinalReport_Group27_V2.pdf.
The project was completed in conjunction with Nicholas Alderman, Drew Anderson, Carter Jan, and Charlie Maslenchko.
Screenshots of the macOS app:
A demo video of the entire system in operation:
Robotic Art is available under the MIT license. See the LICENSE file for more info.