SUMMARY:
UCLA researchers in the Department of Computer Science and Engineering have developed a wearable glove sensor capable of detecting and tracking a musician’s movements in real-time.
BACKGROUND:
Due to recent events such as the COVID-19 pandemic and limited attendance at music venues, practice and training of instruments at home has become popular. Most training on instruments can be acquired via virtual meetings with instructors, but the lack of personal training can affect the performance of musicians. Therefore, there is a need for a device that can aid instructors and musicians on musical instrument practice and performance.
INNOVATION:
UCLA researchers in the Department of Computer Science and Engineering have developed a wearable glove sensor to track hand movements and optical music recognition which extracts key components of music (such as notes and musical instructions) while a musician plays an instrument in real-time. The device is capable of matching hand movements to the music and determining when the electronic page (on laptop or tablet) should be turned. The use of the wearable device can allow musicians to focus on continuous practice without intervention of page turning as well as identifying sections of a piece that require further practice. Furthermore, the wearable device can be used in live performance to allow musicians to focus on the creative aspects of performance instead of relying on page turners or turning it themselves.
POTENTIAL APPLICATIONS:
ADVANTAGES:
STATUS OF DEVELOPMENT
First successful demonstration of wearable sensor on page turning while playing instrument