How accurately can a machine learning model identify violin intonation errors in audio recordings?

Project by Polygence alum Isabelle

How accurately can a machine learning model identify violin intonation errors in audio recordings?

Project's result

An AI-powered program on Github that provides feedback on the intonation of a user's violin playing and a research paper detailing the methods and explaining the program.

They started it from zero. Are you ready to level up with us?

Summary

The project consists of a program in which users can input an audio clip of their violin playing, a pdf of the sheet music and the tempo, then receive feedback on the intonation of the notes played in their audio. The program uses an existing pitch tracking machine learning algorithm to detect the pitches of each note in the audio. It also uses an existing software to convert the sheet music into a digital format. The difference between the audio pitch and the correct pitch is then used to produce feedback for the user through an existing AI model, which lists which notes were out of tune and whether each note was sharp or flat, as well as practice tips for the user. This program can be used by both beginner and advanced violinists as a practice tool to improve their intonation when playing, as well as develop their ability to recognize off-pitch notes. The result of the project includes a website that can be locally hosted and a research paper.

Sarah

Sarah

Polygence mentor

MS Master of Science

Subjects

Computer Science, Engineering

Expertise

Software engineering, Machine Learning, AI and robotics, music + AI

Isabelle

Isabelle

Student

Graduation Year

2028

Project review

“My mentor was very supportive and provided guidance when I encountered difficulties or was unsure of what to do. I also liked that it was structured to keep me on track.”

About my mentor

“Sarah was a great mentor who was kind, understanding, and supportive. When I encountered difficulties in my project, she worked with me to think of and try out possible solutions. She also provided me many different helpful resources on the topics I was interested in, allowing me to explore further.”