Tunebot
Tunebot is a music search engine developed by the Interactive Audio Lab at Northwestern University. Users can search the database by humming or singing a melody into a microphone, playing the melody on a virtual keyboard, or by typing some of the lyrics. This allows users to finally identify that song that was stuck in their head.
Contents
Searching Techniques
Tunebot is a Query by humming system. It compares a sung query to a database of musical themes by using the intervals between each note. This allows a user to sing in a different key than the target recording and still produce a match. The intervals are also unquantized to allow for other tunings besides the standard A=440Hz, since not many people in the world have perfect pitch.
In addition to note intervals, Tunebot compares a query with potential targets by using rhythmic ratios between notes. Since ratios between note lengths are used, the tempo of the performance does not affect the rhythmic similarity measure.
Queries and targets are then matched by a weighted string alignment algorithm between the note intervals and rhythmic ratios.
The Database
The database consists of unaccompanied melodies sung by contributors (a capella). Contributors log into the website and sing their examples to the system. Each of these recordings is associated with a corresponding song on Amazon. A sung query is compared to these examples. A capella sung examples are used as search keys because it is much easier to compare one unaccompanied vocal (the sung query) to another (an example search key) than it is to compare an unaccompanied vocal to a full band recording, which may contain guitar, drums, other singers, sound effects, etc.
Distinguishing Features
Tunebot learns from user input, and it improve its results as each user submits more queries. Since no human can sing perfectly in tune every time they sing, the search engine must take that into account. By choosing a song from a list of ranked results, users tell Tunebot which song was correct. Tunebot then pairs that song with the user's query, analyzes the differences, and runs a Genetic Algorithm. This process tweaks the parameters that control how the system compares the user's query to the targets. For instance, if a user has no sense of rhythm, that factor of the comparison is lowered for future queries.
References
- B. Pardo. Finding Structure in Audio for Music Information Retrieval. IEEE Signal Processing Magazine. vol. 49 (8), pp. 49-52, 2006
- D. Little, D. Raffensperger, B. Pardo. A Query by Humming System that Learns from Experience. Proceedings of the 8th International Conference on Music Information Retrieval, Vienna, Austria, September 23-27, 2007.
- D. Little, D. Raffensperger and B. Pardo.Online Training of a Music Search Engine. Northwestern University, Evanston, IL, NWU-EECS-07-03, 2007
