Replace Your Favourite Singer With a Robot

Melody extraction can be used for a number of cool applications including query-by-humming, automatic transcription, or computational musicology. But it can also be used to replace your favourite singer with a robot!

How? You start by choosing a track, for example this one:

Then you can use Melodia to estimate the pitch curve of the singer. If we synthesize the result with a sine wave, it would sound like this:

But wait! We can load the pitch curve into Vocaloid and synthesize a pitch-accurate rendition with whichever voice we want, like this one:

Finally, we can mix our new rendition with the original accompaniment to produce our very own robot-remix! Here it is:

TADA!

Here's another example, this time with opera! Here's the original track:

And here's the Melodia+Vocaloid version:

The opportunities for creating new songs (or just wreaking havoc with existing ones) are limitless!