Hey HN!
I just shipped a project I’ve been working on called Maroofy: https://maroofy.com
You can search for any song, and it’ll use the song’s audio to find other similar-sounding music.
Demo: https://twitter.com/subby_tech/status/1621293770779287554
How does it work?
I’ve indexed ~120M+ songs from the iTunes catalog with a custom AI audio model that I built for understanding music.
My model analyzes raw music audio as input and produces embedding vectors as output.
I then store the embedding vectors for all songs into a vector database, and use semantic search to find similar music!
Here are some examples you can try:
Fetish (Selena Gomez feat. Gucci Mane) — https://maroofy.com/songs/1563859943
The Medallion Calls (Pirates of the Caribbean) — https://maroofy.com/songs/1440649752
Hope you like it, and would love to hear any questions/feedback/comments! :D
Take Raga's Dance by Vanessa-Mae, A R Rahman, ... Royal Philharmonic https://maroofy.com/songs/476841571 . I put in this track expecting other fusion songs to pop up, and arguably some do, but much more often it feels like a 20 second section was used to define the original song and it misses the underlying concept. Like it got, in my subjective description, the epic violin in orchestral music, but it completely ignores the fusion between the distict styles of traditional indian singing/instrumentals and western ochestral and also ignores the call response structure between the violin and carnatic players, which is the what I actually care about. Other songs have the vocals but no epic backing. It feels like it's matching multiple samples from the song instead of the whole song.
This feels very promising since it clearly is picking up the styling of the specific songs across different genres and languages. I look forward to seeing where this goes.
I also think it would be interesting if there was a way to specify two different songs to find either only the common things and/or to find what the fusion of those two tracks produces.