Music Genre Classification with Deep Learning
Abstract
In this project we adapt the model from Choi et al. to train a custom music genre classification system with our own genres and data. The model takes as an input the spectogram of music frames and analyzes the image using a Convolutional Neural Network (CNN) plus a Recurrent Neural Network (RNN). The output of the system is a vector of predicted genres for the song.
We fine-tuned their model with a small dataset (30 songs per genre) and test it on the GTZAN dataset providing a final accuracy of 80%.
Slides and Report
Code
In this repository we provide the scripts to fine-tune the pre-trained model and a quick music genre prediction algorithm using our own weights.
Currently the genres supported are the GTZAN dataset tags:
- Blues
- Classical
- Country
- Disco
- HipHop
- Jazz
- Metal
- Pop
- Reggae
- Rock
Prerequisites
We have used Keras running over Theano to perform the experiments. Was done previous to Keras 2.0, not sure if it will work with the new version. It should work on CPU and GPU.
- Have pip
- Suggested install: virtualenv
Python packages necessary specified in requirements.txt run:
# Create environment
virtualenv env_song
# Activate environment
source env_song/bin/activate
# Install dependencies
pip install -r requirements.txt
Example Code
Fill the folder music with songs. Fill the example list with the song names.
python quick_test.py
Results
Sea of Dreams - Oberhofer
Sky Full of Stars - Coldplay
