Compare commits
10 Commits
05cf4c4dac
...
ef887cbadb
Author | SHA1 | Date | |
---|---|---|---|
|
ef887cbadb | ||
|
0b7adc73c7 | ||
|
4037646efa | ||
|
a48249554c | ||
|
26aa9e4b84 | ||
|
23903ed628 | ||
|
1fb7124b27 | ||
|
5faa9becba | ||
|
0df51ec959 | ||
|
b4f62df3fa |
6
.gitignore
vendored
6
.gitignore
vendored
|
@ -242,4 +242,8 @@ paket-files/
|
||||||
|
|
||||||
# JetBrains Rider
|
# JetBrains Rider
|
||||||
.idea/
|
.idea/
|
||||||
*.sln.iml
|
*.sln.iml
|
||||||
|
|
||||||
|
# Custom
|
||||||
|
media/
|
||||||
|
logs/
|
16
README.md
16
README.md
|
@ -1,9 +1,17 @@
|
||||||
# tfworldhackathon
|
# MusicGAN
|
||||||
GitHub repo for my Tensorflow World hackathon submission
|
**Scored in the Top 10 most innovative artificial intelligence projects in the international TFWorld Hackathon 2020.**
|
||||||
|
|
||||||
[Video demo](https://www.youtube.com/watch?time_continue=2&v=DQDYsJXLqlo&feature=emb_logo)
|
MusicGAN creates 1 second of instrumental audio at 16kHz.
|
||||||
|
|
||||||
To replicate my results, just clone this repo and run `scripts/WGAN-GP.py` after modifying `DATA_DIR`. I used [this](http://deepyeti.ucsd.edu/cdonahue/wavegan/data/mancini_piano.tar.gz) data after converting the files to wave.
|
[Piano demo](https://www.youtube.com/watch?time_continue=2&v=DQDYsJXLqlo&feature=emb_logo)
|
||||||
|
|
||||||
|
[Violin demo](https://www.youtube.com/watch?v=XcESDdsb3PU)
|
||||||
|
|
||||||
|
To create your own MusicGAN, just clone this repo and run `scripts/WGAN-GP.py` after modifying `DATA_DIR` and `INSTRUMENT`. I used [this](http://deepyeti.ucsd.edu/cdonahue/wavegan/data/mancini_piano.tar.gz) data after converting the files to wave. The violin data I used was just scraped from Youtube.
|
||||||
|
|
||||||
|
Training expects a GPU and will take several hours to achieve resonable results. Due to time limitations for the hackathon, I only trained for a few hours, but better results are possible if trained for a longer duration.
|
||||||
|
|
||||||
|
Run `tensorboard --logdir logs/train` to view generator and critic loss with Tensorboard.
|
||||||
|
|
||||||
## Inspiration
|
## Inspiration
|
||||||
Since the inception of generative adversarial networks, I have been fascinated by their capacity to perform tasks of unprecedented complexity. They are a prime example of how machines can learn in a similar manner to humans - akin to reinforcement learning. I am also a huge fan of music and love to play the piano. So I thought, why not conflate my love for machine learning and my passion for music!?
|
Since the inception of generative adversarial networks, I have been fascinated by their capacity to perform tasks of unprecedented complexity. They are a prime example of how machines can learn in a similar manner to humans - akin to reinforcement learning. I am also a huge fan of music and love to play the piano. So I thought, why not conflate my love for machine learning and my passion for music!?
|
||||||
|
|
Binary file not shown.
BIN
models/violin/88.h5
Normal file
BIN
models/violin/88.h5
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard10of19.bin
Normal file
BIN
models/violin/js/group1-shard10of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard11of19.bin
Normal file
BIN
models/violin/js/group1-shard11of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard12of19.bin
Normal file
BIN
models/violin/js/group1-shard12of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard13of19.bin
Normal file
BIN
models/violin/js/group1-shard13of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard14of19.bin
Normal file
BIN
models/violin/js/group1-shard14of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard15of19.bin
Normal file
BIN
models/violin/js/group1-shard15of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard16of19.bin
Normal file
BIN
models/violin/js/group1-shard16of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard17of19.bin
Normal file
BIN
models/violin/js/group1-shard17of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard18of19.bin
Normal file
BIN
models/violin/js/group1-shard18of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard19of19.bin
Normal file
BIN
models/violin/js/group1-shard19of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard1of19.bin
Normal file
BIN
models/violin/js/group1-shard1of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard2of19.bin
Normal file
BIN
models/violin/js/group1-shard2of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard3of19.bin
Normal file
BIN
models/violin/js/group1-shard3of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard4of19.bin
Normal file
BIN
models/violin/js/group1-shard4of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard5of19.bin
Normal file
BIN
models/violin/js/group1-shard5of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard6of19.bin
Normal file
BIN
models/violin/js/group1-shard6of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard7of19.bin
Normal file
BIN
models/violin/js/group1-shard7of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard8of19.bin
Normal file
BIN
models/violin/js/group1-shard8of19.bin
Normal file
Binary file not shown.
BIN
models/violin/js/group1-shard9of19.bin
Normal file
BIN
models/violin/js/group1-shard9of19.bin
Normal file
Binary file not shown.
1
models/violin/js/model.json
Normal file
1
models/violin/js/model.json
Normal file
File diff suppressed because one or more lines are too long
BIN
output/piano/0-1.wav
Normal file
BIN
output/piano/0-1.wav
Normal file
Binary file not shown.
BIN
output/piano/0-2.wav
Normal file
BIN
output/piano/0-2.wav
Normal file
Binary file not shown.
BIN
output/piano/0-3.wav
Normal file
BIN
output/piano/0-3.wav
Normal file
Binary file not shown.
BIN
output/piano/0-4.wav
Normal file
BIN
output/piano/0-4.wav
Normal file
Binary file not shown.
BIN
output/piano/0-5.wav
Normal file
BIN
output/piano/0-5.wav
Normal file
Binary file not shown.
BIN
output/piano/0-6.wav
Normal file
BIN
output/piano/0-6.wav
Normal file
Binary file not shown.
BIN
output/piano/0-7.wav
Normal file
BIN
output/piano/0-7.wav
Normal file
Binary file not shown.
BIN
output/piano/0-8.wav
Normal file
BIN
output/piano/0-8.wav
Normal file
Binary file not shown.
BIN
output/piano/0-9.wav
Normal file
BIN
output/piano/0-9.wav
Normal file
Binary file not shown.
BIN
output/piano/10-0.wav
Normal file
BIN
output/piano/10-0.wav
Normal file
Binary file not shown.
BIN
output/piano/10-1.wav
Normal file
BIN
output/piano/10-1.wav
Normal file
Binary file not shown.
BIN
output/piano/10-2.wav
Normal file
BIN
output/piano/10-2.wav
Normal file
Binary file not shown.
BIN
output/piano/10-3.wav
Normal file
BIN
output/piano/10-3.wav
Normal file
Binary file not shown.
BIN
output/piano/10-4.wav
Normal file
BIN
output/piano/10-4.wav
Normal file
Binary file not shown.
BIN
output/piano/10-5.wav
Normal file
BIN
output/piano/10-5.wav
Normal file
Binary file not shown.
BIN
output/piano/10-6.wav
Normal file
BIN
output/piano/10-6.wav
Normal file
Binary file not shown.
BIN
output/piano/10-7.wav
Normal file
BIN
output/piano/10-7.wav
Normal file
Binary file not shown.
BIN
output/piano/10-8.wav
Normal file
BIN
output/piano/10-8.wav
Normal file
Binary file not shown.
BIN
output/piano/10-9.wav
Normal file
BIN
output/piano/10-9.wav
Normal file
Binary file not shown.
BIN
output/piano/100-1.wav
Normal file
BIN
output/piano/100-1.wav
Normal file
Binary file not shown.
BIN
output/piano/100-2.wav
Normal file
BIN
output/piano/100-2.wav
Normal file
Binary file not shown.
BIN
output/piano/100-3.wav
Normal file
BIN
output/piano/100-3.wav
Normal file
Binary file not shown.
BIN
output/piano/100-4.wav
Normal file
BIN
output/piano/100-4.wav
Normal file
Binary file not shown.
BIN
output/piano/100-5.wav
Normal file
BIN
output/piano/100-5.wav
Normal file
Binary file not shown.
BIN
output/piano/100-6.wav
Normal file
BIN
output/piano/100-6.wav
Normal file
Binary file not shown.
BIN
output/piano/100-7.wav
Normal file
BIN
output/piano/100-7.wav
Normal file
Binary file not shown.
BIN
output/piano/100-8.wav
Normal file
BIN
output/piano/100-8.wav
Normal file
Binary file not shown.
BIN
output/piano/100-9.wav
Normal file
BIN
output/piano/100-9.wav
Normal file
Binary file not shown.
BIN
output/piano/102-0.wav
Normal file
BIN
output/piano/102-0.wav
Normal file
Binary file not shown.
BIN
output/piano/102-1.wav
Normal file
BIN
output/piano/102-1.wav
Normal file
Binary file not shown.
BIN
output/piano/102-2.wav
Normal file
BIN
output/piano/102-2.wav
Normal file
Binary file not shown.
BIN
output/piano/102-3.wav
Normal file
BIN
output/piano/102-3.wav
Normal file
Binary file not shown.
BIN
output/piano/102-4.wav
Normal file
BIN
output/piano/102-4.wav
Normal file
Binary file not shown.
BIN
output/piano/102-5.wav
Normal file
BIN
output/piano/102-5.wav
Normal file
Binary file not shown.
BIN
output/piano/102-6.wav
Normal file
BIN
output/piano/102-6.wav
Normal file
Binary file not shown.
BIN
output/piano/102-7.wav
Normal file
BIN
output/piano/102-7.wav
Normal file
Binary file not shown.
BIN
output/piano/102-8.wav
Normal file
BIN
output/piano/102-8.wav
Normal file
Binary file not shown.
BIN
output/piano/102-9.wav
Normal file
BIN
output/piano/102-9.wav
Normal file
Binary file not shown.
BIN
output/piano/104-1.wav
Normal file
BIN
output/piano/104-1.wav
Normal file
Binary file not shown.
BIN
output/piano/104-2.wav
Normal file
BIN
output/piano/104-2.wav
Normal file
Binary file not shown.
BIN
output/piano/104-3.wav
Normal file
BIN
output/piano/104-3.wav
Normal file
Binary file not shown.
BIN
output/piano/104-4.wav
Normal file
BIN
output/piano/104-4.wav
Normal file
Binary file not shown.
BIN
output/piano/104-5.wav
Normal file
BIN
output/piano/104-5.wav
Normal file
Binary file not shown.
BIN
output/piano/104-6.wav
Normal file
BIN
output/piano/104-6.wav
Normal file
Binary file not shown.
BIN
output/piano/104-7.wav
Normal file
BIN
output/piano/104-7.wav
Normal file
Binary file not shown.
BIN
output/piano/104-8.wav
Normal file
BIN
output/piano/104-8.wav
Normal file
Binary file not shown.
BIN
output/piano/104-9.wav
Normal file
BIN
output/piano/104-9.wav
Normal file
Binary file not shown.
BIN
output/piano/106-0.wav
Normal file
BIN
output/piano/106-0.wav
Normal file
Binary file not shown.
BIN
output/piano/106-1.wav
Normal file
BIN
output/piano/106-1.wav
Normal file
Binary file not shown.
BIN
output/piano/106-2.wav
Normal file
BIN
output/piano/106-2.wav
Normal file
Binary file not shown.
BIN
output/piano/106-3.wav
Normal file
BIN
output/piano/106-3.wav
Normal file
Binary file not shown.
BIN
output/piano/106-4.wav
Normal file
BIN
output/piano/106-4.wav
Normal file
Binary file not shown.
BIN
output/piano/106-5.wav
Normal file
BIN
output/piano/106-5.wav
Normal file
Binary file not shown.
BIN
output/piano/106-6.wav
Normal file
BIN
output/piano/106-6.wav
Normal file
Binary file not shown.
BIN
output/piano/106-7.wav
Normal file
BIN
output/piano/106-7.wav
Normal file
Binary file not shown.
Some files were not shown because too many files have changed in this diff Show More
Loading…
Reference in New Issue
Block a user