In terms of model architectures, we were able to learn about and implement bidirectional layers, and we got to see its value for learning from sequence data.Spoiler alert: Bidirectional LSTM performs much better than LSTM in terms of in-sample prediction accuracy and output coherenceWe were also surprised by the power of multi-layer perceptrons as our MLP-based generator network using continuous inputs was able to compete with our RNN-based discriminator network trained on discrete data in a short period of time..This continues to prove the extraordinary versatility of MLPs.Finally, this project gave us the opportunity to experiment with reinforcement learning..To us, this method represents an excellent middle ground between supervised and unsupervised learning..Unlike before, we could now obtain the help of a generator AI to lead the model to the ‘correct result’ without the need of a target variable..We’re excited to see the new advances that this type of machine learning will lead to.Our code for this project can be found on Github!ReferencesSigurður Skúli’s blog post — https://towardsdatascience.com/how-to-generate-music-using-a-lstm-neural-network-in-keras-68786834d4c5Brian McMahon’s AI Jukebox — https://medium.com/@cipher813/ai-jukebox-creating-music-with-neural-networks-1d9585c4d649Daniel Johnson’s page on Music Composition with RNNs — http://www.hexahedria.com/2015/08/03/composing-music-with-recurrent-neural-networks/Stanford paper on Music Generation with Deep Learning Networks — https://web.stanford.edu/class/cs224n/reports/2762076.pdfC-RNN-GAN Paper — https://arxiv.org/pdf/1611.09904.pdfFor more reading on GANs, check out these links:A Brief intro to GANs — https://skymind.ai/wiki/generative-adversarial-network-ganA Short PyTorch Tutorial on GANs — https://medium.com/@devnag/generative-adversarial-networks-gans-in-50-lines-of-code-pytorch-e81b79659e3fKeras GAN Library — https://github.com/eriklindernoren/Keras-GANThe GAN Zoo — https://deephunt.in/the-gan-zoo-79597dc8c347Helpful Hints for Training GANs — https://medium.com/@utk.is.here/keep-calm-and-train-a-gan-pitfalls-and-tips-on-training-generative-adversarial-networks-edd529764aa9. More details