Exercises to help learn material from the Deep Learning Book.
If deep learning seems interesting to you, I would checkout this video series by 3Blue1Brown which covers neural networks. If this is something that you would like to learn how to implement on your own, this may be a good place to start.
I highly recommend you have a firm understanding of linear algebra and part 1 of the text before you continue on to the more exciting chapters. While reading chapter 7 (regularization) I had to stop and refresh with the Khan Academy Linear Algebra Course.
It may be useful to have multivariable calculus under your belt. I have not taken this course, but it comes up frequently throughout the Deep Learning Book. Check out the Khan Academy Multivariable Calculus Course.
The overarching objective of this project is to gain a deeper understanding of deep learning.
All of the exercises that I attempt in this project will be done from scratch with guidance as needed from various textbooks and tutorials. Resources used to facilitate exercises will be listed in the exercises readme. If a resource is used more than once I will most likely put them in this readme.
There is no strict path for projects, but I will tend to follow the chapters in the main text. Below is a rough idea of how I plan to complete this project. All of the unfinished exercises are subject to change.
| Material | Type | Completed? |
|---|---|---|
| Part 1 | Reading | Yes |
| Ch. 6 (Deep Feedforward Networks) | Reading | Yes |
| XOR NN | Exercise | Yes |
| MNIST NN | Exrecise | Yes |
| Ch. 7 (Regularization) | Reading | In Progress |
| Ch. 8 (Optimization) | Reading | No |
| Ch. 9 (CNNs) | Reading | No |
| MNIST CNN | Exercise | No |
| CIFAR-10 CNN | Exercise | No |
| Ch. 10 (RNNs) | Reading | No |
| Next Word RNN | Exercise | No |
| Next Word LSTM | Exercise | No |
| Chatbot RNN | Exercise | No |
| Chatbot LSTM | Exercise | No |
- Convolutional Neural Network on MNIST
- Convolutional Neural Network on CIFAR-10
- Recurrent Neural Network to predict next word in a sentence
- Long Short-Term Memory to predict next word in a sentence
- Recurrent Neural Network chatbot
- Long Short-Term Memory chatbot