syllabus.md · 李梦凡/berkeley-stat-157

# Syllabus

This class provides a practical introduction to deep learning, including theoretical motivations and how to implement it in practice. As part of the course we will cover multilayer perceptrons, backpropagation, automatic differentiation, and stochastic gradient descent. Moreover, we introduce convolutional networks for image processing, starting from the simple LeNet to more recent architectures such as ResNet for highly accurate models. Secondly, we discuss sequence models and recurrent networks, such as LSTMs, GRU, and the attention mechanism. Throughout the course we emphasize efficient implementation, optimization and scalability, e.g. to multiple GPUs and to multiple machines. The goal of the course is to provide both a good understanding and good ability to build modern nonparametric estimators. The course loosely follows [Dive into Deep Learning](http://d2l.ai) in terms of notebooks, slides and assignments.

| Date | Topics |
|------|--------|
| 1/22 | [Logistics, Software, Linear Algebra](units/introduction.html) |
| 1/24 | [Probability and Statistics (Bayes Rule, Sampling Naive Bayes, Sampling)](units/probability.html) |
| 1/29 | [Gradients, Chain Rule, Automatic differentiation](units/arrays.html) |
| 1/31 | [Linear Regression, Basic Optimization](units/linear.html) |
| 2/5  | [Likelihood, Loss Functions, Logisitic Regression, Information Theory](units/loss.html) |
| 2/7  | [Multilayer Perceptron](units/mlp.html) |
| 2/12 | [Model Selection, Weight Decay, Dropout](units/capacity.html) |
| 2/14 | [Numerical Stability, Hardware](units/dropout.html) |
| 2/19 | [Environment](units/environment.html) |
| 2/21 | [Layers, Parameters, GPUs](units/layers.html) |
| 2/26 | [Convolutional Layers](units/convnet.html)
| 2/28 | [LeNet, AlexNet, VGG, NiN](units/lenet.html) |
| 3/5  | [Project Midterm Presentation](project.html) |
| 3/7  | [Inception, Residual Networks](units/resnet.html) |
| 3/12 | [Computation Performance, Multi-GPU and Multi-Machine Training](units/parallel.html) |
| 3/14 | [Image Augmentation, Fine Turning](units/finetuning.html) |
| 3/19 | Midterm Exam |
| 3/21 | [Object Detection I](units/detection.html) |
| 4/2  | [Object Detection II, CNN Training Tricks](units/detection.html)  |
| 4/4  | [Sequence models and Language](units/sequence.html) |
| 4/9  | [Recurrent neural networks, Making it work - language modeling](units/rnn.html) |
| 4/11 | [Truncated Backprop, Gated Recurrent Unit, Long Short Term Memory](units/rnn.html) |
| 4/16 | [Bi-LSTM, Deep RNNs](units/blstm.html) |
| 4/18 | [Word2vec, FastText, GloVe, Sentiment Analysis](units/word2vec.html) |
| 4/23 | [Encoder-Decoder, Seq2seq, Machine Translation](units/seq2seq.html) |
| 4/25 | [Attention, Transformer, BERT](units/attention.html) |
| 4/30 | [Convex Optimization, Convergence Rate](units/optimization.html) |
| 5/2  | [Momentum, AdaGrad, RMSProp, Adam](units/adam.html) |
| 5/7  | Project Final Presentation |
| 5/9  | Project Final Presentation |

李梦凡/berkeley-stat-157

简介

发行版

贡献者

近期动态

李梦凡/berkeley-stat-157 .gitee-modal { width: 500px !important; }

简介

发行版

贡献者

近期动态

搜索帮助

李梦凡/berkeley-stat-157