Materials

• Lecture slides
• Our videos (russian) - lecture, seminar, recap on LSTM
• Stanford nlp videos: N-gram language models, neural language models

Practice

As usual, ./seminar.ipynb and ./homework.ipynb awaits you :)

Training RNN-LM:

How to generate text using N-gram LM:

More materials

• CS231 lecture on RNNs - video (english)
• A more detailed lecture by Y. Bengio - video
• Great reading by A. Karpathy - http://karpathy.github.io/2015/05/21/rnn-effectiveness/
• LSTM explained in detail by colah - http://colah.github.io/posts/2015-08-Understanding-LSTMs/
• "Awesome rnn" entry point - https://github.com/kjw0612/awesome-rnn