• Why Recurrent Neural Networks (RNNs)?? • The Vanilla RNN unit? • The RNN forward pass? • Backpropagation refresher? • The RNN backward pass? • Issues with the Vanilla RNN? • The Long Short-Term Memory (LSTM) unit? • The LSTM Forward & Backward pas