Explores Markov decision processes, model-free policy evaluation and control, reinforcement learning with function approximation and Deep RL, policy search techniques, exploration strategies, Offline RL applications, and advanced topics.