This overall review is mainly based on the first lecture in?Shiyu Zhao's vedio?[1].?During the learning process, I also referred to other materials, mainly including?the corresponding book?Mathematical Foundation of Reinforcement?Learning [2], David Silver's lectures [3], and the code in?Hands-on Reinforcement Learning's?website?[4].

Reference

[1] https://www.bilibili.com/video/BV1sd4y167NS

[2] https://github.com/MathFoundationRL/Book-Mathmatical-Foundation-of-Reinforcement-Learning

[3]?https://www.davidsilver.uk/teaching

[4]?https://hrl.boyuai.com/