Resource page for sequential decision problems
Warren Powell
I have created a resource page of my “greatest hits” of information on sequential decision problems at:
It includes links with information on the following topics:
o Introduction to the fields of sequential decision problems
o Books
o Courses and teaching materials
o Short notes about sequential decision analytics
o Some video introductions
I provide both the tinyurl links (please use this when you can because it helps me know what is popular) as well as the original link (for people who cannot use tinyurl links). If you cannot use tinyurl links, you can access the page at
https://castlelab.princeton.edu/sdalinks
Please bookmark this page. I will continue to post additional material here (and drop less popular material).
Remember - every reinforcement learning problem is a sequential decision problem. Every RL method falls in one of the four classes of policies.