Resources for Quickly Learning About Markov Decision Processes

will

p.s if we had to pick favorites or you're short on time

origin of markov chains

PatrickJMT's youtube series on the topic

visual explanation of markov chains

List of Markov Resources

In order of difficulty (beginner - advanced)

A Visual Explanation of Markov Chains by Victor Powell

http://setosa.io/blog/2014/07/26/markov-chains/

Origin of Markov Chains (Part of Khan Academy's Modern Information Theory's Course)

https://www.khanacademy.org/computing/computer-science/informationtheory/moderninfotheory/v/markov_chains

Markov Chains Parts 1-7

https://www.youtube.com/watch?v=uvYTGEZQTEs

Introduction to Markov Processes (a.k.a. Markov Chains)

http://austingwalters.com/introduction-to-markov-processes/

Stanford's Probabilistic Graphical Models Class on Coursera
by Daphne Koller

https://class.coursera.org/pgm-003/lecture

Circuit's of Imagination - Markov Chains

http://blog.circuitsofimagination.com/2015/02/15/Markov-Chains.html

Markov Chain Monte Carlo Sampling