Researched
Markov Chains
Markov's chains (1906) model sequences in which the next state depends only on the present one.
Open in the interactive tree →Markov first proved the law of large numbers for dependent events, and in 1913 he analysed vowel and consonant sequences in Pushkin's Eugene Onegin. Markov models drive PageRank, speech recognition, reinforcement learning and Monte Carlo simulation.
Prerequisites
Unlocks
- Monte Carlo Methods1949
- Learning by reward: TD-Gammon1992Reinforcement learning is built on Markov decision processes
- Web search and PageRank1998PageRank is the stationary distribution of a Markov chain