Markov chain
From Cohen Courses
Jump to navigationJump to search
From Wikipedia:
A Markov chain is a mathematical system that transits from one state to another (out of a finite or countable number of possible states) in a chainlike manner. It is a random process endowed with the Markov property: that the next state depends only on the current state and not on the past. Markov chains have many applications as statistical models of real-world processes.
