Markov Chains and Invariant Probabilities