Discrete-Time Finite-State Markov Chains