What kind of matrix is this and why does this happen?

This is a periodic Markov chain (with period $2$). Otherwise, there's not much that's terribly unusual about it.


User "Iwillnotexist Idonotexist" raised an important point in the comments:

Well, something that can be noted for periodic Markov chains is that by definition they cannot be ergodic, another very important property of MCs that you may encounter soon. Roughly speaking, an ergodic MC that runs long enough "forgets" everything about its initial state. If the MC is periodic, then clearly you must remember some information about the contents of the initial state, because you're stuck in a loop of states that you keep on coming back to and aren't forgetting.


Notice that your matrix $$\begin{align*}P=\left( \begin{array}{ccccc} 0 & \frac{1}{4} & \frac{3}{4} & 0 & 0\\ \frac{1}{4} & 0 & 0 & \frac{1}{4} & \frac{1}{2}\\ \frac{1}{2} & 0 & 0 & \frac{1}{4}& \frac{1}{4}\\ 0 & \frac{1}{4} & \frac{3}{4} & 0& 0\\ 0 & \frac{1}{4} & \frac{3}{4} & 0& 0\\ \end{array} \right).\end{align*}$$

has a special block decomposition as

$$ P=\begin {pmatrix} 0&A &0\\B&0&C\\0&D&0\end{pmatrix}$$

Where A,B,C,D are non zero submatrices.

To find $P^2$ we use the new form to get

$$ P^2 = \begin {pmatrix} 0&A &0\\B&0&C\\0&D&0\end{pmatrix}\begin {pmatrix} 0&A &0\\B&0&C\\0&D&0\end{pmatrix}=\begin {pmatrix} AB&0 &AC\\0&BA+CD&0\\DB&0&DC\end{pmatrix} $$

As you know we can find powers of P by multiplying the new form of P as many times as we wish.

The alternating repeating form of powers of P is due to the block decomposition form of P.


It is a matrix such that $P^4= P^2$ and some additional relations. We see that

$$ 0 = P^4 - P^2 = P^2(P^2 - I) = P^2(P-I)(P+I)$$

so the minimal polynomial $\mu_P(x)$ divides $x^2(x-1)(x+1)$.

However, the minimal polynomial is not any of $$x, x^2, x-1, x+1, \underbrace{x(x-1)}_{P^2 \ne P}, \underbrace{x(x+1)}_{P^2 \ne -P}, \underbrace{x^2(x-1)}_{P^3 \ne P^2}, \underbrace{x^2(x-1)}_{P^3 \ne -P^2}, \underbrace{(x-1)(x+1)}_{P^2 \ne I}, \underbrace{x(x-1)(x+1)}_{P^3 \ne P}$$ so it has to be precisely $x^2(x-1)(x+1)$.

The possibilities for the Jordan normal form of $P$ are:

$$\pmatrix{0 & 1 & 0 & 0 & 0\\ 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 1 & 0 & 0 \\ 0 & 0 & 0 & -1 & 0 \\ 0 & 0 & 0 & 0 & 0}, \pmatrix{0 & 1 & 0 & 0 & 0\\ 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 1 & 0 & 0 \\ 0 & 0 & 0 & -1 & 0 \\ 0 & 0 & 0 & 0 & 1}, \pmatrix{0 & 1 & 0 & 0 & 0\\ 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 1 & 0 & 0 \\ 0 & 0 & 0 & -1 & 0 \\ 0 & 0 & 0 & 0 & -1}$$

meaning $5 \times 5$ matrices have the above properties if and only if they are similar to one of the three matrices above.

Tags:

Matrices