Limit of power of Markov matrix

This a problem which is probably intended to be solved using Markov chains. I will assume you have a basic knowledge of the subject.


Suppose $(X_n)_{n\in\mathbb{N}}$ is a homogenous markov chain with transition matrix given by $$P=\begin{pmatrix} p & q & r\\ q & r & p\\ r & p & q \end{pmatrix}$$ where $p+q+r=1$ and $p,q,r>0$. Then, clearly, the chain is irreducible and ergodic.

Ergodic theorem: If $(X_n)_{n\in\mathbb{N}}$ is an irreducible and ergodic Markov chain, then, it admits a unique stationnary distribution which satisfies $$\pi_j=\lim_{n\to \infty} p_{i,j}^{(n)}\qquad \forall i,j.$$

Solving the equation $\pi P=\pi$ for your chain gives $$\pi=(1/3,1/3,1/3)$$ and thus, by the cited theorem, $$\lim_{n\to \infty} P^{(n)}=\begin{pmatrix} \pi_1 & \pi_2 & \pi_3\\ \pi_1 & \pi_2 & \pi_3\\ \pi_1 & \pi_2 & \pi_3 \end{pmatrix}=\begin{pmatrix} 1/3 & 1/3 & 1/3\\ 1/3 & 1/3 & 1/3\\ 1/3 & 1/3 & 1/3 \end{pmatrix}$$ which is the result we were looking for.


Let $$ \sigma = p^2 + q^2 + r^2 - qr - rp - pq = \frac{1}{2} \left( (q-r)^2 + (r-p)^2 + (p-q)^2 \right) \geq 0. $$ Note $ \sigma = (p+q+r) \sigma = p^3 + q^3 + r^3 - 3 pqr.$ Which is why the characteristic polynomial of your matrix is $$ \lambda^3 - \lambda^2 - \sigma \lambda + \sigma = (\lambda - 1)(\lambda^2 - \sigma) $$ On the other hand $$ 1 = p^2 + q^2 + r^2 +2 qr +2 rp +2 pq, $$ so $$ \sigma = 1 - 3 (qr + rp + pq) < 1. $$ The eigenvalues are $1, \sqrt \sigma, -\sqrt \sigma.$ The diagonalized matrix $ D = P^T MP$ (where $P$ is orthogonal) raised to an arbitrarily large power, converges to the diagonal matrix with entries $1,0,0.$ Reverse the diagonalization, we get a symmetric rank one matrix.. give me a minute

Where was I? $$ P = \left( \begin{array}{rr} \frac{1}{\sqrt 3} & a & b \\ \frac{1}{\sqrt 3} & c & d \\ \frac{1}{\sqrt 3} & e & f \end{array} \right) $$ $$ D_\infty = \left( \begin{array}{rr} 1 & 0 & 0 \\ 0 & 0 & 0 \\ 0 & 0 & 0 \end{array} \right) $$ We then just multiply out $$ M_\infty = P D_\infty P^T = \left( \begin{array}{rr} \frac{1}{ 3} & \frac{1}{ 3} & \frac{1}{ 3} \\ \frac{1}{ 3} & \frac{1}{ 3} & \frac{1}{ 3} \\ \frac{1}{ 3} & \frac{1}{ 3} & \frac{1}{ 3} \end{array} \right) $$


firstly we note that all even powers of $M$ lie within a two-dimensional subalgebra whose members we denote $A(x,y)$ with $x,y \in \mathbb{R}$, since $$ M^2 = \begin{pmatrix} x_2 & y_2 & y_2 \\ y_2 & x_2 & y_2 \\ y_2 & y_2 & x_2 \end{pmatrix} = A(x_2,y_2) $$ where $$ x_2=p^2+q^2+r^2 $$ and $$ y_2 = pq+qr+rp $$ with $$ x_2+2y_2 = (p+q+r)^2 =1 $$ for subsequent squarings (of $M$) we will have: $$ x_{2^{n+1}} = x_{2^n}^2+2y_{2^n}^2 \\ y_{2^{n+1}} = 2x_{2^n}y_n+y_{2^n}^2 $$ from which we have: $$ x_{2^{n+1}}+ 2y_{2^{n+1}} = (x_{2^n}+ 2y_{2^n})^2 = 1\tag{1} $$ and $$ x_{2^{n+1}}-y_{2^{n+1}} = (x_{2^n}-y_{2^n})^2 = \lambda^{2^n} \tag{2} $$ where $0 \le \lambda = x_2-y_2 \lt 1$

it is easily verified that if $$ A(X,Y) = A(x,y)A(x',y') $$ then $$ X-Y = (x-y)(x'-y') $$ any even number $2N$ may be written $$ 2N = \sum_{k=1} a_k2^k $$ with $a_k \in \{0,1\}$ so $$ M^{2N} = \prod_{a_k=1} M^{2k} $$ so, using (2) $$ x_{2N}-y_{2N} = \lambda^N $$ this shows that the subsequence $M^2,M^4,M^6,\dots$ converges to $A(\frac13,\frac13)$# to deal with the odd powers we note that $$ M^{2N+1} = M(M^{2N}) = M\bigg(A(\frac13,\frac13) + \frac13\lambda^N A(2,-1)\bigg) = A(\frac13,\frac13) +O(\lambda^N) $$