Does the limit distribution not exist?
up vote
0
down vote
favorite
Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:
$$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$
This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:
$$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$
So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.
stochastic-processes markov-chains
add a comment |
up vote
0
down vote
favorite
Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:
$$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$
This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:
$$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$
So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.
stochastic-processes markov-chains
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:
$$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$
This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:
$$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$
So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.
stochastic-processes markov-chains
Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:
$$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$
This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:
$$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$
So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.
stochastic-processes markov-chains
stochastic-processes markov-chains
asked 13 hours ago
AstlyDichrar
36417
36417
add a comment |
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2995430%2fdoes-the-limit-distribution-not-exist%23new-answer', 'question_page');
}
);
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password