Does the limit distribution not exist?











up vote
0
down vote

favorite












Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:



$$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$



This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:



$$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$



So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.










share|cite|improve this question


























    up vote
    0
    down vote

    favorite












    Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:



    $$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$



    This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:



    $$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$



    So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.










    share|cite|improve this question
























      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:



      $$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$



      This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:



      $$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$



      So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.










      share|cite|improve this question













      Consider the Markov chain with state space $S = {1,2,3,4}$ and one-step probability transition matrix $M$:



      $$M = begin{bmatrix}0 & frac12 & 0 & frac12 \ frac13 & frac13 & frac13 & 0 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix}$$



      This Markov chain clearly does not have unique stationary distribution, as $pi_1=begin{bmatrix}0 & 0 & 1 & 0end{bmatrix}$ and $pi_2=begin{bmatrix}0 & 0 & 0 & 1end{bmatrix}$ are two stationary distributions for the chain. What can we say about the limit distribution for this chain? The definition in Parzen's book states that "a chain is said to possess a long-run distribution if for every $j,kin S$ we have $lim_{ntoinfty}p_{j,k}(n)=pi_k$. I calculated $M^n$ for big $n$ values using MATLAB, and we get something like this:



      $$M^n to begin{bmatrix}0 & 0 & frac13 & frac23 \ 0 & 0 & frac23 & frac13 \ 0 & 0 & 1 & 0 \ 0 & 0 & 0 & 1end{bmatrix} text{as } ntoinfty$$



      So by the definition stated above the chain doesn't have a limit distribution? It all seems somewhat confusing.







      stochastic-processes markov-chains






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked 13 hours ago









      AstlyDichrar

      36417




      36417



























          active

          oldest

          votes











          Your Answer





          StackExchange.ifUsing("editor", function () {
          return StackExchange.using("mathjaxEditing", function () {
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          });
          });
          }, "mathjax-editing");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "69"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














           

          draft saved


          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2995430%2fdoes-the-limit-distribution-not-exist%23new-answer', 'question_page');
          }
          );

          Post as a guest





































          active

          oldest

          votes













          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















           

          draft saved


          draft discarded



















































           


          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2995430%2fdoes-the-limit-distribution-not-exist%23new-answer', 'question_page');
          }
          );

          Post as a guest




















































































          Popular posts from this blog

          How to change which sound is reproduced for terminal bell?

          Title Spacing in Bjornstrup Chapter, Removing Chapter Number From Contents

          Can I use Tabulator js library in my java Spring + Thymeleaf project?