Ito diffusion: Connection between backward Kolmogorov equation and stationary distribution











up vote
0
down vote

favorite
1












Suppose we have an Ito diffusion
$$ dX_t = b(X_t)dt + sigma(X_t) dB_t, tag{1}$$
where $dB_t$ is Brownian motion. Also assume we know that this diffusion process converges to a stationary distribution $pi$. I am interested in the quantity
$$u_{infty}(x) = lim_{t rightarrow infty} mathbb E[psi(X_t)] = mathbb E_pi[psi(X)],$$
for some function $psi : mathbb R rightarrow mathbb R$; assuming the expectation exists.



I am wondering if there is a way to connect this quantity with the backward Kolmogorov equation, i.e. define $u(x,t) = mathbb E^x[psi(X_t)]$; then the backward Kolmogorov equation says that $u$ solves
begin{align}
frac{partial u}{partial t} &= mathcal A u, tag{2}\
u(0,x) &= psi(x)
end{align}

where $mathcal A$ is the infitesimal generator for (1).



To me it seems like $u_infty(x)$ should be the stationary solution of (2), so we might be able to set $frac{partial u}{partial t} = 0$ to reduce things to an ODE. But I can't wrap my mind around the boundary conditions that should be in place for this to work, or if I've missed an obvious reason for why this wouldn't work.










share|cite|improve this question


























    up vote
    0
    down vote

    favorite
    1












    Suppose we have an Ito diffusion
    $$ dX_t = b(X_t)dt + sigma(X_t) dB_t, tag{1}$$
    where $dB_t$ is Brownian motion. Also assume we know that this diffusion process converges to a stationary distribution $pi$. I am interested in the quantity
    $$u_{infty}(x) = lim_{t rightarrow infty} mathbb E[psi(X_t)] = mathbb E_pi[psi(X)],$$
    for some function $psi : mathbb R rightarrow mathbb R$; assuming the expectation exists.



    I am wondering if there is a way to connect this quantity with the backward Kolmogorov equation, i.e. define $u(x,t) = mathbb E^x[psi(X_t)]$; then the backward Kolmogorov equation says that $u$ solves
    begin{align}
    frac{partial u}{partial t} &= mathcal A u, tag{2}\
    u(0,x) &= psi(x)
    end{align}

    where $mathcal A$ is the infitesimal generator for (1).



    To me it seems like $u_infty(x)$ should be the stationary solution of (2), so we might be able to set $frac{partial u}{partial t} = 0$ to reduce things to an ODE. But I can't wrap my mind around the boundary conditions that should be in place for this to work, or if I've missed an obvious reason for why this wouldn't work.










    share|cite|improve this question
























      up vote
      0
      down vote

      favorite
      1









      up vote
      0
      down vote

      favorite
      1






      1





      Suppose we have an Ito diffusion
      $$ dX_t = b(X_t)dt + sigma(X_t) dB_t, tag{1}$$
      where $dB_t$ is Brownian motion. Also assume we know that this diffusion process converges to a stationary distribution $pi$. I am interested in the quantity
      $$u_{infty}(x) = lim_{t rightarrow infty} mathbb E[psi(X_t)] = mathbb E_pi[psi(X)],$$
      for some function $psi : mathbb R rightarrow mathbb R$; assuming the expectation exists.



      I am wondering if there is a way to connect this quantity with the backward Kolmogorov equation, i.e. define $u(x,t) = mathbb E^x[psi(X_t)]$; then the backward Kolmogorov equation says that $u$ solves
      begin{align}
      frac{partial u}{partial t} &= mathcal A u, tag{2}\
      u(0,x) &= psi(x)
      end{align}

      where $mathcal A$ is the infitesimal generator for (1).



      To me it seems like $u_infty(x)$ should be the stationary solution of (2), so we might be able to set $frac{partial u}{partial t} = 0$ to reduce things to an ODE. But I can't wrap my mind around the boundary conditions that should be in place for this to work, or if I've missed an obvious reason for why this wouldn't work.










      share|cite|improve this question













      Suppose we have an Ito diffusion
      $$ dX_t = b(X_t)dt + sigma(X_t) dB_t, tag{1}$$
      where $dB_t$ is Brownian motion. Also assume we know that this diffusion process converges to a stationary distribution $pi$. I am interested in the quantity
      $$u_{infty}(x) = lim_{t rightarrow infty} mathbb E[psi(X_t)] = mathbb E_pi[psi(X)],$$
      for some function $psi : mathbb R rightarrow mathbb R$; assuming the expectation exists.



      I am wondering if there is a way to connect this quantity with the backward Kolmogorov equation, i.e. define $u(x,t) = mathbb E^x[psi(X_t)]$; then the backward Kolmogorov equation says that $u$ solves
      begin{align}
      frac{partial u}{partial t} &= mathcal A u, tag{2}\
      u(0,x) &= psi(x)
      end{align}

      where $mathcal A$ is the infitesimal generator for (1).



      To me it seems like $u_infty(x)$ should be the stationary solution of (2), so we might be able to set $frac{partial u}{partial t} = 0$ to reduce things to an ODE. But I can't wrap my mind around the boundary conditions that should be in place for this to work, or if I've missed an obvious reason for why this wouldn't work.







      pde stochastic-processes stationary-processes






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked Nov 14 at 13:00









      Jack

      83




      83






















          1 Answer
          1






          active

          oldest

          votes

















          up vote
          0
          down vote













          The stationary distribution is a time-invariant solution of the Fokker--Planck (forward) equation, which is probably an easier way of looking at it, as it comes out as an exponential-integral (of $b(x)/sigma^2(x)$).






          share|cite|improve this answer





















          • Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
            – Jack
            Nov 14 at 13:31











          Your Answer





          StackExchange.ifUsing("editor", function () {
          return StackExchange.using("mathjaxEditing", function () {
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          });
          });
          }, "mathjax-editing");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "69"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














           

          draft saved


          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2998246%2fito-diffusion-connection-between-backward-kolmogorov-equation-and-stationary-di%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          up vote
          0
          down vote













          The stationary distribution is a time-invariant solution of the Fokker--Planck (forward) equation, which is probably an easier way of looking at it, as it comes out as an exponential-integral (of $b(x)/sigma^2(x)$).






          share|cite|improve this answer





















          • Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
            – Jack
            Nov 14 at 13:31















          up vote
          0
          down vote













          The stationary distribution is a time-invariant solution of the Fokker--Planck (forward) equation, which is probably an easier way of looking at it, as it comes out as an exponential-integral (of $b(x)/sigma^2(x)$).






          share|cite|improve this answer





















          • Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
            – Jack
            Nov 14 at 13:31













          up vote
          0
          down vote










          up vote
          0
          down vote









          The stationary distribution is a time-invariant solution of the Fokker--Planck (forward) equation, which is probably an easier way of looking at it, as it comes out as an exponential-integral (of $b(x)/sigma^2(x)$).






          share|cite|improve this answer












          The stationary distribution is a time-invariant solution of the Fokker--Planck (forward) equation, which is probably an easier way of looking at it, as it comes out as an exponential-integral (of $b(x)/sigma^2(x)$).







          share|cite|improve this answer












          share|cite|improve this answer



          share|cite|improve this answer










          answered Nov 14 at 13:07









          Richard Martin

          1,5468




          1,5468












          • Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
            – Jack
            Nov 14 at 13:31


















          • Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
            – Jack
            Nov 14 at 13:31
















          Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
          – Jack
          Nov 14 at 13:31




          Thanks, I know but I wondered if this might be a way of getting an expression for the expectation out directly; rather than finding the whole stationary distribution itself.
          – Jack
          Nov 14 at 13:31


















           

          draft saved


          draft discarded



















































           


          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2998246%2fito-diffusion-connection-between-backward-kolmogorov-equation-and-stationary-di%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          How to change which sound is reproduced for terminal bell?

          Title Spacing in Bjornstrup Chapter, Removing Chapter Number From Contents

          Can I use Tabulator js library in my java Spring + Thymeleaf project?