Shiksha Nation
Skip to content

Markov renewal process

  • 1 min read
  • 2 chapters

Related on Lably

Through Stochastic process

Definition

In the context of a jump process that takes states in a state space S, consider the set of random variables (Xn,Tn), where Tn represents the jump times and Xn represents the associated states in the sequence of states (see Figure). Let the sequence of inter-arrival times τn=Tn−Tn−1. In order for the sequence (Xn,Tn) to be considered a Markov renewal process the following condition should hold:

Pr(τn+1≤t,Xn+1=j∣(X0,T0),(X1,T1),…,(Xn=i,Tn))=Pr(τn+1≤t,Xn+1=j∣Xn=i)∀n≥1,t≥0,i,j∈S

Sign up free to read the rest

One more chapter is free with a Lably account.

Already have an account?

More in Statistics