Domain of Attraction of the Quasistationary Distribution for Birth-and-Death Processes

2013 ◽  
Vol 50 (01) ◽  
pp. 114-126 ◽  
Author(s):  
Hanjun Zhang ◽  
Yixia Zhu

We consider a birth–death process {X(t),t≥0} on the positive integers for which the origin is an absorbing state with birth coefficients λ n ,n≥0, and death coefficients μ n ,n≥0. If we define A=∑ n=1 ∞ 1/λ n π n and S=∑ n=1 ∞ (1/λ n π n )∑ i=n+1 ∞ π i , where {π n ,n≥1} are the potential coefficients, it is a well-known fact (see van Doorn (1991)) that if A=∞ and S<∞, then λ C >0 and there is precisely one quasistationary distribution, namely, {a j (λ C )}, where λ C is the decay parameter of {X(t),t≥0} in C={1,2,...} and a j (x)≡μ1 -1π j xQ j (x), j=1,2,.... In this paper we prove that there is a unique quasistationary distribution that attracts all initial distributions supported in C, if and only if the birth–death process {X(t),t≥0} satisfies bothA=∞ and S<∞. That is, for any probability measure M={m i , i=1,2,...}, we have lim t→∞ℙ M (X(t)=j∣ T>t)= a j (λ C ), j=1,2,..., where T=inf{t≥0 : X(t)=0} is the extinction time of {X(t),t≥0} if and only if the birth–death process {X(t),t≥0} satisfies both A=∞ and S<∞.

2013 ◽  
Vol 50 (1) ◽  
pp. 114-126 ◽  
Author(s):  
Hanjun Zhang ◽  
Yixia Zhu

We consider a birth–death process {X(t),t≥0} on the positive integers for which the origin is an absorbing state with birth coefficients λn,n≥0, and death coefficients μn,n≥0. If we define A=∑n=1∞ 1/λnπn and S=∑n=1∞ (1/λnπn)∑i=n+1∞ πi, where {πn,n≥1} are the potential coefficients, it is a well-known fact (see van Doorn (1991)) that if A=∞ and S<∞, then λC>0 and there is precisely one quasistationary distribution, namely, {aj(λC)}, where λC is the decay parameter of {X(t),t≥0} in C={1,2,...} and aj(x)≡μ1-1πjxQj(x), j=1,2,.... In this paper we prove that there is a unique quasistationary distribution that attracts all initial distributions supported in C, if and only if the birth–death process {X(t),t≥0} satisfies bothA=∞ and S<∞. That is, for any probability measure M={mi, i=1,2,...}, we have limt→∞ℙM(X(t)=j∣ T>t)= aj(λC), j=1,2,..., where T=inf{t≥0 : X(t)=0} is the extinction time of {X(t),t≥0} if and only if the birth–death process {X(t),t≥0} satisfies both A=∞ and S<∞.


2003 ◽  
Vol 40 (3) ◽  
pp. 821-825 ◽  
Author(s):  
Damian Clancy ◽  
Philip K. Pollett

For Markov processes on the positive integers with the origin as an absorbing state, Ferrari, Kesten, Martínez and Picco studied the existence of quasi-stationary and limiting conditional distributions by characterizing quasi-stationary distributions as fixed points of a transformation Φ on the space of probability distributions on {1, 2, …}. In the case of a birth–death process, the components of Φ(ν) can be written down explicitly for any given distribution ν. Using this explicit representation, we will show that Φ preserves likelihood ratio ordering between distributions. A conjecture of Kryscio and Lefèvre concerning the quasi-stationary distribution of the SIS logistic epidemic follows as a corollary.


2015 ◽  
Vol 52 (1) ◽  
pp. 278-289 ◽  
Author(s):  
Erik A. van Doorn

We study the decay parameter (the rate of convergence of the transition probabilities) of a birth-death process on {0, 1, …}, which we allow to evanesce by escape, via state 0, to an absorbing state -1. Our main results are representations for the decay parameter under four different scenarios, derived from a unified perspective involving the orthogonal polynomials appearing in Karlin and McGregor's representation for the transition probabilities of a birth-death process, and the Courant-Fischer theorem on eigenvalues of a symmetric matrix. We also show how the representations readily yield some upper and lower bounds that have appeared in the literature.


1991 ◽  
Vol 23 (4) ◽  
pp. 683-700 ◽  
Author(s):  
Erik A. Van Doorn

For a birth–death process (X(t), ) on the state space {−1, 0, 1, ·· ·}, where −1 is an absorbing state which is reached with certainty and {0, 1, ·· ·} is an irreducible class, we address and solve three problems. First, we determine the set of quasi-stationary distributions of the process, that is, the set of initial distributions which are such that the distribution of X(t), conditioned on non-absorption up to time t, is independent of t. Secondly, we determine the quasi-limiting distribution of X(t), that is, the limit as t→∞ of the distribution of X(t), conditioned on non-absorption up to time t, for any initial distribution with finite support. Thirdly, we determine the rate of convergence of the transition probabilities of X(t), conditioned on non-absorption up to time t, to their limits. Some examples conclude the paper. Our main tools are the spectral representation for the transition probabilities of a birth–death process and a duality concept for birth–death processes.


2015 ◽  
Vol 52 (01) ◽  
pp. 278-289 ◽  
Author(s):  
Erik A. van Doorn

We study the decay parameter (the rate of convergence of the transition probabilities) of a birth-death process on {0, 1, …}, which we allow to evanesce by escape, via state 0, to an absorbing state -1. Our main results are representations for the decay parameter under four different scenarios, derived from a unified perspective involving the orthogonal polynomials appearing in Karlin and McGregor's representation for the transition probabilities of a birth-death process, and the Courant-Fischer theorem on eigenvalues of a symmetric matrix. We also show how the representations readily yield some upper and lower bounds that have appeared in the literature.


2003 ◽  
Vol 40 (03) ◽  
pp. 821-825 ◽  
Author(s):  
Damian Clancy ◽  
Philip K. Pollett

For Markov processes on the positive integers with the origin as an absorbing state, Ferrari, Kesten, Martínez and Picco studied the existence of quasi-stationary and limiting conditional distributions by characterizing quasi-stationary distributions as fixed points of a transformation Φ on the space of probability distributions on {1, 2, …}. In the case of a birth–death process, the components of Φ(ν) can be written down explicitly for any given distributionν. Using this explicit representation, we will show that Φ preserves likelihood ratio ordering between distributions. A conjecture of Kryscio and Lefèvre concerning the quasi-stationary distribution of the SIS logistic epidemic follows as a corollary.


1991 ◽  
Vol 23 (04) ◽  
pp. 683-700 ◽  
Author(s):  
Erik A. Van Doorn

For a birth–death process (X(t), ) on the state space {−1, 0, 1, ·· ·}, where −1 is an absorbing state which is reached with certainty and {0, 1, ·· ·} is an irreducible class, we address and solve three problems. First, we determine the set of quasi-stationary distributions of the process, that is, the set of initial distributions which are such that the distribution of X(t), conditioned on non-absorption up to time t, is independent of t. Secondly, we determine the quasi-limiting distribution of X(t), that is, the limit as t→∞ of the distribution of X(t), conditioned on non-absorption up to time t, for any initial distribution with finite support. Thirdly, we determine the rate of convergence of the transition probabilities of X(t), conditioned on non-absorption up to time t, to their limits. Some examples conclude the paper. Our main tools are the spectral representation for the transition probabilities of a birth–death process and a duality concept for birth–death processes.


2005 ◽  
Vol 42 (01) ◽  
pp. 185-198 ◽  
Author(s):  
Erik A. Van Doorn ◽  
Alexander I. Zeifman

We study birth-death processes on the nonnegative integers, where {1, 2,…} is an irreducible class and 0 an absorbing state, with the additional feature that a transition to state 0 may occur from any state. We give a condition for absorption (extinction) to be certain and obtain the eventual absorption probabilities when absorption is not certain. We also study the rate of convergence, as t → ∞, of the probability of absorption at time t, and relate it to the common rate of convergence of the transition probabilities that do not involve state 0. Finally, we derive upper and lower bounds for the probability of absorption at time t by applying a technique that involves the logarithmic norm of an appropriately defined operator.


1992 ◽  
Vol 29 (4) ◽  
pp. 781-791 ◽  
Author(s):  
Masaaki Kijima

Let N(t) be an exponentially ergodic birth-death process on the state space {0, 1, 2, ···} governed by the parameters {λn, μn}, where µ0 = 0, such that λn = λ and μn = μ for all n ≧ N, N ≧ 1, with λ < μ. In this paper, we develop an algorithm to determine the decay parameter of such a specialized exponentially ergodic birth-death process, based on van Doorn's representation (1987) of eigenvalues of sign-symmetric tridiagonal matrices. The decay parameter is important since it is indicative of the speed of convergence to ergodicity. Some comparability results for the decay parameters are given, followed by the discussion for the decay parameter of a birth-death process governed by the parameters such that limn→∞λn = λ and limn→∞µn = μ. The algorithm is also shown to be a useful tool to determine the quasi-stationary distribution, i.e. the limiting distribution conditioned to stay in {1, 2, ···}, of such specialized birth-death processes.


2005 ◽  
Vol 42 (1) ◽  
pp. 185-198 ◽  
Author(s):  
Erik A. Van Doorn ◽  
Alexander I. Zeifman

We study birth-death processes on the nonnegative integers, where {1, 2,…} is an irreducible class and 0 an absorbing state, with the additional feature that a transition to state 0 may occur from any state. We give a condition for absorption (extinction) to be certain and obtain the eventual absorption probabilities when absorption is not certain. We also study the rate of convergence, as t → ∞, of the probability of absorption at time t, and relate it to the common rate of convergence of the transition probabilities that do not involve state 0. Finally, we derive upper and lower bounds for the probability of absorption at time t by applying a technique that involves the logarithmic norm of an appropriately defined operator.


Sign in / Sign up

Export Citation Format

Share Document