Recurrence conditions for Markov decision processes with Borel state space: A survey

Onésimo Hernández-Lerma; RaÚl Montes-De-Oca; Rolando Cavazos-Cadena

doi:10.1007/bf02055573

Recurrence conditions for Markov decision processes with Borel state space: A survey

Annals of Operations Research ◽

10.1007/bf02055573 ◽

1991 ◽

Vol 28 (1) ◽

pp. 29-46 ◽

Cited By ~ 28

Author(s):

Onésimo Hernández-Lerma ◽

RaÚl Montes-De-Oca ◽

Rolando Cavazos-Cadena

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Borel State Space ◽

Markov Decision

Download Full-text

Sensitive Criteria in Markov Decision Processes with a Borel State Space

Operations Research Proceedings - Operations Research Proceedings 1994 ◽

10.1007/978-3-642-79459-9_45 ◽

1995 ◽

pp. 250-254

Author(s):

Alexander Yushkevich

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Borel State Space ◽

Markov Decision

Download Full-text

Discrete type shock semi-markov decision processes with borel state space

Optimization ◽

10.1080/02331939408843929 ◽

1994 ◽

Vol 28 (3-4) ◽

pp. 367-382

Author(s):

Qiying. Hu

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Borel State Space ◽

Markov Decision ◽

Discrete Type

Download Full-text

Nonhomogeneous Markov Decision Processes with Borel State Space—The Average Criterion with Nonuniformly Bounded Rewards

Mathematics of Operations Research ◽

10.1287/moor.25.4.667.12119 ◽

2000 ◽

Vol 25 (4) ◽

pp. 667-678 ◽

Cited By ~ 10

Author(s):

Xianping Guo ◽

Jianyong Liu ◽

Ke Liu

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Borel State Space ◽

Average Criterion ◽

Markov Decision

Download Full-text

Blackwell optimality in Markov decision processes with a Borel state space

Proceedings of the 36th IEEE Conference on Decision and Control ◽

10.1109/cdc.1997.657841 ◽

2002 ◽

Cited By ~ 1

Author(s):

A.A. Yushkevich

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Borel State Space ◽

Blackwell Optimality ◽

Markov Decision

Download Full-text

Semiparametric Estimation of Markov Decision Processes with Continuous State Space

SSRN Electronic Journal ◽

10.2139/ssrn.1654335 ◽

2010 ◽

Cited By ~ 1

Author(s):

Sorawoot Srisuma ◽

Oliver B. Linton

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Semiparametric Estimation ◽

Decision Processes ◽

Continuous State Space ◽

Continuous State ◽

Markov Decision

Download Full-text

Extreme point characterization of constrained nonstationary infinite-horizon Markov decision processes with finite state space

Operations Research Letters ◽

10.1016/j.orl.2014.03.001 ◽

2014 ◽

Vol 42 (3) ◽

pp. 238-245

Author(s):

Ilbin Lee ◽

Marina A. Epelman ◽

H. Edwin Romeijn ◽

Robert L. Smith

Keyword(s):

State Space ◽

Extreme Point ◽

Markov Decision Processes ◽

Infinite Horizon ◽

Decision Processes ◽

Finite State ◽

Markov Decision ◽

Finite State Space

Download Full-text

The policy iteration algorithm for average reward Markov decision processes with general state space

IEEE Transactions on Automatic Control ◽

10.1109/9.650016 ◽

1997 ◽

Vol 42 (12) ◽

pp. 1663-1680 ◽

Cited By ~ 81

Author(s):

S.P. Meyn

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Policy Iteration ◽

Decision Processes ◽

Iteration Algorithm ◽

General State ◽

Average Reward ◽

Markov Decision ◽

Policy Iteration Algorithm ◽

General State Space

Download Full-text

The Optimal Observability of Partially Observable Markov Decision Processes: Discrete State Space

IEEE Transactions on Automatic Control ◽

10.1109/tac.2010.2074231 ◽

2010 ◽

Vol 55 (12) ◽

pp. 2793-2798 ◽

Cited By ~ 2

Author(s):

Mohammad Rezaeian ◽

Ba-Ngu Vo ◽

Jamie Scott Evans

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Discrete State ◽

Markov Decision ◽

Partially Observable Markov ◽

Partially Observable ◽

Discrete State Space

Download Full-text

Semiparametric estimation of Markov decision processes with continuous state space

Journal of Econometrics ◽

10.1016/j.jeconom.2011.10.003 ◽

2012 ◽

Vol 166 (2) ◽

pp. 320-341 ◽

Cited By ~ 16

Author(s):

Sorawoot Srisuma ◽

Oliver Linton

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Semiparametric Estimation ◽

Decision Processes ◽

Continuous State Space ◽

Continuous State ◽

Markov Decision

Download Full-text

A Semi-Markov Decision Processes Modeling Algorithm for Continuous State Space Environments Using k-Certainty Exploration Method and Fuzzy-ART

TRANSACTIONS OF THE JAPAN SOCIETY OF MECHANICAL ENGINEERS Series C ◽

10.1299/kikaic.71.896 ◽

2005 ◽

Vol 71 (703) ◽

pp. 896-903 ◽

Cited By ~ 1

Author(s):

Takeshi TATEYAMA ◽

Seiichi KAWATA

Keyword(s):

State Space ◽

Markov Decision Processes ◽

Decision Processes ◽

Fuzzy Art ◽

Continuous State Space ◽

Continuous State ◽

Markov Decision ◽

Space Environments ◽

Modeling Algorithm

Download Full-text