AN ANALYTICAL METHOD TO CALCULATE THE ERGODIC AND DIFFERENCE MATRICES OF THE DISCOUNTED MARKOV DECISION PROCESSES



REFERENCES:

1. Altman E., Shwartz A.: Markov Decision Problems and State - Actions
Frequencies,SIAM Journal on Control and Optimization, 29, 1991.

2. Arapostathis A., Borkar V.S., Fernandez-Gaucherand E., Ghosh M.K. and
Marcus S.I.: Discrete -Time Controlled Markov Processes with an Average
Costs Criterion: A Servey. SIAM Journal on Control and Optimization. 31,
1993.

3. Bertsekas P.: Dynamic Programming and Stochastic Control. Acad. Press,
New York,1976.

4. Bewley T., Kohlberg E.: The Asymptotic Theory of Stochasic Games. Ma-
thematics of Oper. Res., 1, 1976.

5. Bewley T., Kohlberg E.: On Stochastic Games with Stationary Optimal
Strategies. Mathematics of Oper. Res., 3, 1978.

6. Breton M., Filar J.A., Haurie A. and Shultz T.A.: On the Computation
of Equilibria in Discounted Stochastic Games. In T. Basar, editor. Dyna-
mics Games and Applications in Economics. Springer - Verlag, Berlin,1985.
Lecture Notes in Economics and Mathematical Systems, 265.

7. Chan L.M.: A Markovian approach to the study of the canadian cattle
industry. Reprint, ser. 162, University Toronto, Canada, 1981.

8. Chan L.M., Gal S.: A Markovin model for a perishable product invertory.
Man. Science,23, 1985.

9. Chrzan P.: O pewnym algorytmie rozwi¾zania zadania optymalizacji nie-
jednorodnego okresowego iancucha Markowa. PN.351, AE-Wrociaw, 1986.

10. Chrzan P.: Iteracyjny algorytm wyznaczania macierzy ergodycznej i funda-
mentalnej dla skonczonego iancucha Markowa. Problemy budowy i zasto-
sowan modeli ekonomicznych. SGPiS-Warszawa, 1987.

11. Chrzan P.: Model Howard’a dla niejednorodnego okresowego iancucha Mar-
kowa. Czçsc I. Przegl¾d Statystyczny, 35
/2, PWN, Poznan, 1988.

12. Chrzan P.: Model Howard’a dla niejednorodnego okresowego iancucha Mar-
kowa. Czçsc II. Przegl¾d Statystyczny, 35
/3, PWN, Poznan, 1988.

13. Chrzan P.: Stacjonarny iancuch Markowa z czasem dyskretnym. Zadanie
optymalizacji z dyskontem. Program w jçzyku FORTRAN dla IBM-PC,
metoda iteracji w przestrzeni polityk. Working Paper, Instytut Ekonomii,
AE- Katowice, 1990.

15



More intriguing information

1. The name is absent
2. Prevalence of exclusive breastfeeding and its determinants in first 6 months of life: A prospective study
3. The name is absent
4. Micro-strategies of Contextualization Cross-national Transfer of Socially Responsible Investment
5. Graphical Data Representation in Bankruptcy Analysis
6. The name is absent
7. The name is absent
8. Impacts of Tourism and Fiscal Expenditure on Remote Islands in Japan: A Panel Data Analysis
9. Consciousness, cognition, and the hierarchy of context: extending the global neuronal workspace model
10. APPLYING BIOSOLIDS: ISSUES FOR VIRGINIA AGRICULTURE