AN ANALYTICAL METHOD TO CALCULATE THE ERGODIC AND DIFFERENCE MATRICES OF THE DISCOUNTED MARKOV DECISION PROCESSES



and for the second state

ν2,∞ (0,5) = 2 1 - 1, 052 4 = -2, 208.

For β = 0, 99 we obtain

ν(0,99) = 100


-4


and

νι,∞ (0, 99) = 100 + 5 = 105,

ν2,∞ (0, 99) = 100 - 4 = 96.

Example 2

Let N = 3 and

0 1     0

9     8     3 ^

P =

1 0     0

, R =

3 -7 -2

0 0, 5 0, 5

5 -9   3

Hence

-8
-3

Further calculations give us the following results:

1 β 0

(I - βP ) =


-β 1       0

0 0,5β 1 - 0, 5β

10



More intriguing information

1. Tastes, castes, and culture: The influence of society on preferences
2. Imputing Dairy Producers' Quota Discount Rate Using the Individual Export Milk Program in Quebec
3. Linking Indigenous Social Capital to a Global Economy
4. Reputations, Market Structure, and the Choice of Quality Assurance Systems in the Food Industry
5. The name is absent
6. How we might be able to understand the brain
7. On the Desirability of Taxing Charitable Contributions
8. THE RISE OF RURAL-TO-RURAL LABOR MARKETS IN CHINA
9. Yield curve analysis
10. Examining the Regional Aspect of Foreign Direct Investment to Developing Countries