Find steady-state probabilities for each policy

Reference no: EM132256168

Stochastic Process Modeling Assignment - Project - Markov Decision Processes

Note - Read Appendix A, and then, solve the following problem. Need help with part II and part III only.

PROBLEM - Every Friday night a man plays poker at his home with the same group of friends. If he provides refreshments for the group (at an expected cost of $14) on any given Friday night, the group will begin the following Friday night in a good mood with probability 7/8 and in a bad mood with probability 1/8. However, if he fails to provide refreshments, the group will begin the following Friday night in a good mood with probability 1/8 and in a bad mood with probability 7/8, regardless of their mood this Friday. Furthermore, if the group begins the night in a bad mood and then he fails to provide refreshments, the group will gang up on him so that he incurs expected poker losses of $75. Under other circumstances, he averages no gain or loss on his poker play. The man wishes to find the policy regarding when to provide refreshments that will minimize his (long-run) expected average cost per week.

PART I -

a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the C_ik.

b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (long-run) expected average cost per period in terms of the unknown steady-state probabilities (π₀, π₁, . . . , π_M).

PART II -

a) Find these steady-state probabilities for each policy. Then evaluate the expression obtained in Part I (b) to find the optimal policy by exhaustive enumeration. Describe the optimal policy briefly in "plain English".

b) Formulate a linear programming model for finding an optimal policy.

PART III -

Use the policy improvement algorithm to find an optimal policy. Describe the optimal policy briefly in "plain English".

Attachment:- Appendix A.rar

Reference no: EM132256168

Questions Cloud

What is alignment in research : Use Google or a search engine of your choice to conduct an internet search using the search question "What is alignment in research?"

Find an example of a business that has struggled : Explain some of the challenges that the enterprise encountered during strategy implementation and how they did or might overcome these challenges.

Identify the aggregate or vulnerable populations : NR443/435/436 Community Health Nursing ( Chamberlain University College of Nursing) Vulnerable population: Identify the aggregate or vulnerable populations.

Does wal-mart new neighborhood store format : Does Wal-Mart’s new neighborhood store format run counter to cost-cutting emphasis that is at least partially responsible for success of its traditional stores?

Find steady-state probabilities for each policy : IE 515 - Stochastic Process Modeling Assignment - Project - Markov Decision Processes, New Mexico State University, USA. Find steady-state probabilities

Identify the stakeholders impacted by the project : Identify the stakeholders impacted by this project. Explain the patient outcome(s) or patient-care efficiencies this project is aimed at improving.

What are wal-mart weaknesses : Is it easy to become enamored with a company when it has enjoyed so much success over the years? What are Wal-Mart’s weaknesses?

What promotional plans do you have for your offering : What promotional plans do you have for your offering? What are key messages or phrases that describe your offering?

How do you handle stress in the healthcare setting : How do you handle stress in the healthcare setting? What clinical skills do you possess that will be most beneficial to this clinical practice?

Reviews

len2256168

3/13/2019 11:11:46 PM

Read Appendix A, and then, solve the following problem. Need help with part II and part III only. The project report should be prepared on a word processor and should contain tables and/or figures that are necessary to make the report easy to read. Be concise in your writing and consult technical writing references as needed.

Write a Review

Required(*) Message

User Account

All Pages