Reference no: EM131104672
Use the policy improvement algorithm to find an optimal policy for Prob. 21.2-1.
Prob. 21.2-1
During any period, a potential customer arrives at a certain facility with probability ½ If there are already two people at the facility (including the one being served), the potential customer leaves the facility immediately and never returns. However, if there is one person or less, he enters the facility and becomes an actual customer. The manager of the facility has two types of service configurations available. At the beginning of each period, a decision must be made on which configuration to use. If she uses her "slow" configuration at a cost of $3 and any customers are present during the period, one customer will be served and leave the facility with probability 3/5 If she uses her "fast" configuration at a cost of $9 and any customers are present during the period, one customer will be served and leave the facility with probability 4/5 The probability of more than one customer arriving or more than one customer being served in a period is zero. A profit of $50 is earned when a customer is served.
(a) Formulate the problem of choosing the service configuration period by period as a Markov decision process. Identify the states and decisions. For each combination of state and decision, find the expected net immediate cost (subtracting any profit from serving a customer) incurred during that period.
(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average net cost per period in terms of the unknown steady-state probabilities
(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.
|
Explain what accountants do as a practical alternative
: 1. State some of the more serious problems encountered in seeking to achieve the ideal measurement of periodic net income. Explain what accountants do as a practical alternative.
|
|
Advantages of the java object class structure
: Discussion Question: What are the advantages of the Java object class structure with its instance fields and methods
|
|
How would you reconcile this dilemma
: Following the observations on prima facie duties, how would you reconcile this dilemma? Are there any conditional duties in operation here? Explain your response.
|
|
Which company should have the higher stock price
: If most investors expect the same cash flows from Companies A and B but are more confident that A's cash flows will be closer to their expected value, which company should have the higher stock price? Explain.
|
|
The problem of choosing the service configuration
: During any period, a potential customer arrives at a certain facility with probability ½ If there are already two people at the facility (including the one being served), the potential customer leaves the facility immediately and never returns. Ho..
|
|
Creating java applications using java se and an ide
: Discussion Question: How does Java provide platform portability for developing applications? Describe the process to creating Java applications using Java SE and an IDE
|
|
New millenium free cash flow last year
: New Millenium Company earned $2.1million in net income last year. It took depreciation deductions of $305,000 and made new investments in working capital and fixed assets of $102,000 and $346,000 respectively.
|
|
Determine the normal force shear force
: Show transcribed image text Determine the normal force, shear force, and moment at point C. Take that w = 14kN/m
|
|
Which costs should be included in the inventory
: What do you think about the criteria used to determine which costs should be included in the inventory? Summarize the reason for the amounts Steel Company's inventory should be reported on the balance sheet.
|