Use the policy improvement algorithm to find

Reference no: EM131104693

Use the policy improvement algorithm to find an optimal policy for Prob. 21.2-1.

Prob. 21.2-1

During any period, a potential customer arrives at a certain facility with probability ½ If there are already two people at the facility (including the one being served), the potential customer leaves the facility immediately and never returns. However, if there is one person or less, he enters the facility and becomes an actual customer. The manager of the facility has two types of service configurations available. At the beginning of each period, a decision must be made on which configuration to use. If she uses her "slow" configuration at a cost of $3 and any customers are present during the period, one customer will be served and leave the facility with probability 3/5 If she uses her "fast" configuration at a cost of $9 and any customers are present during the period, one customer will be served and leave the facility with probability 4/5 The probability of more than one customer arriving or more than one customer being served in a period is zero. A profit of $50 is earned when a customer is served.

(a) Formulate the problem of choosing the service configuration period by period as a Markov decision process. Identify the states and decisions. For each combination of state and decision, find the expected net immediate cost (subtracting any profit from serving a customer) incurred during that period.

(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average net cost per period in terms of the unknown steady-state probabilities

(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

Reference no: EM131104693

Questions Cloud

Calculate net income under fifo and lifo : Weighted average. Round the unit cost answer to two decimal places and ending inventory to the nearest $10. Assume that net income using the weighted-average cost flow assumption is $116,000. Calculate net income under FIFO and LIFO.

Which would be the better performance measure : Would it be easier to measure performance by the growth rate in reported profits or the growth rate in the stock's intrinsic value? Which would be the better performance measure? Why?

Position of an legal representative : Assuming that you have gone to an interview in Rhampsody Co. Ltd for position of an legal representative and the first question are asked is to discuss modes of winding up of a company. What could be your answers?

How should the disposal of a component of a business : How should the disposal of a component of a business be disclosed in the income statement?

Use the policy improvement algorithm to find : During any period, a potential customer arrives at a certain facility with probability ½ If there are already two people at the facility (including the one being served), the potential customer leaves the facility immediately and never returns.

Program that prompts the user to input a decimal number : Write a program that prompts the user to input a decimal number and outputs the number rounded to the nearest integer

Draw at least two views of rag foundation bolt : Also draw at least two views of Rag foundation bolt. Take D=20mm

What are the three ways that other comprehensive income : What are the three ways that other comprehensive income may be displayed (reported)?

A linear programming model for finding an optimal policy : Each year Ms. Fontanez has the chance to invest in two different no-load mutual funds: the Go-Go Fund or the Go-Slow Mutual Fund. At the end of each year, Ms. Fontanez liquidates her holdings, takes her profits, and then reinvests.

User Account

All Pages