Formulate this problem as a markov decision process

Assignment Help Basic Statistics
Reference no: EM131104741

A person often finds that she is up to 1 hour late for work. If she is from 1 to 30 minutes late, $4 is deducted from her paycheck; if she is from 31 to 60 minutes late for work, $8 is deducted from her paycheck. If she drives to work at her normal speed (which is well under the speed limit), she can arrive in 20 minutes However, if she exceeds the speed limit a little here and there on her way to work, she can get there in 10 minutes, but she runs the risk of getting a speeding ticket. With probability 1/8 she will get caught speeding and will be fined $20 and delayed 10 minutes, so that it takes 20 minutes to reach work.

The transition probabilities for s tomorrow if she speeds to work today are given by

Note that there are no transition probabilities for (20, ∞) and (-10, 9), because she will get to work on time and from 1 to 30 minutes late, respectively, regardless of whether she speeds. Hence, speeding when in these states would not be a logical choice. Also note that the transition probabilities imply that the later she is for work and the more she has to rush to get there, the more likely she is to leave for work earlier the next day. She wishes to determine when she should speed and when she should take her time getting to work in order to minimize her (longrun) expected average cost per day.

(a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the Cik.

(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average cost per period in terms of the unknown steady-state probabilities

(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

Reference no: EM131104741

Questions Cloud

Compute the product cost per container of frozen yogurt : Compute the product cost per container of frozen yogurt under (a) variable costing and (b) absorption costing. Prepare income statements for 20x1 using (a) absorption costing and (b) variable costing.
Launching of the new deal : Leaders are shaped by the people they lead and the social context in which they lead. Using the following examples: Woodrow Wilson in the WWI, FDR and the Launching of the New Deal, Kennedy and the Cold War,
How many cell lengths are added in one week, on average : How many cell lengths are added in one week, on average?
Received title to the refrigeration system : Packers, Inc., bought a new kind of refrigeration system from Coolit for storage of its meats. As part of the contract, Coolit delivered the refrigeration system to the Packers plant, installed it, set its temperature, and then monitored it for se..
Formulate this problem as a markov decision process : A person often finds that she is up to 1 hour late for work. If she is from 1 to 30 minutes late, $4 is deducted from her paycheck; if she is from 31 to 60 minutes late for work, $8 is deducted from her paycheck.
Write a program to create instance variables name : Write a program to create instance variables Name, age and create the use defined constructor and create a void check() method to check whether the person is "Young, "Middle" or "Old"
What is the profit : Ray's Lawn and Garden bought 300 lawnmowers for $75.00 each to stock the store for spring. If the 300 lawnmowers are sold for $104.95 each, what is the profit?
Prepare a partial income statement for green day beginning : Green Day Corporation had income from continuing operations of $12,600,000 in 2004. During 2004, it disposed of its restaurant division at an after-tax loss of $189,000.
Identify the economic resources agents and economic events : Identify the economic resources, agents, economic events and at least one cardinality relationship that would be included in the REA diagram for the sales process?

Reviews

Write a Review

Basic Statistics Questions & Answers

  The unemployment rates for various countries ranges from 49

the unemployment rates for various countries ranges from 4.9 to 10.4 with q1 5.3 median 6.6 q3 7.6 a mean of 6.4 and

  Find best statistical test to use for the analysis of data

Six houses were selected and each appraiser provided an appraisal for each of the six houses. What would be the best statistical test to use for the analysis of this data?

  Probability that defective have defective braked

Keith's florist has 18 delivery trucks used mainly to deliver flowers in the SC area. Of these 18 trucks, 5 have brake problems. A sample of 4 trucks is randomly selected. What is the probability that 2 of those defective have defective braked. Ro..

  Explain binomial probabilities

Based on p=.60, probability that a randomly selected homeowners will say no to newspaper subscription.

  Standard error of the mean

A sample of 10 observations is selected from a normal population for which the population standard deviation is known to be 4. The sample mean is 23. (Round your answers to 3 decimal places.) (a) The standard error of the mean is_____?

  Probability of taking a hand of cards

Calculate the probability that a hand of 13 cards dealt from a normal pack of 52 contains exactly two kings and one ace. what is the probability that it contains exactly one ace given that it contains exactly two kings.

  The type of sample statistic that is used to make

the type of sample statistic that is used to make inferences about a given type of population parameter is calleda. the

  What is the maximum amount of total loans

If the reserve requirement is 20%, if initial new deposits are $100,000 what is the maximum amount of total loans that can be created by banks

  Mean amount of coffee to be dispensed

You can allow the cup to overfill 4% of the time. What amount should you set as the mean amount of coffee to be dispensed?

  Considering several international opportunities

Valuation of an MNC Birm Co., based in Alabama, is considering several international opportunities in Europe that could affect the value of its firm. The valuation of its firm is dependent on four factors: (1) expected cash flows in dollars,

  A coin was flipped 60 times and came up heads 36 times what

a coin was flipped 60 times and came up heads 36 times. what is the test statistic you would use to test whether the

  What percentage of calls are completed

Fix-It Copiers advertises a mean time of 100 minutes for office calls with a standard deviation of 25 minutes. What percentage of calls are completed.

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd