Formulate this problem as a markov decision process

Assignment Help Basic Statistics
Reference no: EM131104741

A person often finds that she is up to 1 hour late for work. If she is from 1 to 30 minutes late, $4 is deducted from her paycheck; if she is from 31 to 60 minutes late for work, $8 is deducted from her paycheck. If she drives to work at her normal speed (which is well under the speed limit), she can arrive in 20 minutes However, if she exceeds the speed limit a little here and there on her way to work, she can get there in 10 minutes, but she runs the risk of getting a speeding ticket. With probability 1/8 she will get caught speeding and will be fined $20 and delayed 10 minutes, so that it takes 20 minutes to reach work.

The transition probabilities for s tomorrow if she speeds to work today are given by

Note that there are no transition probabilities for (20, ∞) and (-10, 9), because she will get to work on time and from 1 to 30 minutes late, respectively, regardless of whether she speeds. Hence, speeding when in these states would not be a logical choice. Also note that the transition probabilities imply that the later she is for work and the more she has to rush to get there, the more likely she is to leave for work earlier the next day. She wishes to determine when she should speed and when she should take her time getting to work in order to minimize her (longrun) expected average cost per day.

(a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the Cik.

(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average cost per period in terms of the unknown steady-state probabilities

(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

Reference no: EM131104741

Questions Cloud

Compute the product cost per container of frozen yogurt : Compute the product cost per container of frozen yogurt under (a) variable costing and (b) absorption costing. Prepare income statements for 20x1 using (a) absorption costing and (b) variable costing.
Launching of the new deal : Leaders are shaped by the people they lead and the social context in which they lead. Using the following examples: Woodrow Wilson in the WWI, FDR and the Launching of the New Deal, Kennedy and the Cold War,
How many cell lengths are added in one week, on average : How many cell lengths are added in one week, on average?
Received title to the refrigeration system : Packers, Inc., bought a new kind of refrigeration system from Coolit for storage of its meats. As part of the contract, Coolit delivered the refrigeration system to the Packers plant, installed it, set its temperature, and then monitored it for se..
Formulate this problem as a markov decision process : A person often finds that she is up to 1 hour late for work. If she is from 1 to 30 minutes late, $4 is deducted from her paycheck; if she is from 31 to 60 minutes late for work, $8 is deducted from her paycheck.
Write a program to create instance variables name : Write a program to create instance variables Name, age and create the use defined constructor and create a void check() method to check whether the person is "Young, "Middle" or "Old"
What is the profit : Ray's Lawn and Garden bought 300 lawnmowers for $75.00 each to stock the store for spring. If the 300 lawnmowers are sold for $104.95 each, what is the profit?
Prepare a partial income statement for green day beginning : Green Day Corporation had income from continuing operations of $12,600,000 in 2004. During 2004, it disposed of its restaurant division at an after-tax loss of $189,000.
Identify the economic resources agents and economic events : Identify the economic resources, agents, economic events and at least one cardinality relationship that would be included in the REA diagram for the sales process?

Reviews

Write a Review

Basic Statistics Questions & Answers

  Statistics-probability assignment

MATH1550H: Assignment:  Question:  A word is selected at random from the following poem of Persian poet and mathematician Omar Khayyam (1048-1131), translated by English poet Edward Fitzgerald (1808-1883). Find the expected value of the length of th..

  What is the least number

MATH1550H: Assignment:  Question:     what is the least number of applicants that should be interviewed so as to have at least 50% chance of finding one such secretary?

  Determine the value of k

MATH1550H: Assignment:  Question:     Experience shows that X, the number of customers entering a post office during any period of time t, is a random variable the probability mass function of which is of the form

  What is the probability

MATH1550H: Assignment:Questions: (Genetics) What is the probability that at most two of the offspring are aa?

  Binomial distributions

MATH1550H: Assignment:  Questions:  Let’s assume the department of Mathematics of Trent University has 11 faculty members. For i = 0; 1; 2; 3; find pi, the probability that i of them were born on Canada Day using the binomial distributions.

  Caselet on mcdonald’s vs. burger king - waiting time

Caselet on McDonald’s vs. Burger King - Waiting time

  Generate descriptive statistics

Generate descriptive statistics. Create a stem-and-leaf plot of the data and box plot of the data.

  Sampling variability and standard error

Problems on Sampling Variability and Standard Error and Confidence Intervals

  Estimate the population mean

Estimate the population mean

  Conduct a marketing experiment

Conduct a marketing experiment in which students are to taste one of two different brands of soft drink

  Find out the probability

Find out the probability

  Linear programming models

LINEAR PROGRAMMING MODELS

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd