Improvement algorithm to find an optimal policy

Assignment Help Basic Statistics
Reference no: EM131105403

Use the policy improvement algorithm to find an optimal policy for Prob. 21.2-9.

Prob. 21.2-9

Each year Ms. Fontanez has the chance to invest in two different no-load mutual funds: the Go-Go Fund or the Go-Slow Mutual Fund. At the end of each year, Ms. Fontanez liquidates her holdings, takes her profits, and then reinvests. The yearly profits of the mutual funds are dependent upon how the market reacts each year. Recently the market has been oscillating around the 12,000 mark from one year end to the next, according to the probabilities given in the following transition matrix:

Each year that the market moves up (down) 1,000 points, the GoGo Fund has profits (losses) of $20,000, while the Go-Slow Fund has profits (losses) of $10,000. If the market moves up (down) 2,000 points in a year, the Go-Go Fund has profits (losses) of $50,000, while the Go-Slow Fund has profits (losses) of only $20,000. If the market does not change, there is no profit or loss for either fund. Ms. Fontanez wishes to determine her optimal investment policy in order to minimize her (long-run) expected average cost (loss minus profit) per year.

(a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the Cik.

(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average cost per period in terms of the unknown steady-state probabilities

(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

Reference no: EM131105403

Questions Cloud

How much property tax revenue should be reported : How much property tax revenue should be reported by the general fund on the statement of revenues, expenditures, and changes in fund balances prepared for the year ended December 31, 2012?
How would you respond to battle : Kathleen Battle says, "Retained earnings should be reported as an asset, since it is earnings which are reinvested in the business." How would you respond to Battle?
Determining the minimum number of shares : The shareholders of the Pickwick Paper Company need to elect five directors. There are 360,000 shares outstanding. a. What is the minimum number of shares you need to own to ensure that you can elect at least one director if the company has majorit..
Analyze primary way in which eitf influences : Analyze the primary way in which Emerging Issues Task Force (EITF) influences Generally Accepted Accounting Principles (GAAP). Based on your analysis, recommend one improvement that the EITF could take in order to more effectively influence GAAP.
Improvement algorithm to find an optimal policy : Each year Ms. Fontanez has the chance to invest in two different no-load mutual funds: the Go-Go Fund or the Go-Slow Mutual Fund. At the end of each year, Ms. Fontanez liquidates her holdings, takes her profits, and then reinvests.
What amount should be reported as cash flows : In the electric utility enterprise fund's statement of cash flows for the year ended December 31, 2012, what amount should be reported as cash flows from capital and related financing activities?
Find two designs using open-circuited stub : Problem 5.5 A load impedance ZL = 90 + j60 is to be matched to a 75 Ω line using a single series-stub tuner. Find two designs using open-circuited stubs
Why do we have antitrust laws in the first place : CarToys car audio store sells its JVC brand speakers only with a JVC subwoofer. Without the subwoofer, they will not sell the speakers to people. This kind of practice is called a ___________________.
State the generally accepted accounting principle applicable : State the generally accepted accounting principle applicable to the balance sheet valuation of each of the following assets.

Reviews

Write a Review

Basic Statistics Questions & Answers

  Statistics-probability assignment

MATH1550H: Assignment:  Question:  A word is selected at random from the following poem of Persian poet and mathematician Omar Khayyam (1048-1131), translated by English poet Edward Fitzgerald (1808-1883). Find the expected value of the length of th..

  What is the least number

MATH1550H: Assignment:  Question:     what is the least number of applicants that should be interviewed so as to have at least 50% chance of finding one such secretary?

  Determine the value of k

MATH1550H: Assignment:  Question:     Experience shows that X, the number of customers entering a post office during any period of time t, is a random variable the probability mass function of which is of the form

  What is the probability

MATH1550H: Assignment:Questions: (Genetics) What is the probability that at most two of the offspring are aa?

  Binomial distributions

MATH1550H: Assignment:  Questions:  Let’s assume the department of Mathematics of Trent University has 11 faculty members. For i = 0; 1; 2; 3; find pi, the probability that i of them were born on Canada Day using the binomial distributions.

  Caselet on mcdonald’s vs. burger king - waiting time

Caselet on McDonald’s vs. Burger King - Waiting time

  Generate descriptive statistics

Generate descriptive statistics. Create a stem-and-leaf plot of the data and box plot of the data.

  Sampling variability and standard error

Problems on Sampling Variability and Standard Error and Confidence Intervals

  Estimate the population mean

Estimate the population mean

  Conduct a marketing experiment

Conduct a marketing experiment in which students are to taste one of two different brands of soft drink

  Find out the probability

Find out the probability

  Linear programming models

LINEAR PROGRAMMING MODELS

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd