Improvement algorithm to find an optimal policy

Assignment Help Basic Statistics
Reference no: EM131105403

Use the policy improvement algorithm to find an optimal policy for Prob. 21.2-9.

Prob. 21.2-9

Each year Ms. Fontanez has the chance to invest in two different no-load mutual funds: the Go-Go Fund or the Go-Slow Mutual Fund. At the end of each year, Ms. Fontanez liquidates her holdings, takes her profits, and then reinvests. The yearly profits of the mutual funds are dependent upon how the market reacts each year. Recently the market has been oscillating around the 12,000 mark from one year end to the next, according to the probabilities given in the following transition matrix:

Each year that the market moves up (down) 1,000 points, the GoGo Fund has profits (losses) of $20,000, while the Go-Slow Fund has profits (losses) of $10,000. If the market moves up (down) 2,000 points in a year, the Go-Go Fund has profits (losses) of $50,000, while the Go-Slow Fund has profits (losses) of only $20,000. If the market does not change, there is no profit or loss for either fund. Ms. Fontanez wishes to determine her optimal investment policy in order to minimize her (long-run) expected average cost (loss minus profit) per year.

(a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the Cik.

(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average cost per period in terms of the unknown steady-state probabilities

(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

Reference no: EM131105403

Questions Cloud

How much property tax revenue should be reported : How much property tax revenue should be reported by the general fund on the statement of revenues, expenditures, and changes in fund balances prepared for the year ended December 31, 2012?
How would you respond to battle : Kathleen Battle says, "Retained earnings should be reported as an asset, since it is earnings which are reinvested in the business." How would you respond to Battle?
Determining the minimum number of shares : The shareholders of the Pickwick Paper Company need to elect five directors. There are 360,000 shares outstanding. a. What is the minimum number of shares you need to own to ensure that you can elect at least one director if the company has majorit..
Analyze primary way in which eitf influences : Analyze the primary way in which Emerging Issues Task Force (EITF) influences Generally Accepted Accounting Principles (GAAP). Based on your analysis, recommend one improvement that the EITF could take in order to more effectively influence GAAP.
Improvement algorithm to find an optimal policy : Each year Ms. Fontanez has the chance to invest in two different no-load mutual funds: the Go-Go Fund or the Go-Slow Mutual Fund. At the end of each year, Ms. Fontanez liquidates her holdings, takes her profits, and then reinvests.
What amount should be reported as cash flows : In the electric utility enterprise fund's statement of cash flows for the year ended December 31, 2012, what amount should be reported as cash flows from capital and related financing activities?
Find two designs using open-circuited stub : Problem 5.5 A load impedance ZL = 90 + j60 is to be matched to a 75 Ω line using a single series-stub tuner. Find two designs using open-circuited stubs
Why do we have antitrust laws in the first place : CarToys car audio store sells its JVC brand speakers only with a JVC subwoofer. Without the subwoofer, they will not sell the speakers to people. This kind of practice is called a ___________________.
State the generally accepted accounting principle applicable : State the generally accepted accounting principle applicable to the balance sheet valuation of each of the following assets.

Reviews

Write a Review

Basic Statistics Questions & Answers

  Explain how each process may harm living things

Many people confuse the large void in the ozone layer with global warming. Can you distinguish between the two phenomena? Discuss the causes of each. Explain how each process may harm living things. Your response should be at least 200 words in le..

  Develop the appropriate research questions

1. Develop the appropriate research questions and/or hypothesis for the main effects and interaction.

  Find the probability that student is happy

Find the probability that student is happy with the choice of major, a psychology major and a communications major given that the student is happy with the choice of major.

  A determine the number of classes b determine the interval

q1. describing data frequency distribution and graphic presentationsyou are the parts manager for a local dumb phone

  Statistics research methodology

Choose a business problem that is based upon an experience from your place of work or home environment. Briefly describe the business problem and the research methodology that you would employ to gather data and test your hypothesis

  Find the expression for variance of the estimate

The inventory value is estimated by the sum of book values of population and N-D, where N is population size at top ,D at bottom. show that the estimate is unbiased. Find an expression for the variance of the estimate.

  Computing the critical z value

In 1990, 5.8% of job applicants who were tested for drugs failed the test. At the 0.01 significance level, test the claim that the failure rate is now lower if a simple random sample of 1520 current job applicants results in 58 failures. Does the ..

  Often the experimental factor x is replaced by lnx in these

the following data show the number of fruit y killed at varying concentrations of nicotine.the number of ies killed in

  Hypothesis test for difference between two population

hypothesis test for difference between two population variances.a real estate agent in the coastal area of georgia

  Statistical evidence regarding effectiveness of diet

Stating assumptions on which your arguments and conclusions are based, sum up the statistical evidence regarding effectiveness of this diet.

  Explanation to expected return

Assume the risk-free interest is 5%. If WT borrows $100 million today at this rate and uses the proceeds to pay an immediate cash dividend, what will be the market value of its equity just after the dividend is paid, according to MM?

  Find expected value of the random variable

The number of gallons (measured in thousands of gallons) that this gas station sells per week. If Y = 340 - 90X, what is the expected value of the random variable Y?

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd