formulate the optimality equations, Operation Research

Assignment Help:

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 

 

day n+1

 

 

 

100

200

day n

100

0.5

0.5

 

200

0.25

0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.


Related Discussions:- formulate the optimality equations

Objectives of measuring dispersion - measure of dispersion, Objectives of M...

Objectives of Measuring Dispersion a. To judge the Reliability  of Measures of Central Tendency: Measure of dispersion  is the  only means  to test the  representative charac

Construction procedure for research tool, CONSTRUCTION PROCEDURE The c...

CONSTRUCTION PROCEDURE The construction of an interview schedule or questionnaire is a time consuming task requiring considerable attention to all the details. The investig

data analysis and research methodology , Case  Study - Data Analysis ...

Case  Study - Data Analysis Sandarsen  inc was testing new  packaging  and a few  recipe  for a family  desert cookie  that had  been  on the  market for several years. It wa

LLp, A paper mill produces two grades of paper viz., X and Y. Because of ra...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

project management , Project Management Your  data need to be orga...

Project Management Your  data need to be organized in such  a way that  access to them  is both  quick  and accurate. In  achieving  this a good qualitative analysis progra

Solve lpp by using its duality, Maximize w = 5x -2y +3z subject to 2x +2y -...

Maximize w = 5x -2y +3z subject to 2x +2y -z>=2 y + 3z

Verification of hypothesis, Analysis of Available Information and Verific...

Analysis of Available Information and Verification of Hypothesis: most of the time that a scientist spends in training is devoted to learning how to analyze and int

Complete decision making process , Operation research is only a Tool of Ana...

Operation research is only a Tool of Analysis and Not the Complete Decision making Process: It should always be kept in mind that O. R alone cannot make the final decision . it

Case study and statistical methods, Case Study Methods: It is studying the...

Case Study Methods: It is studying the phenomenon event situation or development through a thorough and detailed analysis or intensive study. The case may be an individual a gr

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd