formulate the optimality equations, Operation Research

Assignment Help:

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 

 

day n+1

 

 

 

100

200

day n

100

0.5

0.5

 

200

0.25

0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.


Related Discussions:- formulate the optimality equations

Assignment, Six Operators are to be assigned to five jobs with the cost of ...

Six Operators are to be assigned to five jobs with the cost of assignment in Rs. given in the matrix below. Determine the optimal assignment. Which operator will have no assignment

Business Simulation Model, How much does cost for developing a simple model...

How much does cost for developing a simple model using Simuli 8 software and 2 pages write up (Explaining model). This is for my university assignment. For example last year assig

Linear programming problem, Solve the following Linear Programming Problem ...

Solve the following Linear Programming Problem using Simple method. Maximize Z= 3x1 + 2X2 Subject to the constraints: X1+ X2 = 4 X1 - X2 = 2 X1, X2 = 0

Manner of presentation - report writing presentation, Manner of Presentatio...

Manner of Presentation  Decide  whether  you wish  to achieve  your  objective by a formal  presentation or a  non formal  type  of presentation. As  discussed  earlier the

Word problems based on formulation of linear programming, Word problems bas...

Word problems based on formulation of linear programming problems. 2.   A manufacturer produces nuts and bolts for industrial machinery. It takes 1 hour of work on machine 1 an

Sing test- hypothesis testing, SING TEST The sign test  is the simples...

SING TEST The sign test  is the simplest  of the  parametric  tests. Its name comes  from the  fact  that it is based  on the direction ( or sings  for  pluses or minuses ) of

Sources of stress and job burnout, QUESTION Discuss the major sources o...

QUESTION Discuss the major sources of stress and job burnout and outline the strategies for managing stress. QUESTION How can you use the „Johari Window Model? as a

Game theory-, use of game theory by state bank of india

use of game theory by state bank of india

Strategies and od intervention techniques, QUESTION 1 Change strategies...

QUESTION 1 Change strategies and OD intervention techniques follow from diagnosis. An inappropriate intervention due to a faulty diagnosis may be very costly to an organization

#methode, #what are the methods of OR ?

#what are the methods of OR ?

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd