formulate the optimality equations, Operation Research

Assignment Help:

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 

 

day n+1

 

 

 

100

200

day n

100

0.5

0.5

 

200

0.25

0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.


Related Discussions:- formulate the optimality equations

Concept and need for information, CONCEPT AND NEED FOR INFORMATION: W...

CONCEPT AND NEED FOR INFORMATION: We shall look at the meaning, of information as also the meaning of other related words such as data, facts, intelligence, advice, knowledge

Meaning and definition, Meaning and Definition If a group  of N observ...

Meaning and Definition If a group  of N observations is  arranged in ascending or descending  order of magnitude then the  middle  value is  called  median of  these  observat

Solve by computational procedure of big – m method, Example 2 Max Z = 3...

Example 2 Max Z = 3x 1 - x 2 Subject to             2x 1 + x 2 ≥ 2             x 1 + 3x 2 ≤ 3             x 2 ≤ 4     &     x 1 ≥ 0, x 2  ≥ 0   A

Examine the future sustainability of business, In your role as a Consultant...

In your role as a Consultant to a renowned organisation or institution, you have been asked to design and submit a research proposal to examine the future sustainability of its bus

Operations research as a decision-making sci, Short Define operations resea...

Short Define operations research as a decision-making science

Model building is the essence of the operations research app, Model buildin...

Model building is the essence of the operations research approaches?

Rehearse - report writing presentation , Rehearse Making  presentat...

Rehearse Making  presentation is not  simple. It  is extremely  important  for us  to realize the sanctity of rehearsing  to improve the quality of the presentation. Unless

Use of the graphs, Use  of the Graphs a . It simplifies  the complexi...

Use  of the Graphs a . It simplifies  the complexities of large numbers  or that of  large mass  of data. In general  graphical  or some  other method or representation  is ad

#title scope.., scope of the operation research in modern management?

scope of the operation research in modern management?

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd