lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Use of the graphs, Use  of the Graphs a . It simplifies  the complexi...

Use  of the Graphs a . It simplifies  the complexities of large numbers  or that of  large mass  of data. In general  graphical  or some  other method or representation  is ad

Competitive models, These models have been developed to establish a trade ...

These models have been developed to establish a trade off between costs of providing and the waiting time of a customer in the queuing system. Constructing a model entails desc

Mode of presentation - report writing presentation, Mode  of Presentation...

Mode  of Presentation A strategy  needs to be  chalked out for  a satisfactory  rendering of the  topic. The  man oeuvres are going  t vary  with a  change in the  manner  of

Application Areas of Linear Programming, what is meant by Application Areas...

what is meant by Application Areas of Linear Programming?

Regression Analysis, regression line drawn as Y=C+1075x, when x was 2, and ...

regression line drawn as Y=C+1075x, when x was 2, and y was 239, given that y intercept was 11. calculate the residual

Techniques of operations research, There is no unique set of problems which...

There is no unique set of problems which can be solved by using operations Research Models r techniques. Several operations Research Models or techniques can be grouped into some b

Narrowing the research problem, NARROWING THE RESEARCH PROBLEM You h...

NARROWING THE RESEARCH PROBLEM You have read how from a general topic we have arrived at the definition of the problem to be studied. Now we have to narrow it down furthe

Replacement theory.., a pipe lis dur for rpair,the repair would cost 10000 ...

a pipe lis dur for rpair,the repair would cost 10000 and it would last for 3 years.alternatively a new pipe line can be purchase at 30000 for 10 years.assuming 10% depriciation rat

Sampling decision, Normal 0 false false false EN-IN X...

Normal 0 false false false EN-IN X-NONE X-NONE

Title page - report writing presentation, Title  Page Tthe title page...

Title  Page Tthe title page  should  indicate  the topic  on which  the report has been  prepared the  person  or agency who has  prepared it the  person  a agency for whom it

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd