lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Operation research and decision making, Operations Research uses the meth...

Operations Research uses the methods of science to understand and explain the phenomena of operating systems. It devises the theories( models ) to explain these phenomena

Overview of writing research proposal, Overview of Writing Research Proposa...

Overview of Writing Research Proposal It may be written in words of the researcher or as answers following the guidelines provided by the sponsoring organization. A review of

LPP, a paper mill produce two grades of paper viz., X and Y. because of raw...

a paper mill produce two grades of paper viz., X and Y. because of raw material restrictions, it cannot produce more than 400 tona of grade X and 300 tons of grade Yin a week. ther

Title page - report writing presentation, Title  Page Tthe title page...

Title  Page Tthe title page  should  indicate  the topic  on which  the report has been  prepared the  person  or agency who has  prepared it the  person  a agency for whom it

Semeter 5, explian completelly the operation reserch

explian completelly the operation reserch

Operational performance and price, An electro-mechanical product for use in...

An electro-mechanical product for use in a vehicle has been in widespread use for some time and has proved popular with customers, in terms of its operational performance and price

Non parametric tests - hypothesis testing, NON PARAMETRIC TESTS All  ...

NON PARAMETRIC TESTS All  practical  data follow normal distribution under  such situations can estimate the  parameters such  as mean  variance etc ,,, and use the  standard

Rank methods spearman s, Rank Methods Spearman s When the variables  u...

Rank Methods Spearman s When the variables  under  consideration are  not capable  of quantitative  measurement but can  be arranged  in serial  order( ranks) we find  correla

Linear programming , the application areas of linear programming

the application areas of linear programming

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd