lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Seven step to a successful presentation, Seven Step to a Successful Present...

Seven Step to a Successful Presentation There  are seven  basic  step which  need to  kept  in mind at the  time of  making  a presentation. How  successful one  is at eh end

Decision analysis, a question was given but i cannot identify the alternati...

a question was given but i cannot identify the alternatives and i do not know how to calculate the right amount of payoff.what are the right ways to calculate the payoff table.

Linear Programming models, In your own words, describe the special cases of...

In your own words, describe the special cases of integer programming and binary programming: what makes these problems different? Give an example of each, pointing out why they mus

Operation research, types of OR ,technique and mathematical system and line...

types of OR ,technique and mathematical system and linear programming system in operation research

ANSWER OF PROBLEM RELATING TO PERT AND CPM., ANSWER OF ACTIVITY WITH THEIR ...

ANSWER OF ACTIVITY WITH THEIR PRECEDING ACTIVITY AND DURATION OF TIME IN WEEKS?

Linear programming problem, A paper mill produces two grades of paper viz.,...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Hypothesis building and testing, Hypothesis  Building and Testing The...

Hypothesis  Building and Testing The foundation of hypothesis building  lies in discovering links between  elements  of your data. CAQDAS can help you to  discover these links

Steps involved in linear programming problem formulation, Question A - Line...

Question A - Linear Programming is most widely used technique for large number of applications in business industry as well as in various other fields. Describe in brief the steps

Demerits of range - measure of dispersion , Demerits  of Range a.It g...

Demerits  of Range a.It gives  importance  to the  two  extreme  values and is very much affected by the extreme items. b.The range  provides  no information  about the  st

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd