lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Preparation of visual aids , Preparation of visual Aids ,Handouts and Feedb...

Preparation of visual Aids ,Handouts and Feedback Forms It is   always  better to prepare  visual  aids much  in advance of the presentation. Leaving  them for the  last mo

Liner, #question.A paper mill produces two grades of paper viz., X and Y. B...

#question.A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade

Integer programming, An integer programming problem is identical to a linea...

An integer programming problem is identical to a linear programming problem except that one or more decision variables are constrained to take integer values. Such problems cannot

Sope, sope of operations research in a detailed manner

sope of operations research in a detailed manner

Deviation taken from assumed mean, Deviation Taken from Assumed Mean ...

Deviation Taken from Assumed Mean This methods  is assorted  when the  arithmetic  average  is a  fractional value. Taking  deviation from  fractional value would  be a ver

Assigment , b. A paper mill produces two grades of paper viz., X and Y. Bec...

b. A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y pape

Formulation of relevant hypotheses and models, Tentative explanations when ...

Tentative explanations when formulated as propositions are called hypotheses. It is very important to state the hypothesis and its anticipated consequences before star

Simple random sampling - sampling decisions, Simple Random Sampling  ...

Simple Random Sampling  This  is  simplest  and most  popular  technique  of sampling. In it each  unit  of the  population has equal  chance  of being  included in the samp

Linear programming model, Nass food produces to kinds of popular dark choco...

Nass food produces to kinds of popular dark chocolate bars. The banana and the coffee.the

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd