lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Application Areas of Linear Programming, what is meant by Application Areas...

what is meant by Application Areas of Linear Programming?

Question, A paper mill produces two grades of paper viz., X and Y. Because ...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Characteristics - probability distribution , Characteristics a. Discr...

Characteristics a. Discrete Distribution: Like  binomial  distribution it is  also a  discrete probability  i e,  occurrences can be  described  by a random  variable. b.

Calculation of standard deviation - continuous series, Calculation of Stand...

Calculation of Standard Deviation - Continuous Series: In the continuous series the methods of calculation standard deviation is almost the same as in a discrete frequency distrib

Simo chart flow diagram , SIMO Chart Flow Diagram The  flow  diagram  ...

SIMO Chart Flow Diagram The  flow  diagram  is a drawing  indicating  the paths  of men  materials  or components on a scale  plan of  the work  area, department or  factory.

LPP, Solve the following Linear Programming Problem using Simple method. Ma...

Solve the following Linear Programming Problem using Simple method. Maximize Z= 3x1 + 2X2 Subject to the constraints: X1+ X2 = 4 X1 - X2 = 2 X1, X2 = 0

Investigate the link between engine wear and mileage, The Association of Ma...

The Association of Malawi Mechanics has commissioned a study to investigate the link between engine wear and mileage. The main focus of the study is to determine whether the mileag

LPP, A paper mill produces two grades of paper viz., X and Y. Because of r...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Uses of range - measure of dispersion, Uses of Range a.Range is suitab...

Uses of Range a.Range is suitable  measure  of dispersion  when the  data are too  scattered to justify the  computation of a more precise  measure of dispersion. b.In rece

Ques, Ask questb. A Company produces 150 cars. But the production rate vari...

Ask questb. A Company produces 150 cars. But the production rate varies with the distribution. Production Rate 147 148 149 150 151 152 153 Probability 0.05 0.10 0.15 0.20 0.30 0.15

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd