lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Need answer, A paper mill produces two grades of paper viz., X and Y. Becau...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Find the maximum and minimum values, Problems based on solution of a given ...

Problems based on solution of a given LPP when it has multiple optimal solution: 1.    Find the maximum and minimum values of 5x+2y, subject to the constraints -2x-3y ≤ -6

Linear programming., The demand of ice cream during the three summer months...

The demand of ice cream during the three summer months (June, July, and August) at All-Flavors Parlor is estimated at 500,600, and 400 20-gallon cartons, respectively. Two wholesal

Determine the optimal assignment., #questiSix Operators are to be assigned ...

#questiSix Operators are to be assigned to five jobs with the cost of assignment in Rs. given in the matrix below. Determine the optimal assignment. Which operator will have no ass

Innovation.., identify a new technological innovation not yet commercialize...

identify a new technological innovation not yet commercialized (e.g., house cleaning robotic). What are the product''s features? In your paper, explain how that technological innov

Medical industry payments to physicians, Medical Industry Payments to Physi...

Medical Industry Payments to Physicians The relationships between physicians and medical related companies in the United States, generally acknowledged to be familiar given th

Merits - correlation regression analysis , Merits a.It is simple  to ...

Merits a.It is simple  to understand  and easy  to calculate. b.It is very  useful  in the  case of data which  are of  qualitative nature  like  intelligence  honesty  be

Operations Decision, 2.Assess the current environmental scan factors that a...

2.Assess the current environmental scan factors that are relevant to the decision making process. Determine the factors that will have the greatest impact on plant operations and m

the simplex method, In large sized linear programming problems, the ...

In large sized linear programming problems, the solution cannot be obtained by the graphical method and hence a more systematic method has to be developed to find

Maths, Maxz=3x1-2x2 St x1-x2 >_0, 3x1-x2 _0

Maxz=3x1-2x2 St x1-x2 >_0, 3x1-x2 _0

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd