lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

What is the temperature of water leaving the chillier, A water chillier wit...

A water chillier with a capacity of 30 TR cools 20 m 3 /hr. water entering at 12 o C what is the temp. of water leaving the chillier. A reversible engine has an ideal thermal ef

Ap problem, Ask question A Company produces 150 cars. But the production ra...

Ask question A Company produces 150 cars. But the production rate varies with the distribution. Production Rate Probability 147 0.05 148 0.10 149 0.15 150 0.20 151 0.30 152 0.15 15

Scope of operations research, Scope of the OR techniques can be derived ...

Scope of the OR techniques can be derived in followings various importance fields: 1. In Agriculture : With the explosion of population and consequent shortage of food O

Seven step to a successful presentation, Seven Step to a Successful Present...

Seven Step to a Successful Presentation There  are seven  basic  step which  need to  kept  in mind at the  time of  making  a presentation. How  successful one  is at eh end

Application Areas of Linear Programming, what is meant by Application Areas...

what is meant by Application Areas of Linear Programming?

LINEAR PROGRAMMING, b. A paper mill produces two grades of paper viz., X an...

b. A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y pape

Methods of survey and study, Methods of Survey and Study:   Some method...

Methods of Survey and Study:   Some methods of collecting information about the organisation and about the information requirement of potential users are mentioned below. No si

Transportation and assignment problem, What are the computer applications o...

What are the computer applications of transportation and assignment problem

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd