lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Li, line drawn as Y=C+1075x, when x was 2, and y was 239, given that y inte...

line drawn as Y=C+1075x, when x was 2, and y was 239, given that y intercept was 11. calculate the residualon..

Graphs of time series, Graphs of Time Series A time  series  is a sequ...

Graphs of Time Series A time  series  is a sequence of values  corresponding  to successive points  of time. Time  series  are  graphed  with time  on the x axis  and the  oth

Lpp, a paper mill prodecs two grades of paper viz., X and Y. Because of raw...

a paper mill prodecs two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper in

Lcd projectors - reoprt writing presentation , LCD Projectors  LCD...

LCD Projectors  LCD projectors  are several  steps  ahead of conventional OHPs. These  projectors  are more  compact  and more  powerful  and can  be directly  linked to a

Linear programming, How do I set this problem up for Excel: A National Cred...

How do I set this problem up for Excel: A National Credit Union has $250,000 available to invest in a 12 month commitment. The money can be placed in Treasury notes yielding an 8%

Characteristics of scientific research, Horton and hunt have given follow...

Horton and hunt have given followings nine characteristics of scientific method: 1. Verifiable evidence i e, factual observations which other observers can see and check

LPP, A paper mill produces two grades of paper viz., X and Y. Because of ra...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Question, A paper mill produces two grades of paper viz., X and Y. Because ...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Rephrasing the research problem, Rephrasing the Research Problem Final...

Rephrasing the Research Problem Finally as a researcher you should rephrase the research problem. Once you have followed all the four steps above, i.e., 1) You have clear

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd