lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Operation Research Models, Explain the classification of models 1. Classifi...

Explain the classification of models 1. Classification by function or uses 2. Classification by degree of qualification 3. Classification by physical characteristics 4. Classidicat

MB0048, A paper mill produces two grades of paper viz., X and Y. Because of...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Assignment, discuss about assignment and steps involved in it

discuss about assignment and steps involved in it

Information resources, INFORMATION RESOURCES: Information resources ar...

INFORMATION RESOURCES: Information resources are of two kinds, namely, Documentary and Non-Documentary Sources. Documentary Sources: A document embodies thought. I

Analyse the average number and mean number, Consider the closed network of ...

Consider the closed network of the following figure. The number at the arrows give the transition probabilities for a customer leaving the queue to route to a subsequent queue. Eve

Action phase - phase of operation research, The action phase consists of ...

The action phase consists of making recommendations for remedial action to those who first posed the problem and who control the operations directly. These recommendatio

On the basis of ratio of change direction, On the  Basis  of Ratio of Ch...

On the  Basis  of Ratio of Change  Direction   a. Linear Correlation: The  correlation  between  two variables a said  to be liner if  corresponding  to a unit change in th

Meaning of research report - report writing presentation, Meaning of Resear...

Meaning of Research Report Research  report is the process of communicating  the  results  of an investigation it  is a document which  reflect about  the research conducted a

Describe states-transitions and transition rate, Customers arrive to a supe...

Customers arrive to a super market according to a Poisson process with intensity V = ½  per minute. The supermarket has two counters, that use a common queue. Counter 1 is always o

REGRESSION, regression line drawn as Y=C+1075x, when x was 2, and y was 239...

regression line drawn as Y=C+1075x, when x was 2, and y was 239, given that y intercept was 11. calculate the residual

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd