lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Pay-off matrix , In a rectangular game, pay-off matrix of player A is as fo...

In a rectangular game, pay-off matrix of player A is as follows: Player B B1 B2 Player A A1 A2 i) Solve the game. ii) Write down the pay-off matrix of B and th

Categories of information in social sciences, Categories of Information in ...

Categories of Information in Social Sciences: It would be useful, particularly in social sciences, to group information into three categories:  •  Statistical Information

Mathematical, Ask 7:23 PM Docx Reader GROUP-7 1. A firm manufactures two pr...

Ask 7:23 PM Docx Reader GROUP-7 1. A firm manufactures two products A & B on which the profits earned per unit is Rs.3 and Rs.4. Each product is processed on two machines Miand M2.

lp-model and markov decision problem, The supply of a certain good is insp...

The supply of a certain good is inspected periodically. If an order is placed of size x >0 (integer), the ordering costs are 8+2. x. The delivery time is zero. The demand is stoc

OR, Models in OR

Models in OR

Linear programming, Solve the following Linear Programming Problem using Si...

Solve the following Linear Programming Problem using Simple method. Maximize Z= 3x1 + 2X2 Subject to the constraints: X1+ X2 = 4 X1 - X2 = 2 X1, X2 = 0

Tied ranks equal or repeated rank, Tied Ranks Equal or Repeated Rank W...

Tied Ranks Equal or Repeated Rank When  two or more  items  have equal values  it is  difficult  to give ranks  to them. In  that case  the items are given  the average of the

CONCEPT OF DUALITY IN LPP, EXPLAIN THE CONCEPT OF DUALITY IN LPP THROUGH A ...

EXPLAIN THE CONCEPT OF DUALITY IN LPP THROUGH A LIFE SITUATION

Simple method, solve the LPP using simple method, maximize z= 3x1+2x2 subje...

solve the LPP using simple method, maximize z= 3x1+2x2 subject to constraints

Discuss how theories is helpful researchers in communication, QUESTION 1 ...

QUESTION 1 i) What do you understand by the following terms? And what is their role in communication theories? Ontology Epistemology Axiology ii) Discuss how

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd