lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Describe states-transitions and transition rate, Customers arrive to a supe...

Customers arrive to a super market according to a Poisson process with intensity V = ½  per minute. The supermarket has two counters, that use a common queue. Counter 1 is always o

Game Theory, Task1:- A company is currently involved in negotiation with it...

Task1:- A company is currently involved in negotiation with its union on the upcoming wage contract. Positive signs in the table represent wage increase while negative sign represe

LInear Programming, - A paper mill produces two grades of paper viz., X an...

- A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y pape

Importance of normal distribution , Importance of Normal Distribution ...

Importance of Normal Distribution Normal distribution  plays  a very  important  role in  statistical  theory  and in  particular  in sampling theory. It has  been  found  th

Set of pareto optimal policies, Problem: A policy maker is considering seve...

Problem: A policy maker is considering several policy options that lead to different utility levels of different individuals a) Which Policy is would be optimal according t

Explain the competitive environment of a company, 1) Provide an overall des...

1) Provide an overall description of the business and the competitive environment in which it operates.  You should describe: a) what type of business it  is (e.g. retail, manuf

Graphical solution procedure, Graphical Solution Procedure sample assignmen...

Graphical Solution Procedure sample assignment and solved questions, free examples and solved homework samples for Graphical Solution Procedure in operation research. Question

Range - measure of dispersion , RANGE Range  is the difference  betw...

RANGE Range  is the difference  between  the highest  and the  lowest  value is  series. This is the simplest  absolute measure  of dispersion. Symbolically  : R= L- S

Evaluate a product from the view point of quality, This assignment requires...

This assignment requires you to evaluate a product from the view point of quality, both quality of design (as perceived by the user) and quality of conformance. To ensure that we a

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd