lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

A paper mill produces two grades of paper viz., A paper mill produces two g...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Operations Research, a. What do you mean by linear programming problem? Exp...

a. What do you mean by linear programming problem? Explain the steps involved in linear programming problem formulation? b. A paper mill produces two grades of paper viz., X and Y.

Graphs of time series, Graphs of Time Series A time  series  is a sequ...

Graphs of Time Series A time  series  is a sequence of values  corresponding  to successive points  of time. Time  series  are  graphed  with time  on the x axis  and the  oth

Oral presentation - report writing presentation, Oral Presentation At ...

Oral Presentation At times  oral presentation of the  results of the study is considered effective particularly in case where  policy recommendations are indicated by project

MODERN MANAGEMENT, DISCUSS THE SIGNIFICANCE AND SCOPE OF OPERATION RESEARCH...

DISCUSS THE SIGNIFICANCE AND SCOPE OF OPERATION RESEARCH IN MODERN MANAGEMENT

Management Applications of Operation Research, Some areas of applications a...

Some areas of applications are Purchasing, Procurement and Exploration Quantities and timing of purchase Replacement policies Rules for buying, supplies Finance, Budgeting and Inv

Compute the joining, The Best Corporation is considering making either mino...

The Best Corporation is considering making either minor or major repairs to a malfunctioning production process.  When the process is malfunctioning, the percentage of defective it

project management , Project Management Your  data need to be orga...

Project Management Your  data need to be organized in such  a way that  access to them  is both  quick  and accurate. In  achieving  this a good qualitative analysis progra

Probability and non probability sampling , Probability and Non  Probability...

Probability and Non  Probability Sampling The following s are some  of the  considerations for the  selection  of probability  an non  probability  sampling. 1.Sometimes p

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd