lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Preparation of visual aids , Preparation of visual Aids ,Handouts and Feedb...

Preparation of visual Aids ,Handouts and Feedback Forms It is   always  better to prepare  visual  aids much  in advance of the presentation. Leaving  them for the  last mo

Replacement, an electric company which generates and distributes electricit...

an electric company which generates and distributes electricity conducted a study on the life of poles. tha appropriate life data are given in the following table: years after inst

Higher order table, Higher Order  Table   When  three  or more  charac...

Higher Order  Table   When  three  or more  characteristics are represented in the same  table such a table  is called  higher order table. The  need  for such  a table arises

One sample runs test - hypothesis testing, ONE SAMPLE  RUNS  TEST A ...

ONE SAMPLE  RUNS  TEST A number of  methods have been  developed fro  judging the randomness of samples on the basis of  the order in which  teh observations  are taken. It is

Network models, These models are applied to the management ( planning con...

These models are applied to the management ( planning controlling and scheduling ) of large scale projects. PERT/ CPM techniques help in identifying potential trouble spots in

Attitude measurement and methodology , Case Study  - Attitude Measurement ...

Case Study  - Attitude Measurement National Kitchens For  several years  the management  of national kitchens a diversified packaged foods manufacturer  had been  watch

Methodology, what are the methodology of operation research

what are the methodology of operation research

Regression Analysis, regression line drawn as Y=C+1075x, when x was 2, and ...

regression line drawn as Y=C+1075x, when x was 2, and y was 239, given that y intercept was 11. calculate the residual

lp-model and markov decision problem, The supply of a certain good is insp...

The supply of a certain good is inspected periodically. If an order is placed of size x >0 (integer), the ordering costs are 8+2. x. The delivery time is zero. The demand is stoc

Linear programing problems, basic requirements for solving linear programin...

basic requirements for solving linear programing using simplex method

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd