lp-model and markov decision problem, Operation Research

Assignment Help:

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 


Related Discussions:- lp-model and markov decision problem

Set of pareto optimal policies, Problem: A policy maker is considering seve...

Problem: A policy maker is considering several policy options that lead to different utility levels of different individuals a) Which Policy is would be optimal according t

Method of calculation of mean deviation, Method of Calculation of Mean  De...

Method of Calculation of Mean  Deviation a. Computation of Mean Deviation Individual Series : The process of computing mean  deviation in case  of individual series involves

Tower of hanoi problem, Step 1: Research Towers of Hanoi problem The Tow...

Step 1: Research Towers of Hanoi problem The Towers of Hanoi is a problem frequently used to teach recursive programming techniques. Step 2: Run the assembly code from Hanoim

Environmental demands, Problem 1 Explain the key elements, which contri...

Problem 1 Explain the key elements, which contribute to a sound and effective strategy. >>Explanation of following elements Market Consumers Competition Skil

Competitive models, These models have been developed to establish a trade ...

These models have been developed to establish a trade off between costs of providing and the waiting time of a customer in the queuing system. Constructing a model entails desc

Some guidelines for bibliography entries , Some Guidelines  for Bibliograp...

Some Guidelines  for Bibliography Entries 1. Reference of a Back  by One Authors : Mention authors  name book title ( in italics hence  to be  underlined) city  publication

Line balancing, what happen if line balancing does not exist

what happen if line balancing does not exist

Research analysis and project, Scenario: You work as a junior employee i...

Scenario: You work as a junior employee in the marketing department of a medium-sized Hong Kong organisation. One of your major tasks is your involvement in your organization's

Knowledge - library and information services, Knowledge: The dictionar...

Knowledge: The dictionary definition of knowledge is 'organised body of information or the comprehension and understanding, consequent on having acquired an organised body of

Use of t -tables - hypothesis testing , Use of t -tables            ...

Use of t -tables            Similar  to normal  curve  tables  there  exist t- distribution  tables. However  whereas the properties of  the normal  curve are constant for all

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd