Formulate this problem as a markov decision process

Assignment Help Basic Statistics
Reference no: EM131104728

A chemical company produces two chemicals, denoted by 0 and 1, and only one can be produced at a time. Each month a decision is made as to which chemical to produce that month. Because the demand for each chemical is predictable, it is known that if 1 is produced this month, there is a 70 percent chance that it will also be produced again next month. Similarly, if 0 is produced this month, there is only a 20 percent chance that it will be produced again next month. To combat the emissions of pollutants, the chemical company has two processes, process A, which is efficient in combating the pollution from the production of 1 but not from 0, and process B, which is efficient in combating the pollution from the production of 0 but not from 1. Only one process can be used at a time. The amount of pollution from the production of each chemical under each process is

Unfortunately, there is a time delay in setting up the pollution control processes, so that a decision as to which process to use must be made in the month prior to the production decision. Management wants to determine a policy for when to use each pollution control process that will minimize the expected total discounted amount of all future pollution with a discount factor of α = 0.5.

(a) Formulate this problem as a Markov decision process by identifying the states, the decisions, and the Cik. Identify all the (stationary deterministic) policies.

(b) Use the policy improvement algorithm to find an optimal policy.

Reference no: EM131104728

Questions Cloud

A chemical company produces two chemicals : A chemical company produces two chemicals, denoted by 0 and 1, and only one can be produced at a time. Each month a decision is made as to which chemical to produce that month.
Prepare a single step income statement for the year ended : Turner Corporation had net sales of $2,400,000 and interest revenue of $31,000 during 2004. Expenses for 2004 were: cost of goods sold $1,250,000; administrative expenses $212,000; selling expenses $280,000; interest expense $45,000.
What are samantha legal rights : Samantha purchased a used computer system from Office Rental Inc. who was updating its computers. Later Big Bank asserted the right to repossess the used computer system from Samantha since it had a lien on all of Office Rental's business equipmen..
Provide java code to create and initialize array of integers : Provide a Java code to create and initialize an array of integers (Java primitive int), floats or any other Java primitive type of your choice
Formulate this problem as a markov decision process : (a) Formulate this problem as a Markov decision process by identifying the states, the decisions, and the Cik. Identify all the (stationary deterministic) policies.
Determine the force in members fg eg and eh : Show transcribed image text The truss shown was designed to support the roof of a food market. For the given loading, determine the force in members FG, EG, and EH. Hint: Method of Section.
Communication theory ashford university discussion : Describe the essential principles of communication and provide examples of its benefits, forms, and purposes. In what ways have you been able to apply these principles in your work and/or studies? Support your response with a minimum of two source..
What factors do you think are associated with difference : Why do you think UCF's alcohol violation rate is so drastically different from the University of Miami? What factors do you think are associated with the difference?
Use the policy improvement algorithm to determine : The price of a certain stock is fluctuating between $10, $20, and $30 from month to month. Market analysts have predicted that if the stock is at $10 during any month, it will be at $10 or $20 the next month, with probabilities 4/5 and 1/5 respect..

Reviews

Write a Review

Basic Statistics Questions & Answers

  Statistics-probability assignment

MATH1550H: Assignment:  Question:  A word is selected at random from the following poem of Persian poet and mathematician Omar Khayyam (1048-1131), translated by English poet Edward Fitzgerald (1808-1883). Find the expected value of the length of th..

  What is the least number

MATH1550H: Assignment:  Question:     what is the least number of applicants that should be interviewed so as to have at least 50% chance of finding one such secretary?

  Determine the value of k

MATH1550H: Assignment:  Question:     Experience shows that X, the number of customers entering a post office during any period of time t, is a random variable the probability mass function of which is of the form

  What is the probability

MATH1550H: Assignment:Questions: (Genetics) What is the probability that at most two of the offspring are aa?

  Binomial distributions

MATH1550H: Assignment:  Questions:  Let’s assume the department of Mathematics of Trent University has 11 faculty members. For i = 0; 1; 2; 3; find pi, the probability that i of them were born on Canada Day using the binomial distributions.

  Caselet on mcdonald’s vs. burger king - waiting time

Caselet on McDonald’s vs. Burger King - Waiting time

  Generate descriptive statistics

Generate descriptive statistics. Create a stem-and-leaf plot of the data and box plot of the data.

  Sampling variability and standard error

Problems on Sampling Variability and Standard Error and Confidence Intervals

  Estimate the population mean

Estimate the population mean

  Conduct a marketing experiment

Conduct a marketing experiment in which students are to taste one of two different brands of soft drink

  Find out the probability

Find out the probability

  Linear programming models

LINEAR PROGRAMMING MODELS

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd