Reference no: EM13909535
George drives his car to the theater, which is at the end of a one-way street. There are parking places along the side of the street and a parking garage that costs $5 at the theater. Each parking place is independently occupied or unoccupied with probability 1/2. If George parks n parking places away from the theater, it costs him n cents (in time and shoe leather) to walk the rest of the way. George is myopic and can only see the parking place he is currently passing. If George has not already parked by the time he reaches the nth place, he first decides whether or not he will park if the place is unoccupied, and then observes the place and acts according to his decision. George can never go back and must park in the parking garage if he has not parked before.
(a) Model the above problem as a two-state dynamic programming problem. In the 'driving' state, state 2, there are two possible decisions: park if the current place is unoccupied or drive on whether or not the current place is unoccupied.
(b) Find v∗(n, u), the minimum expected aggregate cost for n stages (i.e., immediately before observation of the nth parking place) starting in state i = 1 or 2; it is sufficient to express v∗(n, u) in terms ofv∗(n - 1). The final costs, in cents, at stage 0 should be v2(0) = 500, v1(0) = 0.
(c) For what values of n is the optimal decision the decision to drive on?
(d) What is the probability that George will park in the garage, assuming that he follows the optimal policy?
Text Book: Stochastic Processes: Theory for Applications By Robert G. Gallager.
|
Find beta in the given equation
: The main problem is to find β in this equation: F(u) = ωu(u-β)(1-u)
|
|
Business challenges to those in leadership positions
: Organizations are susceptible to an array of crises.There are different types of threats with no "one way" to manage them.This reality presents multiple business challenges to those in leadership positions. Each manager is responsible
|
|
How is hate speech defined
: How is hate speech defined and does the first amendment protect against hate speech?
|
|
What is the probability that george will park in the garage
: What is the probability that George will park in the garage, assuming that he follows the optimal policy? Find v∗(n, u), the minimum expected aggregate cost for n stages.
|
|
Working memory capacity and comprehension performance
: The scores for each participant's working memory performance and comprehension task performance are shown on the right. Is there a relationship between working memory capacity and comprehension performance?
|
|
Darla has never returned thomas telephone call
: Thomas Cascade retired from his law enforcement job and began painting portraits. He loved to paint and expanded his painting into landscapes. The Festival of Arts was coming to his hometown and Thomas was invited to exhibit his paintings. On Wednesd..
|
|
Find the relationship between the relative gain vectors
: Find the relationship between the relative gain vector wk for policy k and the relative-gain vector w∗ for policy k∗. Hint: Show that rk + [Pk]w∗ = ge + w∗; what does this say about w and w∗?
|
|
The ashford university library as well as the law
: Two physicians, Dr. S. and Dr. V., leased a nuclear camera so they would no longer have to refer their patients to the local hospital for nuclear imaging. Faced with the prospect of losing over a third of its $2,274,094 in annual gross nuclear medici..
|