Calculate the bayes decision boundary

Assignment Help Other Subject
Reference no: EM132490380

Question 1. Solve the following problems from Chapter 2 of the text book. 12, 13, 14 (a), (b), (c), 27

Note: The problem numbers listed in this assignment are from the second edition of the text book. Check the version you have and make sure you are solving the right problem.

Question 2. Consider a two-category classification problem with two-dimensional feature vector X = (x1, x2). The two categories are ω1 and ω2.

p(X| ω1 ) ~ N ([-1], Σ1),
                     [2]

p(X| ω2 ) ~ N ([1], Σ2),
                     [2]

P (ω1) = P (ω2) = 1/2,

and

Σ1 = [1  1] , Σ2 = [2  0]
        [1 2] ,         [0 2]

(a) Calculate the Bayes decision boundary.

(b) Generate 50 random patterns from each of the two class-conditional densities and plot them in the two-dimensional feature space. Also draw the decision boundary and ellipses of concentration on this plot.

(c) Calculate the Bhattacharya error bound.

(d) Generate 1, 000 additional test patterns from each class and determine the em- pirical error rate based on the decision boundary in 2(a). Compare this error with the bound in part 2(c).

Question 3. Consider the following bivariate class-conditional density function for feature vector

X = [x1]
     [x2]

µ = [µ1] ;     Σ = [σ12  σ21] ; σ12 = σ21
      [µ2]            [σ21 σ22]

(a) What is the expression for the Euclidean distance between point X and mean vector µ?

(b) What is the expression for the Mahalanobis distance between point X and mean vector µ. Simplify this expresion by expanding the quadratic term?

(c) Compare the expressions in 3(a) and 3(b). How does the Mahalanobis distance differ from the Euclidean distance? When are the two distances equal? When is it more appropriate to use the Mahalanobis distance over the Euclidean distance? Support your answers with illustrations.

Question 4. The class-conditional density functions of a discrete random variable X for four pat- tern classes are shown below:

x

p(x/ω1)

p(x/ω2)

p(x/ω3)

p(x/ω4)

1

1/3

2/3

1/6

2/5

2

2/3

1/3

5/6

3/5

The loss function λ(•) is as follows, where action αi means "decide pattern class ωi":

 

 

ω1

ω2

ω3

ω4

α1

0

2

3

4

α2

1

0

1

8

α3

3

2

0

2

α4

5

3

1

0

Assume the following class prior probabilities: P (ω1) = 1/4, P (ω2) = 1/4, P (ω3) = 1/8, P (ω4) = 3/8.

(a) Compute the conditional risk for each action as follows:

R(αi| x) = Σ4j=1λ(αi | ωj)P (ωj | x), i = 1, . . . , 4

(b) Compute the overall risk R, given as:

R = Σ2i=1R(α(xi) | xi)p(xi)

where α(xi) is the decision rule minimizing the conditional risk for xi.

Question 5. In a particular binary hypothesis testing application, the conditional density for a scalar feature x given class w1 is

p(x | ω1) = k1(exp(-x2/10))
Given class w2 the conditional density is

p(x | ω2) = k2(exp(-(x - 2)2/2))

(a) Find k1 and k2, and plot the two densities on a single graph.
(b) Assume that the prior probabilities of the two classes are equal, and that the loss for choosing correctly is zero. If the loss for choosing incorrectly are λ12 = 1 and λ21 = 5, what is the expression for the Bayes risk?

(c) Find the decision regions which minimize the Bayes risk, and indicate them on the plot you made in part (a).

(d) For the decision regions in part (c), what is the numerical value of the Bayes risk?

Reference no: EM132490380

Questions Cloud

List any internal controls violated in this situation : Required - List any internal controls violated in this situation and propose a solution either to prevent, detect or correct it
Review article and create questions regarding the reading : Instructions for assignement: After reading create 2 questions that you might still have regarding the reading. something you dont understand about the article.
How to calculate the depreciation expense for year five : Determine how to calculate the depreciation expense for year five. A company purchased a building for $210,000 with a service life of 10 years.
What is the APR for these monthly loans : Straight bank loan. Right Bank offers EAR loans of 8.85% and requires a monthly payment on all loans. What is the APR for these monthly loans
Calculate the bayes decision boundary : Calculate the Bayes decision boundary and Calculate the Bhattacharya error bound. - Generate 50 random patterns from each of the two class-conditional
How much must invest at end of each of the next ten years : Sam can earn 10% annually on his investments, how much must he invest at the end of each of the next 10 years to be able to buy his dream home when he retires.
Explain the requirements must be met to receive a tax credit : Explain the requirements that must be met to receive a tax credit for child and dependent care expenses, and the limitations concerning the amount
What is the total cost savings would result : Best Guitars, Inc What should Taylor's decision be, and what is the total cost savings that would result? what is the relevant fixed overhead?
Potential energy and kinetic energy : There will be linear and proportional to each other. Can someone please explain this in terms of potential energy and kinetic energy?

Reviews

Write a Review

Other Subject Questions & Answers

  Cross-cultural opportunities and conflicts in canada

Short Paper on Cross-cultural Opportunities and Conflicts in Canada.

  Sociology theory questions

Sociology are very fundamental in nature. Role strain and role constraint speak about the duties and responsibilities of the roles of people in society or in a group. A short theory about Darwin and Moths is also answered.

  A book review on unfaithful angels

This review will help the reader understand the social work profession through different concepts giving the glimpse of why the social work profession might have drifted away from its original purpose of serving the poor.

  Disorder paper: schizophrenia

Schizophrenia does not really have just one single cause. It is a possibility that this disorder could be inherited but not all doctors are sure.

  Individual assignment: two models handout and rubric

Individual Assignment : Two Models Handout and Rubric,    This paper will allow you to understand and evaluate two vastly different organizational models and to effectively communicate their differences.

  Developing strategic intent for toyota

The following report includes the description about the organization, its strategies, industry analysis in which it operates and its position in the industry.

  Gasoline powered passenger vehicles

In this study, we examine how gasoline price volatility and income of the consumers impacts consumer's demand for gasoline.

  An aspect of poverty in canada

Economics thesis undergrad 4th year paper to write. it should be about 22 pages in length, literature review, economic analysis and then data or cost benefit analysis.

  Ngn customer satisfaction qos indicator for 3g services

The paper aims to highlight the global trends in countries and regions where 3G has already been introduced and propose an implementation plan to the telecom operators of developing countries.

  Prepare a power point presentation

Prepare the power point presentation for the case: Santa Fe Independent School District

  Information literacy is important in this environment

Information literacy is critically important in this contemporary environment

  Associative property of multiplication

Write a definition for associative property of multiplication.

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd