Which evaluation measure do we use for classier

Assignment Help Computer Engineering

Reference no: EM133241260

Question: Consider a classifier that classifies documents as being either "relevant" or "non-relevant".

(a) Which evaluation measure do we use for this classier? Accuracy, precision, and/or recall? Justify your answer.

(b) Suppose that we have a collection of 10 documents - named D1,... D10 - and two different classifiers A and B. Give an example of two result sets of documents, Aq and Bq, assumed to have been returned by two different systems in response to a query q, constructed such that Aq has clearly higher precision than Bq, but Aq and Bq have the same accuracy.

(c) Suppose a classifier returns 3 relevant documents and 2 irrelevant documents to a search query. There are a total of 8 relevant documents in the collection. What is the precision of the system on this search, and what is its recall?

Reference no: EM133241260

Questions Cloud

Write the function dropodd : CIS 623 Syracuse University write the function dropOdd which, take a list xs as input, removes all the elements from the list where their positions are odd

What about demonizing the non-vaxers : What about demonizing the non-vaxers who don't agree with us? Is that ethical? Is it effective?

What does faustus do with his magical powers : What does Faustus do with his magical powers? How would you evaluate his use of these powers? Does Mephistopheles aid Faustus in his quest for knowledge

Differentiate common assessment procedures : 1. Differentiate common assessment procedures used to assess vision and hearing across the life span.

Which evaluation measure do we use for classier : Which evaluation measure do we use for classier? Accuracy, precision, and/or recall? Justify your answer

Assignment on collaboration cafe : Select one international healthcare system to compare and contrast with the Unites States healthcare system. Or, you may select two international healthcare del

Perform the timing tests, you will set the starting size : COMSC 210 Diablo Valley College perform the timing tests, you will set the starting size with the variable 'n' at the top of main(), which controls how many

Discuss welfare in terms of a current event : You are going to discuss Welfare in terms of a current event. Your initial post and peer reply should each consist of approximately 150-200 words.

Find medical history of gerd : You are working in an ER and your next patient to see is a 47 year old female who began having trouble breathing 3 days ago. She felt like it has gotten a littl

User Account

All Pages