Create two learning curves of the out of sample auc

Assignment Help Other Subject
Reference no: EM131408471

1) Consider again the churn dataset. Create two learning curves (using WEKA) of the out of sample AUC on the test set (churn_test.arfff) using both logistic regression and the decision tree J48 (just go with the default settings). In particular, starting from the full training set, after each iteration, reduce the training set to half until you reach less than 100 examples. Provide a plot with both curves (copy the data into EXCEL and create the charts) .

• You can cut the dataset in half easily in Weka. In the Preprocess tab, in the box marked Filter, click on Choose. Under weka->filters->unsupervised->instance you will see RemovePercentage. (Normally, it is a good idea first to run the filter Randomize, to make sure that you are removing the data randomly; real data often will be sorted based on some attribute, which can result in throwing away many data items with similar values. Don't Randomize for this assignment; the data for this assignment already will be randomized.)

• The Undo button on the preprocess tab will undo the preprocessing (like Randomizing, RemovePercentage, etc.). Keep an eye on the data statistics (like the number of instances) in the preprocess tab to verify.

2) Create a fitting curve of the generalization AUC for decision trees as a function of the MinNumObj parameter. First change the option ‘unpruned' to ‘true'. Provide a plot of the parameter and the resulting out of sample performance using either cross validation or a training/test split. What does the parameter do? What is the optimal selection for the parameter?

3) Repeat the same experiment as in step 1, but setting minnumObj=100 and unpruned=TRUE. How does the learning curve of the decision tree change? What do you infer from this result?

Attachment:- Assignment.rar

Reference no: EM131408471

Questions Cloud

What is included in nike''s balance sheet cash account : Compute the change in NIKE's current ratio and working capital from 2008 to 2009. Which accounts are the most important in explaining that change?
Implement to insure compliance : 1. Outline and briefly explain three action items you would recommend the company implement to insure compliance with both the Ontario Human Rights Code and the Employment Equity Act.
Problem regarding the cost of living : The City of St. Albans has a unionized police force that is coming up for a contract renewal. The police have one issue: the cost of living increases. During the past 10 years, police officers have received minimal cost of living increases, and th..
What trends have affected malls : This video describes the problems of suburban regional and superregional shopping centers. while malls were attractive for 50 years, they have fallen out of favor with many shoppers, leaving shopping center developers with significant challeng..
Create two learning curves of the out of sample auc : Create two learning curves of the out of sample AUC on the test set using both logistic regression and the decision tree J48 (just go with the default settings). In particular, starting from the full training set, after each iteration, reduce t..
Discuss the factors that influence internal pay structures : 1) Discuss the factors that influence internal pay structures. Based on your own experiences, which ones do you think are the most important? Why?
What would be ge’s 2008 inventory balance : What would be GE's 2008 inventory balance if it used the FIFO assumption instead? Why is the disclosure of the LIFO reserve useful to financial statement users?
Public perception of an unethical organization : How do you think unethical behavior affects employee productivity and morale? How about public perception of an unethical organization?
Compute the inventory purchases made by hp : In its 2008 annual report, Hewlett-Packard reported beginning inventory of $8.0 billion, ending inventory of $7.9 billion on the balance sheet, and cost of goods sold of $69.3 billion on the income statement. Compute the inventory purchases made b..

Reviews

Write a Review

Other Subject Questions & Answers

  Cross-cultural opportunities and conflicts in canada

Short Paper on Cross-cultural Opportunities and Conflicts in Canada.

  Sociology theory questions

Sociology are very fundamental in nature. Role strain and role constraint speak about the duties and responsibilities of the roles of people in society or in a group. A short theory about Darwin and Moths is also answered.

  A book review on unfaithful angels

This review will help the reader understand the social work profession through different concepts giving the glimpse of why the social work profession might have drifted away from its original purpose of serving the poor.

  Disorder paper: schizophrenia

Schizophrenia does not really have just one single cause. It is a possibility that this disorder could be inherited but not all doctors are sure.

  Individual assignment: two models handout and rubric

Individual Assignment : Two Models Handout and Rubric,    This paper will allow you to understand and evaluate two vastly different organizational models and to effectively communicate their differences.

  Developing strategic intent for toyota

The following report includes the description about the organization, its strategies, industry analysis in which it operates and its position in the industry.

  Gasoline powered passenger vehicles

In this study, we examine how gasoline price volatility and income of the consumers impacts consumer's demand for gasoline.

  An aspect of poverty in canada

Economics thesis undergrad 4th year paper to write. it should be about 22 pages in length, literature review, economic analysis and then data or cost benefit analysis.

  Ngn customer satisfaction qos indicator for 3g services

The paper aims to highlight the global trends in countries and regions where 3G has already been introduced and propose an implementation plan to the telecom operators of developing countries.

  Prepare a power point presentation

Prepare the power point presentation for the case: Santa Fe Independent School District

  Information literacy is important in this environment

Information literacy is critically important in this contemporary environment

  Associative property of multiplication

Write a definition for associative property of multiplication.

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd