How is the pruned tree used for classification

Assignment Help Computer Engineering

Reference no: EM131926076

Problem

Predicting Delayed Flights. The file FlightDelays.csv contains information on all commercial flights departing the Washington, DC area and arriving at New York during January 2004. For each flight, there is information on the departure and arrival airports, the distance of the route, the scheduled time and date of the flight, and so on. The variable that we are trying to predict is whether or not a flight is delayed. A delay is defined as an arrival that is at least 15 minutes later than scheduled.

Data Preprocessing. Transform variable day of week (DAY_WEEK) info a categorical variable. Bin the scheduled departure time into eight bins (in R use function cut()). Use these and all other columns as predictors (excluding DAY_OF_MONTH). Partition the data into training and validation sets.

a. Fit a classification tree to the flight delay variable using all the relevant predictors. Do not include DEP_TIME (actual departure time) in the model because it is unknown at the time of prediction (unless we are generating our predictions of delays after the plane takes off, which is unlikely). Use a pruned tree with maximum of 8 levels, setting = 0.001. Express the resulting tree as a set of rules.

b. If you needed to fly between DCA and EWR on a Monday at 7:00 AM, would you be able to use this tree? What other information would you need? Is it available in practice? What information is redundant?

c. Fit the same tree as in (a), this time excluding the Weather predictor. Display both the pruned and unpruned tree. You will find that the pruned tree contains a single terminal node.

i. How is the pruned tree used for classification? (What is the rule for classifying?)

ii. To what is this rule equivalent?

iii. Examine the unpruned tree. What are the top three predictors according to this tree?

iv. Why, technically, does the pruned tree result in a single node?

v. What is the disadvantage of using the top levels of the unpruned tree as opposed to the pruned tree?

vi. Compare this general result to that from logistic regression in the example in Chapter 10. What are possible reasons for the classification tree's failure to find a good predictive model?

Reference no: EM131926076

Questions Cloud

Describe the rise of nazism in germany : Describe the rise of Nazism in Germany. Indicate the conditions present in Germany that made it possible for Hitler to come to power.

Calculate basic descriptive statistics of selected variables : Calculate the basic descriptive statistics of the selected variables. Draw the distributions and box-plots of every variable you have

How can a cyclic object graph be represented using the data : How can a cyclic object graph be represented using the data types described in this chapter? In what ways is a .NET array different from a Sequence?

What is the fee to run the fund : You invested $1,250,000 with a market-neutral hedge fund manager. The fee structure is 2/20, and the fund has a high-water-mark provision.

How is the pruned tree used for classification : How is the pruned tree used for classification? Examine the unpruned tree. What are the top three predictors according to this tree?

How will you decide which department should get equipment : Imagine that you are the administrator of a nonprofit community hospital. You have been approached by medical staff from two different departments.

What role does healthcare leadership play : Prepare an analysis based on what your research can discover, on the role of HIT, including artificial intelligence and supercomputing

Official discourse in the dominican republic : 1. What was the result of the Haitian genocide for the official discourse in the Dominican Republic?

Describe the interesting and uninteresting information : Describe the interesting and uninteresting information that these rules provide. Is this model practical for predicting the outcome of a new auction?

User Account

All Pages