Explaining accuracy when using training set data

Assignment Help Basic Computer Science
Reference no: EM1347446

Q1) Use the following learning schemes to analyze the attached files adult datasets (here is the description of the data). The files were converted to Weka file adult-Train.arff and adult-Test.arff.

ZeroR (majority class)

Naive Bayes Simple

J4.8

RandomForest

Target field is CLASS (i.e., income). For test options, first choose "Use training set", and then choose "Percentage Split" using default 66% percentage split.

1. Report each classification model, percent error rate, and accuracy. Because each learning schemes will be modeled two different test options, in total you should include 8 different classification models in your reports. For example, for ZeroR learning schema, two models will be generated one with "Use training set" and the other with "Percentage Split". Below are the steps to construct the classification model for ZeroR algorithm with test option - "Use training set".

a. Select a Classify learning schema: ZeroR
b. Training adult-Train by specifying "Use training set" as the test option. Report what classifier you get and its accuracy
c. Next, specify adult-Test as the supplied test set. Report what classifier you get and how its accuracy compare to the one in the previous step
d. Now using the other test option - "Percentage Split". Report what classifier you get and its accuracy.
e. Repeat step c. What do you observe? Does the accuracy on the test set improve and if so, why do you think it does?
f. Following the step a to e for other learning schemas: Naïve Bayes Simple, J4.8, and RandomForest.

2. Once you have built 8 models, which of these classifiers are you more likely to trust when determining whether the income is equal or grater than $50,000? Why?

3. Explain what can you say about accuracy when using training set data and when using separate percentage to train?

Reference no: EM1347446

Questions Cloud

Balance sheet under long term liabilities : ACME Corporation fiscal year ends on December 31st. At the end of 1st quarter on March 31, ACME owes $40,000 on a vehicle loan that matures in three (3) years.
Question regarding the cvp ananlysis : Suppose a fixed cost of $900, a variable cost of $4.50, and selling price of $5.50. Find out the break even point? How many units should be sold to make a profit of $500.? How many units should be sold to average $.0.25 profit per unit? .50 per un..
Find would the firms operating leverage : Would the firm's operating leverage increase or decrease if it made the change and would the new situation expose the firm to more or less business risk than the old one
What percentage of the molecules escape : A 0.410kg block is attached to a horizontal spring that is at its equilibrium length, and whose force constant is 22.0N/m . The block rests on a frictionless surface. A 6.00×10^2kg wad of putty is thrown horizontally at  block, hitting it with a s..
Explaining accuracy when using training set data : Explain what can you say about accuracy when using training set data and when using separate percentage to train?
Calculating-cost-volume-profit analysis : Sure Corporation has gathered the following information after its first year of sales. Net sales were $1,600,000 on 100,000 units; selling expenses $240,000 (40% variable and 60% fixed); direct materials $511,000; direct labor $285,000; administra..
Difference between operating and financial leverages : Show the difference between operating and financial leverage. Can there be too much financial leverage in a firm?
Construct a price weighted index : Three (3) stocks have share values of $12, $75, and $30 with total market rates of $400 million, $350 million & $150 million respectively.
Expalin performance and motivation theory : Expalin Performance and Motivation Theory - How does a leader leverage them as he or she focuses on improving business results

Reviews

Write a Review

Basic Computer Science Questions & Answers

  Identifies the cost of computer

identifies the cost of computer components to configure a computer system (including all peripheral devices where needed) for use in one of the following four situations:

  Input devices

Compare how the gestures data is generated and represented for interpretation in each of the following input devices. In your comparison, consider the data formats (radio waves, electrical signal, sound, etc.), device drivers, operating systems suppo..

  Cores on computer systems

Assignment : Cores on Computer Systems:  Differentiate between multiprocessor systems and many-core systems in terms of power efficiency, cost benefit analysis, instructions processing efficiency, and packaging form factors.

  Prepare an annual budget in an excel spreadsheet

Prepare working solutions in Excel that will manage the annual budget

  Write a research paper in relation to a software design

Research paper in relation to a Software Design related topic

  Describe the forest, domain, ou, and trust configuration

Describe the forest, domain, OU, and trust configuration for Bluesky. Include a chart or diagram of the current configuration. Currently Bluesky has a single domain and default OU structure.

  Construct a truth table for the boolean expression

Construct a truth table for the Boolean expressions ABC + A'B'C' ABC + AB'C' + A'B'C' A(BC' + B'C)

  Evaluate the cost of materials

Evaluate the cost of materials

  The marie simulator

Depending on how comfortable you are with using the MARIE simulator after reading

  What is the main advantage of using master pages

What is the main advantage of using master pages. Explain the purpose and advantage of using styles.

  Describe the three fundamental models of distributed systems

Explain the two approaches to packet delivery by the network layer in Distributed Systems. Describe the three fundamental models of Distributed Systems

  Distinguish between caching and buffering

Distinguish between caching and buffering The failure model defines the ways in which failure may occur in order to provide an understanding of the effects of failure. Give one type of failure with a brief description of the failure

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd