What is the percentage of variance captured by components

Reference no: EM132284368

Assignment - PCA and Clustering

1. Principal component analysis

sklearn comes with several data sets. Load data set called digits by running following code from sklearn.datasets import load_digits DigitData =load_digits()

digits is a dataset of handwritten digits in matrix form of 8x8 pixels that means the dimension of data is 64. Our goal is to reduce this dimension to some lower dimension by using principal component analysis.

Run the PCA on the data. Get the first two components and plot it with their corresponding labels.

To run PCA, use PCA from sklearn.decomposition.

Note: you can use pyplot from matplotlib for plotting.

What do you observe? What is the percentage of variance captured by these two components? Is it sufficient or we should find more components?

2. K-mean Clustering

use the same digit data set as above from sklearn.datasets

It is a good idea to scale this data before performing clustering. To do that use scale from sklearn.preprocessing

Show the images with their labels using matplotlib.

Divide the data into training set and test set with testset = 20% of total data.

To divide the data into training and test set, use train_test_split from sklearn.cross validation

Perform clustering assuming there are 10 clusters.

To perform clustering, use cluster from sklearn.

U se KMeans function of cluster (cluster.KMeans).

Assign numbering or labels to your clusters (remember your labeling has nothing to do with actual labels, we pretend that we do not know the actual labels)

Test your cluster on the test data set. What do you observe? Print a confusion matrix of your test.

To divide the data into training and test set, use train_test_split from sklearn.cross validation

Perform clustering assuming there are 10 clusters.

To perform clustering, use cluster from sklearn.

Use KMeans function of cluster (cluster.KMeans).

Assign numbering or labels to your clusters (remember your labeling has nothing to do with actual labels, we pretend that we do not know the actual labels)

Test your cluster on the test data set. What do you observe? Print a confusion matrix of your test.

What to submit? A single jupyter notebook file with code and results.

Reference no: EM132284368

Questions Cloud

Solve the issues related to healthcare policies : Locate a news article or story related to a current event in healthcare policy. Some examples may be, but are not limited to healthcare reform.

Explain how article supports the sustainability initiative : Identify best practices you can use in your sustainability initiative - Explain how the article supports the sustainability initiative you are developing

Identify two or three unique strengths : How well you answer this question could be the difference between getting the job and not getting the job.

Article change your perception of google as employer : Why are older employees often neglected or discriminated against? Does this article change your perception of google as an employer? How?

What is the percentage of variance captured by components : Principal component analysis - What do you observe? What is the percentage of variance captured by these two components

What are some of the limitations of using the swot model : We can apply concepts from various models, such as SWOT, SPACE, PEST/PESTLE, Porter's Five Forces, the BCG Portfolio matrix, etc. Understanding the basic.

Knowledge management strategy to business strategy : How can an organization align its knowledge management strategy to the business strategy?

Why it is important for a company to have a viable business : The 5 most basic strategic approaches for setting a company apart from rivals and winning a sustainable competitive advantage.

Customer service representative : For this assignment you will compose two different messages - the first as a customer, and the second as a customer service representative.

User Account

All Pages