Explain ridge regression, Applied Statistics

Assignment Help:

Using log(x1), log(x2) and log(x3) as the predictors, do pair wise scatterplots of all pairs of variables (including the response) and comment (use the pairs function). Do you think that multi collinearity might be a problem with these data?

Plot the ridge trace for a grid of 50 values for the shrinkage parameter  over the range [0; 1]. Based on this plot suggest a reasonable value for . Find the estimates of the coecients for a ridge re gression with your chosen value of  (using centred and scaled predictors).

(The following question is based on Exercise 8.5 of Myers (1990), Classical and Modern Regression with Applications (Second Edition)," Duxbury).

With centred and scaled predictor variables, the ridge regression estimator for the coecients of the predictors is where y is the vector of responses, X is the design matrix for the centred and scaled predictors, is

1709_basic linear models.png

the shirnkage parameter and I denotes the identity matrix. We write n for the number of observations and k for the number of predictors. Writing biR for the ith component of bR, we will prove in this question that where 2 is the variance of the responses, and vi, i = 1,.......k are the eigenvalues of XTX. The di erent parts of the question below lead you through the proof.

735_basic linear models1.png

(a) Write XTX = QDQT for the eigenvalue decomposition of XTX, where D = diag(v1,........vk) is the diagonal matrix of eigenvalues and Q is an orthogonal matrix (QTQ = I) where the columns are the eigenvectors of XTX. Show that XTX +I = Q(D+I)QT .

2344_basic linear models2.png

where V ar(bR) denotes the covariance matrix of bR. (Hint: recall the result from basic linear models that if Y is a k  1 random vector with V ar(Y ) = V and if A is a k  k matrix and Z = AY then V ar(Z) = AV AT ).


Related Discussions:- Explain ridge regression

What is the p-value, Use the information given below to find the P-value. ...

Use the information given below to find the P-value. Also, use a 0.05 significance level and state the conclusion about the null hypothesis (reject the null hypothesis or fail to

The weekly treatment , A researcher is interested in comparing the effectiv...

A researcher is interested in comparing the effectiveness of three different parts of therapy for anger problems. 8 participants are randomly assigned to 3 treatment conditions: Co

Find the unbiased estimators for mean and variance matrix, Is the random ve...

Is the random vector (Trunk Space, Length, Turning diameter) of US car normally distributed? Why? If yes, find the unbiased estimators for the mean and variance matrix of (Trunk Sp

Time series, Year Production 2006 8 2007 6 2008 10 2009 12 2010 11 2011 15 ...

Year Production 2006 8 2007 6 2008 10 2009 12 2010 11 2011 15 2012 14 2013 16 Determine the trend from data given above?

Descriptive statistics, find the average rate of increase in population whi...

find the average rate of increase in population which in the first decade has increased 20%.in the second 25% and in the third 44%

LPP, b. A paper mill produces two grades of paper viz., X and Y. Because of...

b. A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y

Job application, .what job can you after offering that course

.what job can you after offering that course

Compute the roughness of several parametric densities, An approximation to ...

An approximation to the error of a Riemannian sum: where V g (a; b) is the total variation of g on [a, b] de ned by the sup over all partitions on [a, b], including (a; b

Philosophy, what is the aim of statistics?

what is the aim of statistics?

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd