TransWikia.com

PCA loadings of correlation matrix

Cross Validated Asked by mri on October 20, 2020

I know similar questions have been asked before already but I’m still a bit confused about the understanding of ‘loadings’.

Eigenvectors are unit-scaled loadings; and they are the coefficients
(the cosines) of orthogonal transformation (rotation) of variables
into principal components or back. (Loadings vs eigenvectors in PCA: when to use one or another?)

[…]cosϕ is the Pearson correlation between V and component F1
(What is the proper association measure of a variable with a PCA component (on a biplot / loading plot)?)

So the eigenvectors indicate the correlation between the component and the variables and loadings are those eigenvectors multiplied by the square root of the corresponding eigenvalue. The eigenvalue equals the variance explained by the component.

Now lets say we perform a correlation-matrix based PCA.

If we PCA-analyzed not just centered but standardized (centered then
unit-variance scaled) variables the three variables vectors (not their
projections on the plane) would be of the same, unit length. Then it
follows that a loading is correlation, not covariance, between a
variable and a component.[…] In correlation-based PCA a1=cosϕ
because h=1, but principal components are not those same principal
components as we get from covariances-based PCA. (see prior link)

For me this sounds like in this case the loading equals the eigenvector. But when the loading is computed as mentioned above then it has to be different from the eigenvector (unless sqrt(eigenvalue) = 1). It appears that on several websites eigenvectors and loadings are used interchangeably and loadings are often defined as “the correlation between a variable and a component” but I’m not sure anymore if the eigenvector or loading (as computed) is meant.

What exactly does a loading value tell me regarding a variable? How does that differ from what the eigenvector value tells me about that variable?
Also, can a loading for a variable on correlation based PCA be greater than 1?

(I’m sorry if I’m mixing things up here but the more I read into it the more I get confused so I hope you can help me getting a clearer understanding. Help is much appreciated!)

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP