What does the first principal component (PC) explain in PCA?
Most variance
Each subsequent PC explains less variance than the previous one.
In PCA, all principal components are _______.
uncorrelated
This property allows for the independent interpretation of each component.
What is sometimes difficult to interpret in PCA?
Factor-item correlation (factor loadings)
These correlations indicate how strongly each item relates to the factors.
Which labels can you put on factor 1 and factor 2 based on the provided correlations?
The labels are based on the loadings of the items on each factor.
What indicates a low incremental validity in predictors?
High correlation between X1 and X2
Predictor 2 explains a small unique amount of the criterion.
What is the aim of Principal Component Analysis (PCA)?
Find factors that explain as much variance as possible
PCA seeks to create a weighted combination of item scores.
What does high correlation between predictors indicate?
Low incremental validity
This means that the second predictor adds little value beyond the first.
What does incremental validity measure?
The additional value of a test on top of existing information
It is important for understanding how well a new test predicts outcomes.
In the context of predictive validity, what does range restriction lead to?
Underestimation of predictive validity
This occurs when only high-scoring candidates are selected.
What is the Multiple Group Method (MGM) used for?
Confirming expected groupings of variables
It assesses whether the expected structure is found in the data.
What is the variance accounted for (VAF) in PCA?
How well the factors represent the variation in the data
VAF is usually between .30 - .80.
What does a scree plot help determine?
The number of principal components
It shows where the variance explained begins to level off.
What is the Kaiser criterion in PCA?
Eigenvalue > 1
This criterion helps decide how many components to retain.
What is the goal of rotation in PCA?
To achieve a clearer structure of factors
Rotation helps to maximize the variance accounted for by each factor.
What does factor analysis aim to do?
Summarize many variables into fewer factors
It retains as much information as possible.
What is the difference between exploratory and confirmatory factor analysis?
Exploratory seeks to discover patterns, while confirmatory tests hypotheses.
What does item-rest factor correlation measure?
Correlation of an item with the factor sum score excluding that item
It helps assess the item’s contribution to the factor.
What is the relationship between predictors and criterion in incremental validity?
Correlation with criterion Y should be as high as possible
Correlation with existing predictors X should be as low as possible.
What does a high loading on both principal components indicate?
Items may need rotation for clearer interpretation
This situation complicates the identification of distinct factors.
What is the central idea of factor analysis?
There are similar patterns of responses that cluster together
These patterns help identify underlying constructs.
What does VAF stand for?
Variance accounted for
VAF is used to describe the proportion of variance in a dependent variable that is predictable from the independent variables.
What is the aim of rotation in factor analysis?
Substitute PC’s by new factors with in total the same amount of VAF
This aims to achieve a clearer interpretation of the factors.
How do we determine the number of principal components?
This is a subjective decision based on prior knowledge or exploratory analysis.
Using the Eigenvalue criterion, how many components are concluded for ‘statistics anxiety’?
Four components
This is because there are 4 components with an Eigenvalue larger than 1.