Z-Score
(x-mean)/std
coefficient alpha/internal consistency (OBJECTIVE measure)
correlates one measure with all others on a test. Should be at .7 to be acceptable
test-retest reliability (OBJECTIVE measure)
should score the same if taking at different points in time; evaluates the amount of situational error
Should be between .5-.9 to be acceptable
INTRArater reliability (SUBJECTIVE measure)
same person at 2 points in time
Should be above .8 to be acceptable
INTERrater reliability (SUBJECTIVE measure)
different person at 2 points in time
similar to test-retest
reliability vs. validity
reliability = consistency validity = measure truly measures the attribute it was intended to (accuracy of measurement AND prediction)
relationship of reliability and validity
squareroot of reliability is the MAX validity (validity of 1 is out of the picture)
two types of validation studies
job-related validation: compares test to actual job performance
content validation: correlation is “guessed” “Yep, that looks like it measures ______”
concurrent vs. predictive validation designs
concurrent - correlate job performance and test scores of current employees
predictive - give to job applicants, don’t use in hiring decision, use performance of new hires to correlate with scores
2 times to use content validation
1) when there are too few people to form a sample for criterion/job-related validation measures
2) when criterion measures are not available
* can be supported by validity generalization
situation-specific validity vs. validity generalization
situation specific - different validity test for every situation
generalization - combine all validation studies to come up with a general validity
Resume and Cover Letters (INITIAL)
Application Blanks (INITIAL)
Biodata (INITIAL)
Reference Check (INITIAL)
- (from .26 unstructured to .4 w/ structure)
Interview (INITIAL)
- little evidence about usefulness
Unstructured Interview vs. Structured Inteview (SUBSTANTIVE)
Unstructured: -r=0.38, moderate, but could be better -done by small/med organizations Structured: -r=0.5, high
BARS
behaviorally anchored rating scale (predetermined rating scale)
Personality Test (SUBSTANTIVE)
- correlation broken down by each factor
Extraversion (part of personality test)
Emotional Stability (part of personality test)
Agreeableness (part of personality test)
Conscientiousness (part of personality test)
Openness to Experience (part of personality test)