Reliability and Validity Flashcards

(25 cards)

1
Q

Attitudes, beliefs, emotions, personality traits, etc. that cannot be observed tangibly are called..?

A

Constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

The field of psychological measurement, dedicated to finding ways to assign scores to individuals to represent these constructs.

A

Psychometrics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describes what the construct is made up of - a description of the internal processes nd behaviors that constitute it

A

Conceptual definition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

This is how the construct is measured in an empirical study

A

Operational definition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Refers to the consistency of a measure

A

Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Types of reliability

A

Test-retest reliability
Internal consistency
Interrater Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Consistency of a measure across time, applicable for measurements of constructs that are assumed to be relatively stable/unchanging for a long period of time

A

Test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How consistent a measure is within itself

A

Internal consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Consistency of a measure across time, applicable for measurements of constructs that are assumed to be relatively stable/unchanging for a long period of time

A

Test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

If i divide the measure into two, would they be highly-correlated?

A

Split-half reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How consistent a measure is within itself

A

Internal consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Consistency of a measure across different judgements - for measures score by external judges rather than self-scored/automatically scored inventories

A

Interrater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How well the measure represents the variable its supposed to be measuring

A

Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Does the measurement appear to measure what it claims to measure?

A

Face validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Types of Validity (Sigh)

A

Face Validity
Content Validity
Criterion Validity (Concurrent & Predictive Validity)
Convergent Validity
Discriminant Validity
Construct Validity
Statistical Validity
Internal Validity
External Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Is the measurement comprehensive in covering the construct based on how it’s defined?

A

Content validity

15
Q

Does the measure correlate with variables that it is conceptually related to?

A

Criterion Validity

16
Q

The correlation with variables measured at the same time (person’s extraversion vs number of people in their social circle)

A

Concurrent Validity

17
Q

The correlation with variable measures at a late date (new hire’s conscientiousness vs how well they hit job goals a year into job)

A

Predictive Validity

18
Q

Correlation with other measurements of the same variable (self-report and peer report personality questionnaires)

A

Convergent Validity

19
Q

No correlation with measurements of different variable (conscientiousness vs academic achievement)

A

Discriminant Validity

20
Q

How well are the variables operationalized? Do results reflect the conceptual definition of construct?

A

Construct Validity

21
Q

How strong is the statistical evidence to support the research results? Is there enough margin of error to cast doubt?

A

Statistical Validity

22
Q

Can you truly claim cause and effect or are there confounding variables that might lead to alternate explanations?

A

Internal Validity

23
Can the findings be generalized?
External Validity