validity and relability

Question 1

What is validity?

Answer 1

Accuracy—measures what it’s supposed to.

Question 2

What is reliability?

Answer 2

Consistency—produces stable results.

Question 3

Can something be reliable but not valid?

Answer 3

Yes—like a scale that’s always 5 lbs off.

Question 4

What are the four main types of validity?

Answer 4

Face, Content, Criterion-related (Empirical), and Construct.

Question 5

What is face validity?

Answer 5

How valid a measure appears “on its face”; based on appearance, not data.

Question 6

What is content validity?

Answer 6

Ensures the measure covers all relevant aspects of the concept.

Question 7

What is criterion-related validity?

Answer 7

Compares test results to an external standard or outcome.

Question 8

What are the two types of criterion-related validity?

Answer 8

Predictive and Concurrent.

Question 9

Predictive vs. Concurrent validity?

Answer 9

Predictive forecasts future outcomes; Concurrent compares with current measures.

Question 10

What is construct validity?

Answer 10

Tests whether a measure truly represents the theoretical concept intended.

Question 11

How is construct validity supported?

Answer 11

By consistent results across multiple studies.

Question 12

What is empirical comparison?

Answer 12

Correlates test scores with a criterion (predictive or concurrent).

Question 13

What are the three methods for assessing validity?

Answer 13

Expert judgment, empirical comparison, and construct testing.

Question 13

What is expert judgment used for?

Answer 13

Evaluates face and content validity based on expert review.

Question 14

What is construct testing?

Answer 14

Tests hypothesized relationships between constructs using data.

Question 15

What are the main ways to assess reliability?

Answer 15

Interrater, Test-Retest, and Parallel-Forms (plus Internal Consistency).

Question 16

What is interrater reliability?

Answer 16

Consistency between multiple observers’ results.

Question 17

What is test-retest reliability?

Answer 17

Stability of results when the same test is repeated over time.

Question 18

What is parallel-forms reliability?

Answer 18

Consistency between two equivalent versions of a test.

Question 19

What does internal consistency measure?

Answer 19

How consistent items within a single test are.

Question 20

How is internal consistency assessed?

Answer 20

With split-half reliability or Cronbach’s alpha.

Question 21

What is the range of r?

Answer 21

-1.0 to +1.0.

Question 22

What does +1.0 mean?

Answer 22

Perfect positive relationship.

Question 23

What does -1.0 mean?

Answer 23

Perfect negative relationship.

Question 24

What does 0 mean?

Answer 24

No relationship.

Question 25

How does r relate to reliability?

Answer 25

Indicates score consistency across raters or over time.

Question 25

How does r relate to validity?

Answer 25

Shows how closely test scores align with a criterion (higher = more valid).

Question 25

Can a measure be reliable but not valid?

Answer 25

Yes, consistent but inaccurate results.

Question 26

Can a measure be valid without being reliable?

Answer 26

No, reliability is required for validity.

Question 27

What does high reliability mean?

Answer 27

Consistent results.

Question 28

Which is more important, validity or reliability?

Answer 28

Validity—accuracy matters most.

Question 28

What does high validity mean?

Answer 28

Accurate results.

Question 29

What must a useful measure have?

Answer 29

Both validity and reliability for credible results.

Question 30

What is internal validity?

Answer 30

The degree to which results are truly due to the treatment, not other factors.

Question 30

What threatens internal validity?

Answer 30

Confounding variables that may explain results.

Question 31

Main threats to internal validity?

Answer 31

History, maturation, instrumentation, testing effect, regression, selection bias, mortality.

Question 32

What is the history threat?

Answer 32

External events during the study affect results.

Question 33

What is maturation?

Answer 33

Natural participant changes over time.

Question 34

What is instrumentation?

Answer 34

Changes in measurement tools or methods.

Question 35

What is the testing effect?

Answer 35

Pretests influence later performance.

Question 36

What is statistical regression?

Answer 36

Extreme scores move toward the mean over time.

Question 37

What is selection bias?

Answer 37

Unequal groups at baseline.

Question 38

What is mortality (attrition)?

Answer 38

Uneven participant dropout affects results.

Question 39

How can you reduce threats?

Answer 39

Use random assignment, equal conditions, and consistent procedures.

Question 40

What is a selection-history interaction?

Answer 40

: Groups experience different outside events during the study.

Question 41

Example of selection-history interaction?

Answer 41

One group gets extra tutoring that affects results.

Question 42

What is a selection-maturation interaction?

Answer 42

Groups mature or change at different rates.

Question 43

Example of selection-maturation interaction?

Answer 43

Older participants improve faster than younger ones.

Question 44

What is external validity?

Answer 44

The extent results can be generalized to other people, settings, or times.

Question 45

Why do experiments often have lower external validity?

Answer 45

Controlled conditions may not reflect real life.

Question 46

Main threats to external validity?

Answer 46

Selection bias, testing reactivity, experimental arrangement effects, multiple-treatment interference.

Question 47

What is selection bias in external validity?

Answer 47

Non-representative samples limit generalizability.

Question 48

What is pretest sensitization?

Answer 48

Pretests influence how participants respond to treatment.

Question 49

How can external validity threats be reduced?

Answer 49

Use random selection, avoid pretests, and give only one treatment per group.