Reliability Validity Flashcards

(19 cards)

1
Q

What is the conceptual definition of validity?

A

A valid test does what it was designed to do and measures what it was designed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the four main types of validity?

A

1️⃣ Face
2️⃣ Content
3️⃣ Criterion (concurrent & predictive)
4️⃣ Construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does assessing validity mean in general?

A

It examines how well a measurement tool actually measures what it intends to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is face validity?

A

How well an instrument appears, on its face, to test what it is supposed to test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Who determines face validity?

A

Typically, the respondents or anyone reviewing the tool—asking, “Does this look like it measures what it should?”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Give an example of face validity.

A

A nutrition-knowledge test reviewed by others to see if it appears to measure nutrition knowledge.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is content validity?

A

The extent to which items represent all relevant aspects of the concept being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How is content validity established?

A

By consulting experts to verify that all important areas are covered.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Define criterion validity.

A

The ability of a tool to predict or align with results from an external, valid criterion or gold standard.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the two sub-types of criterion validity?

A
  • Concurrent validity (present)
  • Predictive validity (future).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the key difference between parallel-form reliability and criterion validity?

A

Reliability → two forms of the same test on the same group; Validity → comparing test results to a different external criterion (gold standard).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does construct validity assess?

A

How well a tool measures an underlying abstract concept (e.g., “healthy eating”).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What makes construct validity difficult?

A

Abstract constructs require multiple approaches and comparisons.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Name two types of construct validity.

A
  • Convergent validity – similar constructs correlate.
  • Discriminant validity – unrelated constructs do not correlate.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Give examples of each Convergent and Discriminant Validity

A

Convergent: Healthy eating tool vs Canada’s Food Guide → similar scores.

Discriminant: Healthy eating tool vs financial knowledge tool → different scores.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is absolute validity?

A

When a tool is compared to a true gold standard that exactly measures the intended construct.

17
Q

List three common approaches to establish validity.

A

1️⃣ Correlate new test with an established test.
2️⃣ Show people with and without certain traits score differently.
3️⃣ Ensure test tasks align with the theory underpinning the construct.

18
Q

Why is it hard to measure change over time?

A

Requires valid & reliable tools; initial levels affect results (floor/ceiling effects); practice and natural changes can skew results.

19
Q

What are floor and ceiling effects?

A

When scores cannot go lower or higher due to test limits, masking true change.