Measurement Reliability Flashcards

(22 cards)

1
Q

What does the process of conceptualization help with in research?

A

It helps translate an abstract theory or construct into specific variables and makes it possible to test hypotheses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is operationalization in research?

A

Operationalization is the process of specifying exactly what will be observed and how it will be done, including the level of measurement and the method of measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How would you operationalize “socio-economic status”?

A

Examples could include asking about total family income or the highest level of school completed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the four levels of measurement (NOIR)?

A

1) Nominal – categories, no rank
2) Ordinal – order, ranks
3) Interval – ranks with known intervals
4) Ratio – an absolute zero and meaningful ratios

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is an example of a Nominal scale?

A

Assignment of labels for categorical variables
EX. gender (male/female) or compliance (took the pill/didn’t take the pill)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is an example of an Ordinal scale?

A
  • Assignment of values along some underlying dimension
    EX. Rank in college
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an Interval scale?

A

An interval scale has equal intervals between points but no true zero. Examples include IQ scores or temperature in Celsius/Fahrenheit

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is an example of a Ratio scale?

A

Examples include age, weight, or nutrient intakes in mg/day, where there is an absolute zero point

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Why is reliability important in research?

A

Reliability refers to the consistency of a measurement tool, ensuring that measurements are dependable, predictable, and free from random error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the formula for reliability?

A

Reliability = True Score / (True Score + Error Score)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the two types of error in measurements?

A

1) Random error – due to chance; 2) Systematic error – consistent under or overestimation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are some factors that influence measurement error?

A

Factors include errors in taking measurements, equipment malfunctions, transient states of participants, and situational factors like room temperature or lighting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the four methods for evaluating reliability?

A

1) Test-Retest – stability over time
2) Parallel/Alternate Forms
3) Inter-Rater
4) Internal Consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is Cronbach’s Alpha used for?

A

It is used to measure (0-1) internal consistency, with a value of around 0.7 being considered acceptable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Split half reliability

A

Randomly divide items into 2 subsets and examin the consistency in total scores across 2 subsets

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How is reliability measured?

A

Reliability is often measured using a correlation coefficient (r), where values closer to +1.00 indicate higher reliability

17
Q

What is the difference between reliability and validity?

A

Reliability refers to the consistency of the measurement tool, while validity refers to whether the tool measures what it is supposed to measure

18
Q

What strategies can improve reliability in a study?

A
  • increasing sample size
  • eliminating unclear questions
  • standardizing testing conditions
  • minimizing the effects of external events
  • Moderate the degree of difficulty of test
  • Maintain consistent scoring procedures
19
Q

What is Test-Retest reliability?

A

give same test to same people two time points to see if same results obtained

20
Q

What is Parallel/Alternate Forms reliability?

A

give two different forms of the test to same group and compare results

21
Q

What is Inter-Rater reliability? and Intra-rater

A

Consistency between raters (having two raters judge same event/behaviour and assess agreement
- Intra-rater: Stability of measures by the same person

22
Q

What is Internal Consistency in reliability?

A

It measures how consistently the underlying construct is being measured across different items in a test