Reliability

Question 1

What is measurement reliability?

Answer 1

Measures and produces the same results over time and across contexts.

• consistency over time
• consistency within items

Question 3

How high do reliability coefficients of measurements need to be?

Answer 3

• .80 and above = Good.
• .70 and above = Adequate
• .60 and below = Inadequate
• between .70 and .60 = Zone of argument

Question 4

What is Test-Retest Reliability?

Answer 4

• performance across time-
• Give measure twice and assess consistency between scores

Question 5

What is Split Half Reliability?

Answer 5

• performance across scale parts
• Divide measure in half and assess consistency between parts (of same concept)

Question 6

What is Intercoder Reliability?

Answer 6

• consistency among observers/coders/raters
• Assess percentage of agreement in decisions

Question 7

What can cause poor reliability?

Answer 7

1. Too few questions
2. Too many questions
3. Familiarity with measurement format
4. Mood
5. Environment (noise and temp)
6. Motivation
7. Memory (stick to short time frame to recall info but big enough to get data correctly)
8. Prior experience with a variable (know how to answer to get what they want)

Question 8

What is Internal Consistency Reliability?

Answer 8

• measures how consistent the items in a scale are with each other
• compute a correlation of how each item relates to every other item (cronbach’s alpha)