Reliability and Validity Flashcards

(25 cards)

1
Q

Types of measures (operational definitions)

A

self-report, observational, physiological

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

define self-report measure

A

participant’s answers to questions about themselves (questionnaire or interview)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

define observational measure

A

recording observable behaviors (i.e. allergies - how often someone sneezes)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

define physiological measure

A

recording biological data. (i.e. EEG/ERP, HR, hormone levels)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

two types of measurements

A

categorical, quantitative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

define categorical variable

A

nominal. levels are qualitatively distinct (i.e. species, nationality)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

define quantitative variable

A

meaningful numbers (i.e. height, weight, scales)
includes ordinal, interval, ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

define ordinal variable

A

a type of quantitative variable. numbers represent a rank order. distance between numbers don’t have meaning.
ex) order of racers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

define interval variable

A

a type of quantitative variable. numbers represent equal distances, no true zero.
ex) IQ, shoe size, pain scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

define ratio variable

A

a type of quantitative variable. numbers represent equal distances, zero represents none of the variable being measured.
ex) number of correct answers. episodes watched, height

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

3 types of reliability

A

test-retest, inter-rater, internal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

define test-retest reliability

A

consistent scores, regardless of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

define inter-rater reliability

A

consistent scores, regardless of researcher measuring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

define internal reliability

A

consistent scores, regardless of how researcher asks the question (i.e. different depression tests, same results)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

2 ways to evaluate reliability

A

scatterplot (visual), correlation coefficient ‘r’ (statistical)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

define Cronbach’s alpha

A

statistic used to evaluate internal reliability (similar to r-coefficient)

17
Q

define validity

A

accuracy of measurement
is the operationalization measuring what it’s intended to measure?
face, content, convergent, discriminant

18
Q

define face validity

A

it looks like what you want to measure

19
Q

define content validity

A

the measure contains all parts your theory says it should contain

20
Q

define criterion validity

A

is the measure related to a concrete outcome that it should be related to? can be assessed with the known-groups paradigm

21
Q

define known-groups paradigm

A

does the measure align with a set of groups whose behavior is already well understood
ex) testing a depression scale by giving it to individuals who are already diagnosed as depressed

22
Q

define convergent validity

A

a measure should strongly correlate with other measures of the same construction
ex) comparing one depression scale to another

23
Q

define discriminant validity

A

a measure should correlate less strongly with measures of different constructs
ex) comparing a depression scale to a physical health scale

24
Q

reliability vs. validity

A

reliability: how well a measure correlates with itself
validity: how well a measure is associated with something else

reliability is necessary for validity

25
relationship between reliability and validity
you can't have good validity + poor reliability (reliability precedes validity) -good R, poor V -poor R, poor V -good R, good V