improving reliability Flashcards

(20 cards)

1
Q

what are the two methods of improving reliability

A

-the split-half method
-the test-retest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

how does the split- half method work

A

-randomly choose half the questions on the test and compare the results with the other half
-if significant +ve correlation between two halves then questions are reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

strength of using the split-half method

A

-don’t have to wait for the participant to forge the questions between the two halves of the test
-quick and easy way to establish reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

weakness of using the split-half method

A

-only effective with large questionnaires
-in which all questions measure the behaviour being researched

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

how would u use the split-half method of assessing reliability to improve reliability of tests

A

-unreliable questions are removed until reliability is established

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what does the test-retest method involve

A

-administering an entire test to a participant
-waiting for them to forget the questions (could take several months)
-readministering the test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what do the results from a test-retest indicate

A

-if the results from both presentations of the test significantly positively correlate then its a reliable test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

strength of test-retest

A

-every question is checked for reliability so unreliable ones removed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

weakness for test-retest method of assessing reliability

A

-takes a long time for results to be obtained
-if too long an interval has been used the participant may have changed in themselves meaning it is wrongly declared unreliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

how would you use test-retest to improve reliability of a test

A

-unreliable questions removed until reliability is established

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

how to assess reliability of experiments

A

-dependent variable measured using a rating scale
-e.g. bandura (bobo doll)
-method used to measure the DV is consistent (e.g. observations)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

how to improve reliability of experiments

A

standardisation
-procedures must be exactly the same for different ppts or on different occasions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how to improve the reliability of questionnaires

A

-over time they should be measured using test-retest and compare the two data sets
-correlation coefficient needs to be +0.8 to be reliable
-if low test-retest reliability some items need to be rewritten to reduce ambiguousness of interpretation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

how to improve reliability of interviews

A

-use the same interviewer each time
-each interviewer has to be trained in order to avoid asking leading/ambiguous questions
-more easily done in structured interviews due to fixed questions whereas unstructured are les likely to be reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

how would you improve the reliability of observations

A

-operationalising behavioural categories
-make sure they are measurable and self-evident
-categories shouldn’t overlap to remove uncertainty and produce inconsistent results
-if low, observers need further training in using behavioural categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

how can you improve the reliability of experiments

A

-lab more reliable due to control over variables due to standardised procedures
-one factor affecting reliability of experiments is if the pps are tested under even slightly different conditions

17
Q

how to use reliability as an evaluation

A

-internal and external reliability

18
Q

how would u asses internal reliability with a questionnaire and observation

A

questionnaire- mention split half as a way of assessing reliability
observation- mention having two or more observers and checking for inter observer reliability

19
Q

how would u assess external reliability with a questionnaire and experiment

A

questionnaire- mention test-retest as a way of assessing reliability
experiment- mention whether replication is possible (standardisation) or actually replication to check for reliability or is it already a replication?

20
Q

why is it important for research to be replicated

A

-likelihood of the same differences occurring twice (or more), by chance
alone are much smaller than when they occur the first time.
* Effects that occur in a study are more likely to be reliable if they occur in a
repeat of the study – replication therefore increases (external) reliabilit