what are the two methods of improving reliability
-the split-half method
-the test-retest
how does the split- half method work
-randomly choose half the questions on the test and compare the results with the other half
-if significant +ve correlation between two halves then questions are reliable
strength of using the split-half method
-don’t have to wait for the participant to forge the questions between the two halves of the test
-quick and easy way to establish reliability
weakness of using the split-half method
-only effective with large questionnaires
-in which all questions measure the behaviour being researched
how would u use the split-half method of assessing reliability to improve reliability of tests
-unreliable questions are removed until reliability is established
what does the test-retest method involve
-administering an entire test to a participant
-waiting for them to forget the questions (could take several months)
-readministering the test
what do the results from a test-retest indicate
-if the results from both presentations of the test significantly positively correlate then its a reliable test
strength of test-retest
-every question is checked for reliability so unreliable ones removed
weakness for test-retest method of assessing reliability
-takes a long time for results to be obtained
-if too long an interval has been used the participant may have changed in themselves meaning it is wrongly declared unreliable
how would you use test-retest to improve reliability of a test
-unreliable questions removed until reliability is established
how to assess reliability of experiments
-dependent variable measured using a rating scale
-e.g. bandura (bobo doll)
-method used to measure the DV is consistent (e.g. observations)
how to improve reliability of experiments
standardisation
-procedures must be exactly the same for different ppts or on different occasions
how to improve the reliability of questionnaires
-over time they should be measured using test-retest and compare the two data sets
-correlation coefficient needs to be +0.8 to be reliable
-if low test-retest reliability some items need to be rewritten to reduce ambiguousness of interpretation
how to improve reliability of interviews
-use the same interviewer each time
-each interviewer has to be trained in order to avoid asking leading/ambiguous questions
-more easily done in structured interviews due to fixed questions whereas unstructured are les likely to be reliable
how would you improve the reliability of observations
-operationalising behavioural categories
-make sure they are measurable and self-evident
-categories shouldn’t overlap to remove uncertainty and produce inconsistent results
-if low, observers need further training in using behavioural categories
how can you improve the reliability of experiments
-lab more reliable due to control over variables due to standardised procedures
-one factor affecting reliability of experiments is if the pps are tested under even slightly different conditions
how to use reliability as an evaluation
-internal and external reliability
how would u asses internal reliability with a questionnaire and observation
questionnaire- mention split half as a way of assessing reliability
observation- mention having two or more observers and checking for inter observer reliability
how would u assess external reliability with a questionnaire and experiment
questionnaire- mention test-retest as a way of assessing reliability
experiment- mention whether replication is possible (standardisation) or actually replication to check for reliability or is it already a replication?
why is it important for research to be replicated
-likelihood of the same differences occurring twice (or more), by chance
alone are much smaller than when they occur the first time.
* Effects that occur in a study are more likely to be reliable if they occur in a
repeat of the study – replication therefore increases (external) reliabilit