RM- Reliability

Question 1

How can we assess reliability of observations using TEST RETEST method?

Answer 1

Repeat observation a second time by using the same participants and compare results gained from second observation, with the results gained from the first observation. The results should be very similar and produce a correlation coefficient of +0.8 or more in order to be reliable.

Question 2

How can we assess reliability of observations using INTER RATER RELIABILITY method?

Answer 2

Use more than one observer/psychologist to observe and record the behaviours separately. The results from both psychologists could be compared and should gain a positive correlation of +0.8 or more if observation is reliable.

Question 3

How can we assess reliability of observations using PILOT STUDY method?

Answer 3

Conduct a small trial run of the observation, before the main research study is carried out. Includes standardised instructions, debriefing and planning procedures properly to minimise human error.
- All key concepts and terms are operationalised.

Question 4

How can we assess reliability of self reports using TEST RETEST method?

Answer 4

Give a self-report to a group of participants and collect the results. Give the same participants the same self report to complete a second time and compare results from 1st self-report to 2nd self report. Results should be similar with a correlation coefficient of +0.8 or more to be reliable.

Question 5

How can we assess reliability of self reports using INTER RATER RELIABILITY method?

Answer 5

• If conducting an interview use more than one psychologist to interview pps and record seperately.
• Researchers need to act in similar and consistent ways.
• The results from both psychologists could be compared and should gain a positive coefficient of +0.8 or more if the interview is reliable.

Question 6

How can we assess reliability of experiments using TEST RETEST method?

Answer 6

Conduct the experiment once and collect the results. Repeat the experiment again a few weeks later with the same participants who will be tested in exactly the same way. Compare results gained from both occasions and if reliable should have a correlation coefficient of +0.8 or more.

Question 7

How can we improve reliability of experiments?

Answer 7

Via standardisation of instructions: Procedures should be exactly the same for each participant that takes part in experiment. Key concepts and variables should be operationalised.

Question 8

How can we improve reliability of interviews ?

Answer 8

• Interview questions are not too leading/ ambiguous, they should be very clear so pps can understand them.
• easier to avoid leading questions in structured interviews

Question 9

How can we improve reliability of observations?

Answer 9

• If inter observer reliability is low, make sure behavioural categories have been operationalised properly and clearly so observer understands categories properly when observing data,
• If results from pilot study not very clear then give more training and practice to observers.

Question 10

What is reliability?

Answer 10

Reliability refers to the consistency of a research study especially when a study is repeated again and same results are gained on both occasions.

Question 11

What is internal reliability?

Answer 11

• This is whether a test and the results gained are consistent within itself.

Question 12

What is used to assess internal reliability?

Answer 12

• Split half technique.
• Questionnaire is split in half and if pps score similarly on both halves of questionnaire then it has internal reliability.

Question 13

What is external reliability?

Answer 13

• This is whether a test and the results are gained are consistent over time.

Question 14

What is used to assess external reliability?

Answer 14

• Test-retest method

Question 15

improving reliability for questionnaires :

Answer 15

• some items of the questionnaire need to be rewritten or deselected
• for example, ambitious questions can be interpreted differently, so less use of open ended questions

Question 16

two ways of assessing reliability

Answer 16

test-retest and inter-observer reliability