Validity And Reliability: Internal Validity + Self Reports

Question 1

How do we deal with low internal validity

Answer 1

Control extraneous/confounding variables

Question 2

When does problems with internal validity occur

Answer 2

• problems with behavioural categories
• problems with presence of an observer, observer bias
• difficulty in recording data

Question 3

How could the problem that lowers internal validity be dealt with: ‘flawed behavioural categories, e.g. behaviour recorded inaccurately or behaviour wan’t recorded —> low validity’

Answer 3

• Pilot study —> make sure all the possible behaviours that can be observed are included
• give observers training and practise before —> gives them time to discuss and ask Qs about the different behaviours on the coding scheme —> helps establish what counts as an example of each behaviour

Question 4

How could the problem that lowers internal validity be dealt with: ‘presence of an observer causing social desirability bias’

Answer 4

• use covert observation where possible

Question 5

How could the problem that lowers internal validity be dealt with: ‘observer bias, especially prevalent in participant observations where the observer might get too involved’

Answer 5

• use more than 1 observer and correlate their data —if data similar—> unlikely to have been bias

Question 6

How could the problem that lowers internal validity be dealt with: ‘Difficulty in recording data, e.g. with non-participant observation where they might miss some behaviours, or participant observation where they can’t write it all down discretely so rely on memory later’

Answer 6

• make use of recording equipment, e.g. video/audio recorders so observations can be replayed/analysed

Question 7

What are self reports

Answer 7

Refers to any data collection method that involves asking people to report on their own thoughts, feelings or beliefs to the researcher, e.g. questionnaire, interview, diary

Question 8

What do you think th key problem could be in gathering accurate, valid data from self-reports

Answer 8

Social desirability bias

Question 9

How would the issue be solved concerning self-reports: No appropriate option to choose as an answer, so participants can’t put what they feel

Answer 9

• use open ended Qs

Question 10

How would the issue be solved concerning self-reports: Some people don’t know what they think or feel

Answer 10

Give participants some options for possible answers

Question 11

How would the issue be solved concerning self-reports: Giving socially acceptable answers rather than honest ones (social desirability bias)

Answer 11

• add a lie scale (set of Qs that determine if participant is lying)
• Make the self-report anonymous and/or online, tell them answers are confidential

Question 12

How would the issue be solved concerning self-reports: leading Qs / ambiguous Qs

Answer 12

Change or remove problematic Qs

Question 13

How would the issue be solved concerning self-reports: interviewer bias / effects

Answer 13

• Use a questionnaire instead
• use a different research method, e.g. observation, experiment

Question 14

.

Answer 14

.