What is validity
If it is truthful to say that these findings accurately reflect natural behaviour.
What is internal validity
Questions the cause and effect relationship between the change the researcher made to the independent variable (IV) and the observed change in the dependent variable (DV).
What causes a lack in internal validity
If the change in the DV was influenced by any other factor than the IV (due to a lack of control)
What does it mean if something has external validity
Can be generalised beyond the study.
What is social desirability bias (internal validity)
Participants hide their genuine opinions/behaviours and instead act/respond in a more socially acceptable way to “look good”.
What are investigator effects (internal validity)
The researcher’s behaviour (or personal characteristics) influences the participants’ behaviour, including researcher bias,when the researcher either consciously or unconsciously influences the results.
Give examples of how investigator effects could occur
The participant’s behaviour could be affected by the researcher using more positive body language/tone of voice when participants behave as expected according to theory.
The researcher could also be biased in how they interpret participant behaviours and responses.
What is ecological validity (external validity)
The extent to which the findings of any particular study can be generalised to alternative environments.
(e.g. if moving a test of obedience from a laboratory setting to a busy city street, would obedient behaviour be replicated)?
What is mundane realism (external validity)
The extent to which the task/materials/activities used in an experimental set-up are similar to the stimuli experienced in the real world.
What is population validity
The extent to which the sample used in the study is representative of the target population. (e.g. gender, age, ethnicity, education level)
What is temporal validity (external validity)
The extent to which the findings of a study can be generalised to other time periods.
What is meant by face validity
Does the test appear to measure what it claims to be measuring?
What is meant by criterion validity
Confidence in the validity of a test increases if we can compare the data from a test to another measure of the same variable and identify a correlation.
What is meant by concurrent validity
The extent to which data from the newly created test is similar to an established testof the same variable conducted at the same time. A test of correlation assesses this; there is high concurrent validity if the strength of the correlation is +0.8 or higher.
What is meant by predictive validity
The extent to which performance on a test can predict future performance/outcomes/behaviour. (e.g. GCSE scores are highly predictive of future A-level results)
How can you improve internal validity
Improved by demonstrating a high level of control over variables. Control ensures the researcher is measuring any potential cause-and-effect relationship between the IV and DV, not the effect of an EV on the DV.
Give the steps to improving internal validity
Random allocation – Controls participant variables
Standard procedures – Controls extraneous variables
Counterbalancing - Controls order effects
Single & double-blind trials – Controls researcher bias and demand characteristics
Peer review – Controls researcher bias
How can you improve external validity
Improved by demonstrating that findings are generalisable. Replication ensures the cause-and-effect relationship observed in the original study is not just limited to that one experimental/observational set up.
Give the steps to improving external validity
Replicating findings in multiple settings improves ecological validity
Replicating findings with diverse groups of people improves population validity
Replicating historical studies improves temporal validity
Replicating findings using real-world/realistic tasks improves mundane realism