Different crises in science
> replication crisis
statistical crisis
generalisability crisis
triggers for crisis
> failures to replicate influential claims
questionable research practices
questionable measurement practices
limited samples
responses to research crisis- the credibility revolution
> pre-registration and registered reports
replication studies
identification of open science principles
variation and replication in psychological sciences
> patterns/ effects that interest us may vary between places, people and time
treatment effects can vary so may not be replicable
therefore need to research how effects vary and open our workflow
data analysis workflow- steps
> get data
process or tidy
explore, visualise, analyse
present / report findings
kinds of reproducibility
> methods
results
inferential
language experience + reasoning capacity = ?
comprehension outcome
what are the 3 data analysis assumptions
> validity
measurement
generalisability
what are 3 levels of uncertainty when look at data
- The nature of the expected change in outcome
- The ways that expected changes might vary between individual participants or between groups of participants
- The random ways that specific responses can be produced
what is results reproducibility
Results reproducibility means that a new study with new data, collected following the original procedures as closely as possible
> If a researcher finds a pattern in human behaviour or in individual differences we may critically evaluate the robustness or the generalizability of the finding
what are 3 kinds of reproducibility?
> methods
results
inferential
