Define external validity
Validity
the ability of the study to be generalized beyond the experiment
What is the goal of lab-based and online vignette experiments?
*When referring to prioritization of validity
Validity
maximizing internal validity by creating a highly controlled environment to establish cause and effect - sacrifice of realism and external validity
What is the goal of quasi experiments?
*When referring to prioritization of validity
Validity
to maximize external validity ADD HERE
What is representativeness?
aka population generalizability
Validity
Do participants of a study have characteristics and behaviour that resemble the people the study results would apply to?
What makes results ‘robust’?
Validity
When they translate beyond the particular sample, settings, and operationalizations studied
Define random assignment
Validity
Makes people in treatment and control conditions similar to each other
What is the purpose of random assignment?
Validity
To rule out the influence of random error on results (confounds)
What is two-step randomization?
Validity
Using both random sampling and random assignment
More common in laboratory settings
What is nonresponse bias?
Validity
When people do not answer questions, or choose not to participate, which then threatens validity
What are some examples of nonresponse bias?
Validity
- People of privileged identities may not answer demographic questions if they think that the survey is about discrimination
- People of marginalized identities may not answer demographic questions for fear of being identified
What is ecological validity?
Validity
How realistic the setting and treatment are
Define internal validity
Validity
Whether the effects of the experiment were due to the studied cause
Define replicability
Validity
ability to repeat findings from an experiment with different subjects, conditions, treatments, measures, etc.
Define self-replication
Validity
when researchers take it upon themselves to replicate studies to ensure confidence in their results
Define exact replication
Validity
everything about the experiment is the same
more common in medicine
Define conceptual replication
Validity
extending theory and generalization by conducting a variation of an experiment
more common in social science
What were the X and IV for the Blackjack Experiment?
Galinsky et al. (2003)
Validity
- X = manipulation of power
IV = random assignment to roles of manager or subordinate after a quiz
quiz scores were completely unrelated to role assignment
What were the results for the Blackjack experiment?
Galinsky et al. (2003)
Validity
Participants assigned to high power more frequently took a risky hit in Blackjack compared to low power and control conditions
What were the potential confounds of the Blackjack experiment?
Galinsky et al. (2003)
Validity
Risky behaviour being a result of role-prescriptive behaviour or diminished cognitive resources instead of power
What was X for the Annoying Fan experiment?
Galinsky et al. (2003)
Validity
writing task and prediction
* high power = recall situation in which you had power, then allocate lottery tickets
* low power = recall situation when someone had power over you, then predict ticket allocation
What was _ and O for the Annoying Fan experiment?
Galinsky et al. (2003)
Validity
- O = whether or not the participants pushed away an annoying fan on them
- there was no control condition
What potential confound was identified for the Annoying Fan experiment?
Galinsky et al. (2003)
Validity
coders blind to the experiment found that people in the high power condition used more action words, potentially semantically priming them to action
What was X and _ for the Corruptibility and Responsibility experiment?
Galinsky et al. (2003)
Validity
- X = high power or low power condition (writing essay like exp. 2)
- control was essay recalling previous day - unrelated to power
What was O for the Corruptibility and Responsibility experiment?
Galinsky et al. (2003)
Validity
Whether individuals “took action” in division of goods within commons and public goods dilemmas
