Sampling Bias
Occurs when a sample was not randomly selected from the population
Selection Bias
Participants were not selected at random
Nonresponse Bias
Occurs when respondents differ in meaningful ways from nonrespondents
Quota Sampling
By time zone and region
Sampling Error
The sample collected is not representative of the population due to chance alone. Outliers get absorbed, so the spread gets much tighter in a sampling distribution. Always tighter and smaller range
Standard Error
Measures the variability. Can never be larger than the SD. Formula is SE= SD/SR of n (square root)
95% Margin of Error (MOE)
If we sampled repeatedly, 95% of these intervals would contain the true population mean. Formula is mean +/- 2 SE
Null Hypothesis
Nothing happened (H0)
Alternative Hypothesis
Something happened (Ha)
Conformation Bias
A tendency for people to favor information that confirms their hypothesis
Type 1 Error
Null is true, reject the null (false alarm)
Type 2 Error
Null is false, refuse to reject the null (miss and/or false negative)
P-Value
Probability of a false alarm. If the p-value is low, we should reject the null
P < .05 means what?
Reject null (statistically significant)
P > .05 means what?
Failed to reject null (nonsignificant)
Cofounding Variables
Has to change with the IV to affect the DV. It is an extraneous variable.
We can get really small p-values by…
Having large sample sizes
Replication Crisis
If you found a significant effect, someone else should be able to replicate it; however, many studies can’t be replicated
Reasons why replication crisis exists:
Publication bias: journals only want to publish significant results.
“Publish or perish” mentality: researchers wouldn’t have a job if they didn’t publish results
P-Hacking
Making the p-value smaller than it actually is. May not be intentional, and is due to common practices in psychology.
Effect sizes quantify the strength of a relationship between variables because…
It tells us how meaningful the effect is, is unaffected by sample size, and can help mitigate the replication crisis
Between-Group Comparisons
Different people in the same group, and group size is independent of each other
Within-Group Comparisons
Same person throughout time, and groups are dependent on each other
Independent Samples T-Test
Used for between-group comparisons
Formula is t= m1+m2/SE