Parametric tests
makes assumptions about parameters of population distribution from which data is drawn:
Features of parametric tests
Fixed parameters - normal distributions
Data is interval/ratio
Sample sizes must be sufficient (relative to design) because otherwise cannot tell if its normally distributed
Should not have significant outliers nor too many outliers
Features of nonparametric tests
Has fewer assumptions
Data can be any level of measurement
Data can have non normal distributions
Sample size can be very small
And uneven
Can parametric tests be robust enough even with moderate skew?
Yes if the sample size is large enough
Parametric tests examples
Independent samples t test
Paired samples t test
When is independent samples t test used
If we fit the criteria for doing a parametric test and:
We have a between-subjects design
When is a paired samples t test used
If we fit the criteria for doing a parametric test and:
We have a within-subjects design
non parametric test examples
Mann-whitney u
Wilcoxon signed ranks
When do we use a mann whitney u test
If we do not fit the criteria for parametric test
And have between subjects design
When do we use a wilcoxon signed ranks
If we do not fit the criteria for parametric test
And have within subjects design
Non parametric tests are 95% Power efficient
95/100 goes where a non parametric test is ran (despite meeting criteria for parametric) you observe a statistically significant difference
Compared to if we had run a parametric equivalent
Problem with non parametric tests
More likely to commit a type 2 error (falsely reject the null hypothesis when we shouldnt have rejected it)
Because of the 95% power efficient: we want to observe 100% a statistically significant difference
In that 5%: no significance meaning we reject it??
What do all non parametric tests involve
Ranking the data from smallest to largest
Steps of a mann whitney test
Across the whole data set (inc conditions) , every number is ranked
Calculate the U statistic for each independent group
Choose thr lowest one
Compare this U value to a table of critical values:
Obtain a threshold U value we need to beat based on sample size and also the alpha level
Rules of ranking
smallest data gets value of 1
Work way up
If multiple data entries are the same, they share a midpoint of this rank
U statistic
U for a singular group equals
R - [ n(n+1) ] /2
Where R = sum of every rank
n = number of participants of that singular group
Obtaining threshold value for U
The table we get this value from is specific for level of significance e.g. the alpha
How do we know if the U we obtained is significant?
If calculated U is less than or equal to threshold U we got from table at specific alpha level
Mann whitney u test: when we reject the null/
If we obtain a U value from the table at our alpha that is from sample sizes
And the lowest, calculated U value is equal to or below it
What does null assume ?
Medians will be the same because the populations are identical
Wilcoxon signed ranks test stages
Calculate the difference between each participants score
RANK THE DIFFERENCE ignoring if pos or neg
and IGNORE if 0 difference
Sum up all POSITIVE DIFFERENCE’S ranks
Sum up all NEGATIVE DIFFERENCE’S ranks
Choose the lowest value = Calculated T statistic
How to obtain a threshold for T statistic
Based on one/two tailed test:
And sample size, look up in table to obtain threshold
When do we reject the null in wilcoxon signed ranks
If the calculated T statistic is lower than threshold T statistic