Type 1 Error
When we Reject the Null hypothesis, but the Null is actually true. `
Type 2 Error
When we do not reject the Null, but the Null is actually false
Level of Significance for a test
The number a, such that a is the probability a test result will be a Type 1 error
Observed Significance
the probability that if the same test was repeated on a new sample, the result would be at least as contrary to the Null and in favour of the Alternative, as was the outcome before.