Validity in science and statistics
- extent to which a conc___, concl__, or me___ is well founded and corresponds to the r___ w___
Extent to which a concept, conclusion or measurement is well founded and corresponds to the real world
Measurement validity
- is measure measuring what it in___ to measure?
- is the measurement a___?
Study validity
- are the me___ of the study valid
- Do they represent the r__ wo__
- Are the results free of bi__?
intends
accurate
are the methods of the study valid
Do they represent the real world
Are the results free of bias
Internal validity
- are the changes of the d___ variable really caused by the i___ variable
- st___ validity
External validity
- extrap___ (generalizing findings)
are the changes of the dependent variable really caused by the independent variable
Study validity
external
Extrapolation
Factors to internal validity
- Are the me__ true
-Are the re___ free from error/true
Are there any threats?
- bi__, sa___, mea____, co__ var__ all affect interpretaion
Are the measures true
Are the results from from error/true
Threats can be bias, sampling, measurement, confounding variability all affect variability
Controlling threats to internal validity
Ra___ assignment (required for cause and effect)
St__ de___
- Pl___ control (not an I__ V__ but a con___)
Single bl__/double bl___/ triple bl__
Random assignment
Study design
Placebo control (not an Independent variable but a condition)
Blind
External Validity (app____)
Can the conclusion be applied to others in the pop__ or other pop___
Threats to external validity
- selection of sa___
- controlled en___ of ex___ procedures
- pre-te___
- Multiple tr___ interference effect
Application
Population x 2
Threats
- selection of sample
- controlled environment of experimental procedures
- pre-testing
- multiple treatment interference effect
Controlling threats to external validity
Ra__ se___
St__ De__ (same as internal validity)
- testing eff___
- testing en____
Random selection
Study Design
Testing effect
Testing Environment
Differences between Reliability and Validity
A measurement can be r__ and n___ v___ however it CANNOT be va___ if it’s not re___
A measurement can be reliable and not valid, however it cannot be valid if they are not reliable
Construct validity
To assess whether a measure accurately represents the underlying concept or construct it instends to measure
Logical or face validity
common sense, lowest level of validity
content validity
relies on who?
people who are experienced in the field
- doesn’t represent all dimensions
Criterion validity
gold standard
tests are related to a standard, predictive