Quality of experiments
Validity:
- internal: designed and executed properly
- External: lab does not fully recreate real-life settings
Reliability
- Maximize detail and transparency in documentation
Quality case study
Validity
- Researcher bias (opinions researcher strong and affect objectivity)
- Respondent bias (values, opinions)
- Recollection bias (memory not reliable)
- construct validity: operationalization of construct is good
Quality surveys
Validity
- Quality of questionnaire
- Sample quality and sampling bias
- Low response rate and non-response bias
- response incompleteness and missing values
Risks addressed in a research project