Key Elements of a Statistical Investigation
Distribution
Pattern of variation
Significance
Result is statistically significant if it is unlikely to arise by chance alone
Random Sampling
Margin of Error
Expect amount of random variation in a statistic (95% confidence level)
Internal Validity
Degree to which a cause-effect relationship between two variables has been unambiguously established
External Validity
Degree to which the findings of a specific sample can be generalized to a larger population
Ecological Validity
Degree to which a study finding has been obtained under real life conditions
Experience-Sampling Method
Participants report on their momentary thoughts, feeling, and behaviours at different points in time over the course of a day
Ecological Momentary Assessment
Methodologies that repeatedly sample participants’ real work experiences, behaviour and physiology in real time
Diary Method
Participants complete a questionnaire about their thoughts, feelings and behaviour of the day each night
Day Reconstruction Method (DRM)
A methodology where participants describe their experiences and behaviour of a given day by systematically reconstructing it the following day.
Correlational Studies
Correlation
Measures the association between two variables
Experimental Research
Manipulation of independent variable and measures effect on a dependent variable
Random Assignment:
- removes confounding influences
- use double blind procedure to limit confounds
Strength: has causality and interval validity
Weak: lacks ecological validity
Confounding Variables
Placebo Effect - Change in behaviour because they believe they are receiving treatment
Participant Demand - Participants behave how they think the experimenter want
Experimenter Expectations - biases in observations
Participant Observation
Research embeds themselves in the group or setting to observe behaviours, interactions, and dynamics
Overt - know being observed
Covert - don’t know being observed
Case Study
In depth examination of specific individual or contexts
- extensive rounds of testing
- limited number of participant based on inclusion criteria
Weakness: Generalization external validity
Narrative Analysis
Quasi Experimental Designs
Like experiments but without random assignment
- Assignment to conditions based on pre-existing ingroups
- The conditions are the independent variables
Weakness: lacks causality because confounding variables
Longitudinal Studies
Track the same participants over time
Surveys
Collect self reported data via questionnaires
- Larger sample size at lower cost