Goodness of fit
- purpose
- design
- research Q’s and hypoth
- conceptual and operational definitions
- data collection method
what do you need for intervention fidelity?
data consistency
what is interrater reliability?
consistency of observations reflected in Cohen’s Kappa
data collected needs to be the same every time
data collection strategies
- physiological/biological
- observational- conceled or not
> reactivity- ppl change bhvr if they know they are being watched - interviews- open/closed
- questionnairs
- records or avail data: hops records, video tapes
data collection measurement tools
different from instruments/organizational definition
- CAM score
- stress scale
- sedation/pain scale
Evaluating the measurement tool (psychometric)
2
reliability- consistency 3 aspects
1) stability- test-retest
2. homogeneity- alpha 0.8 or greater
3) interrater reliability - use the same interviewer, same tests…
validity-
> does the instrument actually measure or reflect the abstract construct?
> expert opinion
> comparisons to other events
control of extraneous variables
1) strict inclusion/exclusion
2) control and consistency
3) manipulation of independent variables
4) random sampling
what is internal validity and name them?
> the extent to which the study findings are true, rather than the results of extraneous variables
- history
- maturation
- test and retest
- mortality
- instruments
- selection bias
what is external validity and name them
> the extent to which study findings can be generalized beyond the sample used in the study
- selection effects- right grp of ppl?
- measurement effects- decreased anxiety if given a second time. the general pop would have high anxiety
- reactive effects
how do you critique measurement and data?
validity and reliability
