select appropriate measurement system
dimensions of bx
frequency
intensity
duration`
Replication
purpose= to demonstrate research results have BOTH INTERNAL and EXTERNAL VALIDITY
-supports a functional relationship through repeating effects of the IV on the DV
INTRA subject replication
replication w/ the SAME participant
INTER subject replication
replication ACROSS participants
-study replicated w/ a new participant to see if results will maintain
Direct Replication
the same researcher REPLICATING the same study
Systematic Replication
previous research replicated w/ some variation (researcher, populations, procedures)
independent variables are manipulated by…
Variable manipulated in a study oAntecedent events oConsequent events oStructural/Environmental oBiological
Considerations when Choosing IVs
Is the process of implementing IV clearly described?
oUse treatment integrity measures to ensure proper use
•Is it appropriate to the consumer’s ability?
Validity/ Accuracy
The extent to which data are relevant to DV and purpose for measurement (true measure)
oAre you collecting data on the correct behavior?
oMake sure you’re measuring the right dimension of behavior
–Target behavior: Aggression
»Intensity vs. frequency of occurrence
oMake sure you’re using the right type of measurement: –Target behavior: Tantrums
Internal Validity
The degree to which outside variables influences results–
Does the IV cause the DV to change
Threats to Internal Validity
–Procedural fidelity/procedural drift –Attrition/participant drop out –Cyclical variability of the data –Effects of testing –Maturation of participants –Reactivity
Assessing Observer Reliability/IOA
“Establishing a criterion or criteria in a way that two or more observers can agree on their occurrences.”
Discrepancies in data collection:•Inadequacies of observers
•Inadequacies of observation code/definition •Inadequacies of calculation
Interobserver Agreement (IOA)
Assesses whether data are reliable
•IOA validates your operational definition
Consideration: Identify ways to minimize observer bias
•Calculating IOA (TOTAL reliability):
L/H x 100 (frequency, duration, intensity, latency, permanent product)
L: Low
H: High
A/A+D x 100 (interval and time sample
A: Agreement–D: Disagreement
Measurement Considerations
•Minimizing Reactivity Wait Avoid interactions Be out of the way Minimize distractions •Observer drift •Selecting inappropriate measuremen t•Inadequate operational definitions •Not enough data
Interval Based Rec
Interval Recording• Whole-interval recording •Partial-interval recording •Frequency-within-interval recording• Continuous vs. discontinuous
Time Based Measuring
Temporal Dimensions
Duration—Amount of time response is performed
Latency—–Amount of time between the onset of a stimulus and the behavior
Interresponse time (IRT)—-Amount of time that occurs between two consecutive instances of a response
Event Rec
Event Recording (frequency) Pencil and paper•Clickers, counters•Pennies, etc.•Electronic data collector (iPhone app, etc.)•Calculating response rate•Total responses•Responses per minute
Time Sampling
Social Validity
1) the extent to which the dependent variables are socially relevant
2) the intervention is socially acceptable
3) the results produce significant change
Treatment Integrity
•Treatment Integrity- the accuracy of the implementation of an intervention
Assessment of treatment integrity is essential: To determine effectiveness of the intervention
Produce High Treatment Integrity
Operational definition Simplify Training Task analyses Assessing
Methods to Assess Treatment Integrity
Methods to assess treatment Integrity
•Checklists
•Direct observation
Selecting a research question Consideratons