Research Design

Question 1

Types of Design

Question 2

ANOVAs

Question 3

Alpha level

Answer 3

The chance of making a type I error

Question 4

Type 1 and 2 Errors

Answer 4

Type I Error: Detect a significant difference when there is not one, chances of making a type I error = the alpha level
Type II Error: Fail to detect a significant difference when there is one

Question 5

Measures of Central Tendency

Answer 5

Mean: average
Median: response at the center of the distribution
Mode: most frequent response

Question 6

Effect Size

Answer 6

• Cohen’s D
• Calculation: d = (M1 – M2) / pooled SD
• Measures whether the independent variable has an effect on the dependent variable
• Other stats related to effect size: Correlations, Standardized Mean Differences, Odds ratio

Question 7

Reliability

Answer 7

See if test measures accurately
Cronbach’s alpha (Reliability coefficient - internal consistency)

Question 8

Validity

Answer 8

See if test measures what it is supposed to measure

Question 9

Double-Blind Study

Answer 9

• Multiple participant groups assigned
• Neither researcher nor participants know which group they are in

Question 10

Distribution Curve

Question 11

Standard Error of Estimate and Measurement

Question 12

Percentile Ranks

Question 13

Sample Size

Answer 13

• Sample needs to represent the larger population
• Sample needs to be large enough to be high-powered but not so large that it is wasting resources that are not necessary to find a meaningful difference

Question 14

Statistical Power

Answer 14

• The probability of avoiding a type II error (failure to detect a meaningful difference in the sample)
• Typically set at 80%
• Too much power = tests are too sensitive to true effects

Question 15

Instrumentation

Answer 15

• Threat to internal validity
• E.g., you are relying on an expert rater’s ratings for your dependent variable and find that the rater’s accuracy changes over time

Question 16

Difference between a true experiment and a quasi experiment

Answer 16

ability to randomly assign participants to treatment and comparison conditions

Question 17

Testing threat to internal validity

Answer 17

• E.g., There are differences on the post-intervention test between the participants who did and did not take the pretest

Question 18

Independent Variable

Answer 18

Variable that you manipulate to see if a change occurs

Question 19

Dependent Variable

Answer 19

Variable that you measure to see if it changes in response to the manipulation of the independent variable

Question 20

Efficacy

Answer 20

• Internal validity
• Assesses a causal link between the treatment and a change in the clinical condition

Question 21

Effectiveness

Answer 21

• External Validity

Question 22

Reliable Clinical Change Index (RCI)

Answer 22

• Calculates the effect size of change for an individual client over the course of treatment
• Demonstrates that after the intervention, the client is functioning in the non-clinical range

Question 23

Results from a single-subject research study are evaluated using

Answer 23

Visual inspection

Question 24

ABA Design

Answer 24

Assesses behavior changes when the treatment is introduced and how it changes again when the treatment is withdrawn

Question 25

Compliance (in randomized control trials)

Answer 25

The degree to which study subjects adhere to an assigned treatment protocol

Question 26

Michael Lambert, the author of the Outcome Questionnaire – 45 (OQ45) advocates for what?

Answer 26

Tracking the therapy progress especially for clients who are not progressing or who are deteriorating

Question 27

ITT (intention to treat) group

Answer 27

- Important because it reduces the risk of sample bias that might result from attrition - Still take into account data from participants who did not complete the study

Question 28

Which of the following research designs is considered the most trustworthy, according to SAMSHA?

Answer 28

Meta-analysis

Question 29

Stratified random sampling

Answer 29

- Creates a probabilistic sample

Question 30

Sampling Frame

Answer 30

All of the units or cases that a researcher has accessible to study

Question 31

Random Sampling

Answer 31

Sample members are selected so each member of the population has an equal probability of being selected

Question 32

"Positivist approach" said the scientific method could be applied to

Answer 32

Observable and repeatable behaviors

Question 33

Construct

Answer 33

The theoretical idea or concept that is being described or analyzed in the process of research

Question 34

Construct Validity

Answer 34

Is your measure assessing the construct of interest? Do the items capture the construct?

Question 35

Convergent Validity

Answer 35

Two test that are supposed to be related are in fact related

Question 36

Discriminant Validity

Answer 36

Two tests that are not supposed to be related are in fact unrelated