What is the goal of blocking in experimental design?
Reduce/control variability
Example: Create 4 groups based on grade level.
What does voluntary response bias give too much emphasis too?
people with strong opinions, especially negative opinions.
Example: Divide population based on gender.
What is critical in selecting an unbiased sample?
use of randomization
Example: Stratify by age, gender, ethnicity.
True or false: Accuracy refers to how close a set of measured values are to the true value.
TRUE
Accuracy is about hitting the target.
What does precision measure in data collection?
Measure of variability
Precision is about consistently hitting the same location on the target.
What is critical in being able to generalize a sample to the population?
use of randomization in selecting a sample
In the US, this occurs every 10 years.
What is the difference between stratified sampling and cluster sampling?
Stratified involves SRS within each group, while cluster involves SRS of groups.
What is the purpose of a control group in an experiment?
Needed for comparison to treatment group
Helps to measure the effect of the treatment.
When are differences in observed responses statistically significant?
when it’s not likely that they can be explained by chance variation
Ensures groups are similar other than treatment.
Random assignment of subjects to treatment groups is important in handling what?
unknown and uncontrollable differences.
One subject receives one treatment, the other receives the second.
What is sampling variability?
Unavoidable error when taking a sample of a population
Describes the probability of how likely we are to have a certain error size.
What is the difference between random assignment and random sampling?
random assignment refers to what’s done with subjects after they’ve been selected for a study while random sampling has to do with how subjects are selected for a study.
Important to identify in studies.
What is the difference between an observational study and an experiment?
Experiments establish cause-and-effect relationships.
Randomized block design
experiments in which randomization only occurs within blocks.
This can lead to unrepresentative samples.
Randomized paired comparison design
experiments where subjects are paired and randomization is used to decide who in each pair receives which treatment.
Goal is to remove bias and control variables.
What is the purpose of replication in experiments?
To redo the same experiment with more than one experimental unit and get similar results
Enhances reliability of findings.
What’s the goal of blinding and double blinding?
remove bias and control all variables
Example: Telephone surveys ignore those without access to phones.
What is the goal of blocking?
reduces/controls variability
Results in low response rates.
What does stratification reduce?
variability
Happens after choosing a sample.
What does it mean when there’s a low accuracy?
it means there’s bias in the selection method
Subjects are told that the treatment works.
What is the significance of sample size in studies?
Larger samples lead to more accurate reflections of the population
Important for generalizability.
What is proportional sampling?
Sizes of random samples depend on the proportion of the total population represented
Example: Surveying students based on demographics.
What does randomization in assignment to treatment groups increase?
the chance that the treatment groups are as similar as possible other than which treatment each group receives.
Advantages and Disadvantages of Retrospective Studies
Advantages: Smaller scale, quicker, less expensive
Disadvantages: Researchers rely on previous recordkeepers, inaccurate
accounts, biases