Why are questionnaires used in correlational research designs?
To observe relationships in naturally-occurring groups
When are questionnaires used in experimental designs?
- To measure pre vs post condition effects
- To assign participants to groups
What is preliminary data?
Relevant data from prior research, existing materials, and interviews that can be useful in understanding construct and developing novel research methods
What is the process of developing questionnaires from scratch?
1) Identify and operationalize research
2) Review preliminary data
3) Develop items
4) Pilot
5) Revise
What is the difference between questions and items in a questionnaire?
Questions: Questions
Items: Statements
What are the different types of closed responses?
- Categorical (Nominal): Responses identify belonging to groups
- Rank-Ordered (Ordinal): Responses use numerical rankings for multiple options
- Likert (Interval or Ordinal): Point scale
When is a Likert scale on a questionnaire considered ordinal vs. interval data?
Ordinal: Measuring a single item
Interval: Measuring multiple items in a combined, composite score
What is acquiscence bias?
When a participant consistently answers items in a biased way, distorting data
How can you prevent aquiscence bias?
Reverse questions and inverted scoring
What are 2 common methods of analyzing questionnaire data?
Content Analysis: Coding participant data into categories with attributed numbers to measure frequency data
(Qualitative –> Quantitative)
Thematic Analysis: Identifying patterns and themes in participant responses to better understand different facets of a construct
(Qualitative –> Qualitative)
What are the elements of data in a questionnaire?
Scale and Items
What are 3 ways to extract scores in questionnaire data?
- Score every item in a questionnaire collectively
- Score each scale
- Score each item individually (Less common)
How can you make a summary variable out of item scores for analysis?
Sum of item scores or Mean of item scores
What is coding data?
Applying labels (codes) to data parts that identify patterns and commonalities
What is a factor?
The latent variable identified through observed variables
What is factor analysis?
The statistical method of determining scales by identifying clustered correlations among observed variables and determining underlying factors explaining correlations
After determining scales, what models can be used to analyze their scores?
ANOVA or Regression
