Lecture 8

Question 1

Surveys are valuable tools for ____ ____ and anyone wanting to collect original data to _____ a population that is …

Answer 1

• social scientists
• describe
• too large to observe directly

Question 2

Prevalence of polls (and telemarketers) may have ______ the status of surveys in the eyes of the public.

Answer 2

diminished

Question 3

Survey:

Answer 3

technique that seeks to determine present practices or opinions of a specified population

Question 4

Questionnaire:

Answer 4

type of paper and pencil or electronic survey in which information is obtained by asking participants to respond to questions rather than by observing their behaviour

Question 5

The purpose of survey design is to provide _____ or _____ description of _____, _____, or _____ of a population by studying a sample of that population.

Answer 5

• quantitative
• numeric
• trends
• attitudes
• opinions

Question 6

Most common type of descriptive research:

Answer 6

survey research

Question 7

Pros of survey research:

Answer 7

• Can solicit info from large populations.
• Best at determining current opinion or trends in a population.
• Can provide a basis for making broad based comparisons &
  decisions

Question 8

Cautions of survey research:

Answer 8

• must ensure the population is adequately represented
• reliant on the honesty of the respondent
• very difficult to establish cause and effect
• difficult to gain the underlying reason for the info solicited

Question 9

5 methods of a survey method plan:

Answer 9

• the survey design
• the population and sample
• creating and pretesting an instrument
• variables in the study
• data analysis and interpretation

Question 10

Survey design:

Answer 10

a plan for quantitative or numeric description of trends, attitudes, or opinions of a population by studying a sample of the population

Question 11

In the survey design, we indicate why a survey is the ____ type of data collection procedure for the study, examine the _____ of this design for the study.

Answer 11

• preferred

- advantages

Question 12

2 types of survey design:

Answer 12

• cross section

- longitudinal

Question 13

Cross-section survey design:

Answer 13

participants assessed at one point in time

Question 14

Longitudinal survey design:

Answer 14

following participants over time

Question 15

In a survey design, we must specify the form of ____ _____, examine the _____ and ______ for the ones chosen.

Answer 15

• data collection

- strengths and weaknesses

Question 16

Types of data collection:

Answer 16

• telephone
• mail
• drop-off
• internet surveys

Question 17

A challenge of questionnaires is that you only get responses to ….

Answer 17

the questions that you ask (if you ask a poor question, you may not get the types of responses that you were expecting)

Question 18

When posing questions, make sure that the question _____ to the respondent.

Answer 18

applies

Question 19

When posing questions, make sure the question is ______ ______.

Answer 19

technically accurate

Question 20

When posing questions, ask ____ _____ at a time.

Answer 20

one question

Question 21

When posing questions, use _____ and _____ words.

Answer 21

• simple

- familiar

Question 22

When posing questions, use ____ and ____ words to specify the concepts clearly.

Answer 22

• specific

- concrete

Question 23

When posing questions, use ___ words as possible to pose the question.

Answer 23

few

Question 24

When posing questions, use ____ sentences with ____ sentence structures.

Answer 24

• complete

- simple

Question 25

When posing questions, make sure ___ means _____ and ____ means ____ (ie. avoid ____ _____).

Answer 25

- yes means yes - no means no - double negatives

Question 26

When posing questions, be sure that the question specifies the ____ _____.

Answer 26

response task

Question 27

In the population and sample stage, identify the ____ in the study, state the _____ of the population, means of _____ individuals in the population, and _____ of sample frames.

Answer 27

- population - size - identifying - availability

Question 28

In the population and sample stage, we need to specify if the sampling design will be:

Answer 28

- single stage | - multi stage

Question 29

Single stage sampling design:

Answer 29

- there is access to the names of the people in the population - they may be sampled directly

Question 30

Multi stage sampling design:

Answer 30

will identify groups or organizations who will assist in the gathering the names of individuals who will be sampled

Question 31

In the population and sample stage, we need to identify the _____ process for the sample.

Answer 31

selection

Question 32

In the population and sample stage, we need to indicate if the population and subsequent sample will be _____ based on ...

Answer 32

- stratified - specific population characteristics - eg. age, gender, income levels, education

Question 33

In the population and sample stage, we need to discuss how sample will be _____ from available lists.

Answer 33

selected

Question 34

In the population and sample stage, we need to indicate the ____ of people in the sample and the ____ used to compute this number.

Answer 34

- number | - procedures

Question 35

In the population and sample stage, attention must be given to the _____ of the population that will be included in the:

Answer 35

- percentage/fraction - sample - margin of error - confidence interval - confidence level - response rate

Question 36

The ____ ____ will dictate the type of participants you need for the study.

Answer 36

research question

Question 37

In the population and sample stage, we need to ensure sampling/participants are ______ for your chosen research design and methods.

Answer 37

appropriate

Question 38

The greater the variability in your outcomes, the _____ sample size needed to find _____.

Answer 38

- larger | - significance

Question 39

In the population and sample stage, we need to think about _____ considerations (_____), such as...

Answer 39

- practical - feasibility - time, money, resources - participant availability

Question 40

In creating and pretesting an instrument stage, we need to name the survey ____ used to collect data.

Answer 40

instrument

Question 41

When using an existing instrument, describe the established ____ _____ from previous use.

Answer 41

validity scores

Question 42

Validity scores in a survey identifies ....

Answer 42

whether the instrument is a good one to be used

Question 43

3 components of validity scores;

Answer 43

- construct - content - criterion

Question 44

Construct (validity scores):

Answer 44

how one translates the idea or construct into something real or concrete

Question 45

Content (validity scores):

Answer 45

a check of the operationalization against the relevant content domain of the construct

Question 46

Criterion (validity scores):

Answer 46

the validation of a measure based on its relationship to another independent measure as predicted by your theory of how the measures should behave

Question 47

In creating and pretesting an instrument stage, we need to mention whether scores resulting from past use of the instrument demonstrate _____.

Answer 47

- reliability - test-retest correlations - consistency in test administration and scoring

Question 48

In the pilot testing phase, survey should be tested with a sample as _____ to the sample used in the ____ ____ ______ as possible.

Answer 48

- similar | - full survey presentation

Question 49

4 stage process for pilot testing:

Answer 49

- review by knowledgeable colleagues and analysts - interview with potential survey respondents to evaluate each question - conduct a small pilot test - a final check from a small group of individuals with no role in survey development or revisions

Question 50

The variables in the study phase is useful in the _____ section to relate the variables to ____ _____ and items on the _____.

Answer 50

- methods - research questions - instrument

Question 51

The variables in the study phase allows the reader to easily determine how the _____ ______ connects to the variables and _____ or _____.

Answer 51

- data collection - question - hypotheses

Question 52

The variables in the study phase allows for ____-______ the variables, the _____ or ______, and specify ____ ____.

Answer 52

- cross-referencing - questions - hypotheses - survey items

Question 53

Steps for analyzing the data in data analysis and interpretation phase:

Answer 53

1. report response rate 2. determine response bias: the effect of nonresponses on survey estimates 3. discuss plan to provide descriptive analysis 4. check instrument's scales 5. statistics and statistical computer program for inferential statistical analyses 6. present and interpret results

Question 54

The the data analysis and interpretation phase, report how the results answered the _____ ____ or _____.

Answer 54

- research question | - hypotheses

Question 55

The the data analysis and interpretation phase, discuss the ______ for the results for practice or _____ research on the topic. Draw _____ and ____ from results.

Answer 55

- implications - future - inferences - conclusions

Question 56

2 questions asked when looking at error in survey research:

Answer 56

- how closely the responding sample is representative of the population - how well the questionnaire answers measure the characteristics to be described

Question 57

2 errors related to how closely the responding sample is representative of the population:

Answer 57

- sampling error | - frame (coverage) error

Question 58

sampling error:

Answer 58

occurs when a sample drawn from the population is not representative of the entire population

Question 59

Frame (coverage) error:

Answer 59

occurs when the list from which the sample is drawn fails to contain all members of the population

Question 60

2 errors related to how well the questionnaire answers measure the characteristics to be described:

Answer 60

- response error | - nonresponse error

Question 61

Response error:

Answer 61

- occurs when the respondent is unable or unwilling to respond to all items in a survey as a result of the communication process - do not answer truthfully to items

Question 62

Nonresponse error:

Answer 62

extent to which individuals included in the sample fail to provide usable responses (systematically different from those who respond to the survey)

Question 63

Falling response rates:

Answer 63

less effective surveys = % of surveys that are returned compared to the # sent out

Question 64

potential reasons for falling response rates:

Answer 64

- changing cultural norms of cooperation - overexposure to academic and marketing surveys - increasing concerns regarding confidentiality

Question 65

Benefits of internet surveys:

Answer 65

- potentially allow to reach more of the population - 24/7 data collection - ease of delivery - easy storage - provide less threatening approach for sensitive data

Question 66

Costs of internet surveys:

Answer 66

- sources of error (frame, sampling, measurement) - ethical issues - level of expertise required