Reliability and Validity Practice Questions

Question 1

1. Which term best describes the consistency of an assessment?
   a. Validity
   b. Correlation
   c. Variance
   d. Reliability

Answer 1

d. reliability

Question 2

2. Reliability refers to whether we are truly measuring the concept of interest in our study.
   a. True
   b. False

Answer 2

b. False

Question 3

3. The three common types of validity in research are observational, internal, and external.
   a. True
   b. False

Answer 3

b. False

Question 4

4. Scientists always try to maximize the reliability and consistency in their research.
   a. True
   b. False

Answer 4

a. True

Question 5

5. Measurement reliability refers to the:
   a. Accuracy of the scores
   b. Dependency of the scores
   c. Comprehensiveness of the scores
   d. Consistency of the scores

Answer 5

d. Consistency of the scores

Question 6

6. If a measure is consistent over multiple occasions, it has:
   a. Test-retest reliability
   b. Internal reliability
   c. Inter-rater reliability
   d. Construct validity

Answer 6

a. Test-retest reliability

Question 7

7. The validity of a measure refers to the:
   a. Accuracy with which it measures the construct
   b. Comprehensiveness with which it measures the construct
   c. Consistency of the measurement
   d. Particular type of construct specification

Answer 7

a. Accuracy with which it measures the construct

Question 8

8. The extent to which we can generalize the results of a study to other participants:
   a. Construct validity
   b. External validity
   c. Internal validity
   d. Sampling validity

Answer 8

b. External validity

Question 9

9. When you are confident that the experimental manipulation produced the changes you measured in the dependent variable; your study probably has good ________ validity.
   a. Construct
   b. Internal
   c. Causal
   d. External

Answer 9

b. Internal Validity

Question 10

10. A measure has high internal consistency reliability when:
    a. Participants score at the high end of the scale every time they complete the measure
    b. Multiple observers make it the same ratings using the measure
    c. Multiple observers obtain the same score every time they use the measure
    d. Each of the items correlate with other items on the measure

Answer 10

d. Each of the items correlate with other items on the measure

Question 11

11. MSOT students create a new test to assess reading comprehension. When comparing the results of the new measure to existing validated measures of reading comprehension, they find that the new measure compares wells with existing validated measures. We may conclude that the new test has good _____:
    a. Content validity
    b. Criterion validity
    c. Reliability
    d. Concurrent validity

Answer 11

b. Criterion Validity

Question 12

12. A test is said to accurately assess specific psychological and personality traits, psychological concepts, attributes, and theoretical characteristics, this assessment is likely to have good _____:
    a. Construct validity
    b. Content validity
    c. Concurrent validity
    d. Predictive validity

Answer 12

a. Construct validity

Question 13

13. When a test measures what it purports to measure, it has good _______:
    a. Validity
    b. Variance
    c. Reliability
    d. Correlation

Answer 13

a. Validity

Question 14

14. Research suggests that a new scholastic achievement test in the US has poor internal consistency. What does this mean?
    a. The test, when split in half and compared, does not produce the same results.
    b. The test does not produce the same results across time.
    c. The test items do not repeatedly measure what they purport to measure.
    d. The different versions of the test do not produce the same responses.

Answer 14

a. The test, when split in half and compared, does not produce the same results.