Reliability

Question 1

refers to the consistency of scores obtained by the same person when re-examined with the same test on diffeerent ocasssions or with different sets of equivalent items or under other variable examinig condition

Answer 1

Reliability

Question 2

true or false
measurement error is common in all fields of science

Answer 2

true

Question 3

true or false
test that are relatively free ofmeasuremen error are considered reliable while test that contains relatively large measurement of error are considered unreliable

Answer 3

true

Question 4

identification
the difference between observed score and the true score results

Answer 4

measurement error

Question 5

identification
the standard deviation of the distribution of errors for each repeated application of the same test on an individual

Answer 5

standard error of measurement

Question 6

true or false
although it is impossible to eliminate all measurement error, test developers do strive to maximize psychometric nuisance through careful attention to the sources of measurement error

Answer 6

false. minimize

Question 7

t/f
the greater the numberof items the higher the reliability

Answer 7

true

Question 8

identification
a problem in the use of limited number of items to represnt a larger and more complicated construct

Answer 8

domain sampling model

Question 9

3 sources of measurement error

Answer 9

item selection
test administration
test scoring

Question 10

identify

one source of measurement error is the instrument itself

Answer 10

item selection

Question 11

identify what sources of measurement error and
true/false

general environmental conditions , momentary fluctuation of anxiety, motivation, attention and the examiner can contribute and be the source of measurement error in the process

Answer 11

true
test administration

Question 12

identification
with the help of acomputer the item difficulty is calibrated to the mental ability of the test taker

Answer 12

item response theory

Question 13

t/f
correlation coefficient (r) expresses the degree and magnitude of a linear relationship between two sets of scores obtained from the same person

Answer 13

true

Question 14

forms of reliability

Answer 14

test-retest
parallel forms
inter-rater reliability
split half reliability

Question 15

it is established by comparing the scores obtained from two successive measurements of the same individuals and calculating a correlation between the twosets of scores

Answer 15

test-retest reliability

Question 16

other term for test-retest reliability that measure the error associated with administering a test at two different times

Answer 16

time sampling reliability

Question 17

corresponds to the random fluctuations of performance from one test session to the other

Answer 17

error variance

Question 18

you took an iq test today and you will take it again after exactly a year, if your scores are almost the same then the measure has a good ________? what kind of reliability is the example

Answer 18

test-retest reliability

Question 19

limitations of test-retest reliability

Answer 19

carryover effect
practice effect

Question 20

occurs when the first testing session influences the results of the second session and this can affect the test-retest reliability of a psychological measure

Answer 20

carryover effect

Question 21

a type of carryover effect wherein the scores on the second test administration are higher than they were on first

Answer 21

practice effect

Question 22

t/f sometimes a poor test-retest correlation do not mean that the test is unreliable. it might mean that the variable under the study has changed

Answer 22

true

Question 23

It is established when at least two different versions of the test yield almost
the same scores.

Answer 23

parallel form reliability

Question 24

other term for parallel form reliability that knowns to compares two equivalent forms of a test that measure the same attribute to
make sure that the items indeed assess a specific characteristic.

Answer 24

item sampling or alternate forms reliability

Question 25

The Purdue Non-Language Test (PNLT) has Forms A and B and both yield slightly identical scores of the test taker is an example of what reliability

Answer 25

parallel forms reliability

Question 26

Tests should contain the same number of items and the items should be expresses in the same form and should cover the same type of content is an example of what reliability

Answer 26

parallel forms

Question 27

true or false The error of variance in parallel forms represents fluctuations in performance from one set of items to another, but not fluctuations over time.

Answer 27

true

Question 28

true or false The range and level of difficulty of the items in parallel forma of reliability should be equal.

Answer 28

true

Question 29

It is the degree of agreement between two observers who simultaneously record measurements of the behaviors.

Answer 29

inter- rater reliability

Question 30

Two psychologists observe the aggressive behavior of elementary school children. If their individual records of the construct are almost the same, then the measure has a good ______reliability.

Answer 30

inter rater reliability

Question 31

Two parents evaluated the ADHD symptoms of their child. If they both yield identical ratings, then the measure has good __________ reliability

Answer 31

inter-rater

Question 32

what statistic inter-rater reliability use in order to assess the level of agreement among several raters using nominal scales.

Answer 32

kappa statistics

Question 33

It is obtained by splitting the items on a questionnaire or test in half, computing a separate score for each half, and then calculating the degree of consistency between the two scores for a group of participants.

Answer 33

split-half reliability

Question 34

This model of reliability measures the internal consistency of the test which is the degree to which each test item measures the same construct. It is simply the intercorrelations among the items.

Answer 34

split-half

Question 35

t/f The test can be divided according to the odd and even numbers of the items (odd-even system).

Answer 35

true

Question 36

what are the formula used to measure the internal consistency of a test in split half reliability

Answer 36

spearman-brown, kuder-richardson and cronbach’s alpha

Question 37

A statistics which allows a test developer to estimate what correlations between the two halves would have been if each half had been the length of the whole test and have equal variances.

Answer 37

Spearman- Brown Formula

Question 38

Spearman Brown Formula

Answer 38

rSB= 2r hh/ 1+ rhh

Question 39

A statistics which allows the test developer to confirm that a test has substantial reliability in case the two halves of a test have unequal variances.

Answer 39

Cronbach’s coefficient alpha

Question 40

The statistics used for calculating the reliability of a test in which the items are dichotomous or scored as 0 or 1.

Answer 40

Kuder-Richardson 20 (KR20) Formula

Question 41

t/f For tests that has two forms, use parallel forms reliability.

Answer 41

true

Question 42

true /false For tests that are designed to be administered to an individual more than once, use split-half reliability

Answer 42

false. test-retest

Question 43

t/f For tests with continuum Likert scale, use Cronbach’s coefficient alpha.

Answer 43

true

Question 44

t/f For tests which involve dichotomous items or forced choice items, use spearman-brown formula

Answer 44

False. KR20

Question 45

t/f For tests with items carefully ordered according to difficulty, use inter-rater reliability

Answer 45

false. split-half

Question 46

t/f For tests which involve some degree of subjective scoring, use test-retest reliability

Answer 46

false. inter-rater reliability

Question 47

is a statistic that quantifies reliability, ranging from 0 (not at all reliable) to 1 (perfectly reliable).

Answer 47

reliability coeffecient

Question 48

usually refers to a mistake of some sort that could have been prevented had a person been more conscientious, more skilled, or better informed.

Answer 48

error

Question 49

refers to the inherent uncertainty associated with any measurement, even after care has been taken to minimize preventable mistakes

Answer 49

measurement error

Question 50

consists of unpredictable fluctuations and inconsistencies of other variables in the measurement process

Answer 50

random error

Question 51

refers to the proportion of the total variance attributed to true variance.

Answer 51

reliability

Question 52

When the interval between testing is greater than six months, the estimate of test-retest reliability is often referred to as the ________

Answer 52

coefficient of stability

Question 53

The degree of the relationship between various forms of a test can be evaluated by means of an alternate-forms or parallel-forms coefficient of reliability, which is often termed the

Answer 53

coefficient of equivalence

Question 54

refers to an estimate of the extent to which item sampling and other errors have affected test scores on versions of the same test when, for each form of the test, the means and variances of observed test scores are equal.

Answer 54

parallel forms reliability

Question 55

are simply different versions of a test that have been constructed so as to be parallel. Although they do not meet the requirements for the legitimate designation “parallel,” they are typically designed to be equivalent with respect to variables such as content and level of difficulty.

Answer 55

alternate forms

Question 56

refers to an estimate of the extent to which these different forms of the same test have been affected by item sampling error, or other error.

Answer 56

alternate forms reliability

Question 57

refers to the degree of correlation among all the items on a scale.

Answer 57

inter-item consistency

Question 58

seek to estimate the extent to which specific sources of variation under defined conditions are contributing to the test score.

Answer 58

domain sampling theory

Question 59

tool used to estimate or infer the extent to which an observed score deviates from a true score.

Answer 59

standard error of measurement

Question 60

t/f standard error of a score and denoted by the symbol σmeas,

Answer 60

true