Reliability is the
Con___ or St___ of measurement
If you measure the same thing, will you get the same score?
Consistency or stability of measurement
Challenges to reliability
Systematic or Unsystematic errors
- me____ error
- B___ (systematic)
- Con___ var____ (noise, random variation fluctuations)
Measurement
Bias
Confounding variability
Measurement error
Difference between an ob___ value and and ac___ value
Include both sys___ and ra___ error
Estimate of measurement error is re____
Difference between observed values and actual value
Includes systematic and random error
Reliability
Operational definitions are a way to
Sy___ pro____ of a particular procedure so we reduce the amount and magnitude of error
Systematic procedure
systematic error vs Random error
Systematic is a bi__ error
they are pre___, one di____, can co___ or rec___
Shifts mean to the le___
Random are
Due to ch___
Unp___
With many trials, it would eventually cancel out
Can be a result of con___ var___
Systematic is a bias error, they are predictable, one direction and you can correct or recalibrate
They shift mean to the left
Random are due to chance, unpredictable, can be a result of confounding variability
Inter-Rater reliability (between)
a coefficient that assesses the ag___ of observations made by _ or more raters
number of ag___ x ___% / number of possible
Re___
Assesses the agreement of observations made by 2 or more raters
Possible number of agreements x 100% / number of possible
Reproductivity
Intra-rater reliability (within ?)
Progression of t___, how consistently you score things
St__ of data recorded by ___ individual across _ or more trials
Re___ is established with m__ trials
Re____
Progression of time
Stability of data recorded by 1 individual across 2 or more trials
Reliability established with multiple trials
Repeatability
Test Retest
Results of both test and retest should be con___ if test is reliable
Consistent
Alternate forms
Use alternate forms of te___ in___ for one measurement
Ex Under water, skin caliper, DEXA and Bioelectrical impedance for BMI
Use alternate forms of testing instruments
Internal consistency
Closer you are to _, the higher internal consistency you have
0 = __ con___ at all
closer you are to one
Methods of Establishing reliability
Determining stability
T___-Re___ over time
Same day T___-Re___
Constructing alternate forms
Determine Go__ St___
Obtaining internal consistency
Sp___-H___ technique
Test Re-test over time
Same day test-retest
Determine Gold Standard
Split Half