Module 4- part 2 Flashcards

(56 cards)

1
Q

what ensures that measurements are consistent over time and across different observers or instruments?

A

reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is ensures that the measurements accurately reflect the concept or variable they are intended to measure?

A

validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what is consistency of a measure when repeated over time under the same conditions?

  • a patient completes the Berg Balance Scale twice in one week w/ similar results
A

test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what is degree to which different raters give consistent estimates of the same behavior?

  • two pts measure shoulder ROM using a goniometer and obtain similar valuesInter-rater reliability
A

Inter-rater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what is consistency of measurements taken by the same rater across multiple occasions?

  • same pt measures a patients hamstring flexibility on two different days with similar results
A

Intra-Rater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

internal consistency what is how well items on a test measure the same construct or concept?

  • items on the Oswestry Disability Index consistently reflect the construct of low back disability
A

internal consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is consistency b/w two equivalent versions of a test?

A

parallel-forms Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is the importance of high Internal Consistency?

A

indicates that the items w/I the test are measuring the same underlying construct
-CronBach’s alpha value b/w 0.65=acceptable , <8= good

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what are consistent, predictable error that skews results in one direction?

  • a goni consistently overestimates joint angles due to misalignment during use
A

systemic errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what are unpredictable fluctuations that occur due to chance or variability?

-a patient’s balance score varies slightly each time due to fatigue or distraction

A

random error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what stat measures are used for Test-Retest?

A

infraclass correlation Coefficient, Pearson’s r

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what stat measures does inter-rater use?

A

ICC, cohen’s Kappa

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what stat measurement does intra-rater use?

A

ICC

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what stat measures does internal consistency use?

A

Cronbach’s Alpha

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what stat measures does parallel-Forms use?

A

pearson’s r, Spearman’s rho

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what does Pearson’s r measure?

A

linear relationship between two continuous variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what does Spearman’s p (rho) measure?

A

monotonic relationship using ranked data

  • ranking patient pain levels vs therapist perception
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what does Intraclass Correlation Coefficient (ICC) measure?

A

agreement of measurements across raters or time

  • inter-rater reliability of goni measurements
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what does kendall’s T (tau) measure?

A

ordinal association based on concordant/discordant pairs

  • agreement between two pts ranking patient mobility
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what is Standard Error of Measurement ?

A

estimates the amount of error in a single observed score due to imperfect reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what is minimal detectable change?

A

amount of change in a variable that must be achieved before we can be confident that error does not account for the entire measured difference and that some true change must have occurred Based on the SEM.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what is minimal clinically important difference?

A

smallest change in a measurement that patients perceive as beneficial and that would justify a change in treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what is validity?

A

the extent to which a test measures what it claims to measure

24
Q

what is reliability?

A

the consistency or repeatability of a measurement

25
what is a construct?
an abstract concept or theoretical idea that a test aims to measure
26
what is criterion validity?
how well a test correlates with a gold standard or outcome measure
27
what is internal validity?
the degree to which a study establishes a causal relationship between variables
28
what is external validity?
the extent to which study findings can be generalized to other settings or populations
29
what is statistical conclusion validity?
the appropriateness of statistical methods used, and the accuracy of conclusions drawn from data
30
what is face validity ?
whether a test appears to measure what it claims to, at face value - a balance test looks like it measures balance to both pts & patients
31
what is content validity?
whether a test fully represents the construct being measured - a functional mobility scale (health scale) includes walking, transfers, and stairs
32
what is construct validity?
whether a test truly measures the theoretical construct it claims to
33
what is criterion validity?
how well a test correlates with a gold standard or outcome
34
what is concurrent validity?
subtype of criterion validity; comparison with a gold standard at the same time
35
what is predictive validity?
subtype of criterion validity; how well a test predicts future outcomes - a fall risk assessment predicting actual falls over 6 months
36
what is Factor Analysis with regards to construct validity?
assesses whether a scale is unidimensional or composed of multiple underlying dimensions
37
what are the elements of criterion validity?
concurrent & predictive validity
38
assumption of causality requires what 3 components?
1. temporal precedence 2. covariation of cause & effect 3. No plausible alternative explanation: confounding variables
39
what are some internal threats ?
historical events, maturation, experimenter bias, diffusion, testing
40
what is history internal threats?
events occurring between pretest and posttest that affect outcomes - a major health event during a study period influencing patient recovery
41
what is maturation internal threats?
natural changes over time that affect the dependent variable - children improving in motor skills due to age, not intervention
42
what is attrition internal threats?
loss of participants that skews group composition - more females drop out of one group, affecting gender balance
43
what is testing internal threats?
effects of repeated testing on performance - improved ROM due to familiarity with the test, not actual improvement
44
what is instrumentation internal threats?
changes in measurement tools or procedures - a pt becomes more skilled at using a goniometer over time
45
what is regression internal threats?
extreme scores tend to move toward the mean on retesting - depressed patients feel better over time regardless of treatment
46
what is selection internal threats?
bias in group assignment or self-selection - patients choosing their own group based on preference
47
what does social threats refer to?
the pressures that can occur in research situations that may lead to differences between groups - related to interaction of subjects and investigators
48
what are the 3 social threats?
1. diffusion or limitation of treatments 2. compensatory equalization 3. compensatory rivalry or resentful demoralization
49
what is resentful demoralization?
the subjects with the less desirable treatment become disheartened and "give up"
50
what is compensatory rivalry?
the subjects with the less desirable treatment attempt to work extra hard to receive the same results as the other groups
51
what are selection external validity threats?
study participants may not represent the broader population - a study includes only young adults, limiting generalizability to older adults
52
what is setting external validity threats?
results may not apply to different clinical or geographic settings
53
what is history external validity threats?
findings may not be applicable across different time periods - a study from 1990 may not reflect current clinical practices or technologies
54
what is statistical power?
the ability of a statistical test to document a real relationship between independent and dependent variables - low power may result in a real relationship existing, but not being detected by the statistical analysis - sample size is the primary limiting factor
55
what are examples of statistical conclusion validity of reliability and variance ?
unreliable measurements, failure to standardize the protocol, environmental interference, heterogeneity of subjects
56
what does Intention to Treat analysis allow?
to analyze according to original random assignments, regardless of the treatment subjects actually received, if they dropped out or were non-compliant