Reliability and validity of assessment measures: Reliability refers to the degree to which the test scores are free from the effects of m___ e___, while validity refers to the degree to which a test m___ what it is d___ed to m__“__.
free from the effects of measurement error; measures what it is designed to measure
Standardization of an assessment measure can mean 2 things:
1) regulation of the consistency of ___ a test is administered/scored such that deviation from standard procedure may yield i___ results
2) a test is administered in standard conditions with a rep___ p___ to establish norms, and future test takers who differ considerably from that pop are more likely to have i__“__ results
1) how a test is administered/scored…invalid results;
2) representative population…invalid results
While norm-referenced scores permit comparisons between an examinee’s performance and that of individuals in the ___ group, criterion-referenced scores permit interpretation with regard to an ex___ c___.
individual in the norm group…external criterion (%ile ranks and standard scores are examples of norm-referenced scores) (criterion-referenced scores are also known as domain-referenced and content-referenced scores) (self-referenced scores are provided by ipsative scores that allow intraindividual comparisons)
A protocol analysis in behavioral assessment entails an assessment of t___ processes by asking examinees to verbalize their t__“__ processes or p___-s___ing processes out loud.
assessment of thought processes…verbalize their thought processes or problem-solving processes out loud.
Dynamic assessment, derived from work by V___, involves deliberate d___ from standardized testing to obtain additional info or see if a testee would benefit from assistance or instruction. Testing the ___, a kind of dynamic assessment, involves providing additional cues, suggestions, or feedback after standard admin to see what they are able to do with some a___.
Vygotsky; deliberate deviation; Testing the limits; with some assistance
(Test-teach-retest and Graduated prompting are two other kinds of dynamic assessment)
Formative vs. summative assessment: in a classroom example, midterms and final exams are more like which kind of assessment? (Quizzes and homework assignments are more like the other if they are designed to evaluate learning early on the process and help make appropriate changes.)
midterms and finals are like summative assessments (examine change compared to some standard or benchmark)
T/F: In comparisons between actuarial (stastical) predictions vs. clinical predictions, research shows that clinical judgment alone is more accurate than the actuarial method alone.
F: the actuarial method alone is more accurate than clinical judgment alone (when fair comparison made between both approaches, e.g., same data used for both methods) (e.g., Aegisdottir et al., 2006; Grove & Meehl, 1996).
(actuarial method alone is also about equally accurate as a combination of actuarial and clinical methods)
To avoid making critical statements in assessment with children when they exhibit undesirable bxs, making ___-based corrections, making i___nal statements, or ignoring the behavior are recommended.
rule-based corrections (e.g., “One of the rules in this room is that we don’t throw things”)…invitational statements (e.g., “Come and sit at the table”)
(descriptive statements, reflections, and labeled praise are also recommended in general in assessment with kids)
Research shows that interviews with children as young as [2/4/6] can be used to obtain reliable and valid data.
6
Although open-ended questions are recommended in assessment with children, starting questions with the word [what/why/how] is discouraged
why
(open-ended questions elicit more info and reduce likelihood that they will be led to accept the interviewer’s conclusions)
Which statement is more accurate?
1) In every domain of assessment, there are culturally-fair-and-free tests widely available.
2) There are no truly “culture-free” or “culture-fair” tests.
2) There are no truly “culture-free” or “culture-fair” tests (although many attempt to have less of a cultural loading or be more culturally sensitive)
T/F: Research demonstrates that racial or cultural match or mismatch between examinee and examiner is always more important than rapport or the examiner’s attitude.
F (there is no consistent effect of a match or mismatch of the examiner and examinee in terms of race, ethnicity, or culture)
___-report is one of the quickest and lowest cost methods for collecting assessment data, but weaknesses include shaky validity and reliability
Self-report
T/F: Psychophysiological measures are used to analyze momentary psychophysiological experiences as they occur and obtain objective/qualitative data about subjective emotional experience. Fortunately, they are also relatively cheap and require little training to use.
F: First sentence is true, but they are costly and require much training to use.
T/F: A major advantage of direct observation in psychological assessment is the small amount of time the process often takes.
F: The amount of time associated with conducting observations is a weakness of the approach.
[Computerized Adaptive Testing/Dynamic Assessment] allows a testing experience to be tailored to the individual examinee by choosing subsequent items based on their previous answers.
Computerized Adaptive Testing (CAT)
According to ___’s Two-Factor Theory of intelligence, performance on any cognitive task depends on a general intelligence (g) factor plus one or more specific factors (s) unique to the task
Spearman (1927)
___ and ___ proposed Fluid (Gf) and Crystallized (Gc) intelligence. Which of the two includes reading, numerical skills, and factual knowledge? Which of two enables one to solve new problems, recognize patterns, and reason abstractly?
Horn and Cattell (1966);
Crystallized intelligence (Gc) includes reading, numerical skills, and factual knowledge (and acquired skills, affected by educational and cultural exp’s);
Fluid intelligence (Gf) enables one to solve new problems, recognize patterns, and reason abstractly (does not depend on specific instruction, is less affected by educat and culture)
C___’s three-stratum theory distinguished between three levels (strata) of intelligence. Stratum III is g, meaning ___ ___. Stratum II consists of [2/8/16] broad abilities. Name one.
Stratum I consists of specific abilities that are each linked to one of what?
Carroll’s three-stratum theory (1997);
Stratum III is g, meaning general intelligence;
Stratum II consists of 8 broad abilities, examples include fluid intelligence, crystallized intelligence, and general memory and learning;
Stratum I consists of specific abilities that are each linked to one the second stratum abilities
Which intelligence theory was developed on the basis of extensive empirical research and serves as the framework for IQ tests including the KABC-II and Woodcock-Johnson IV, currently distinguishing between 16 broad-stratum abilities and over 80 narrow-stratum abilities each linked to a broad-stratum?
A. Carroll’s Three-Stratum Theory
B. Sternberg’s Triarchic Theory
C. McGrew’s Cattell-Horn-Carroll (CHC) Theory of Cognitive Abilities
D. Spearman’s Two-Factor Theory
C. McGrew’s Cattell-Horn-Carroll (CHC) Theory of Cognitive Abilities (1997)
(Although McGrew acknowledges the existence of g general intelligence, it is omitted from his theory bc of his belief that it does not contribute to psychoeducational assessment practice)
(Theories of intelligence) Between Guilford’s convergent and divergent thinking (1967), which relied on rational, logical reasoning and involved the use of logical judgment and consideration of facts to derive the correct solution to a problem? Which involved nonlogical processes, creativity, and flexibility to derive multiple solutions?
Convergent is the former (logical, rational) while divergent is the latter (creative, flexible)
(Guilford argued that most intelligence tests focus on convergent thinking)
Which theorist about intelligence argued that most intelligence tests emphasize analytical abilities but neglect creative and practical abilities, noting that “succesful intelligence” is the ability to modify, adapt to, and choose environments that accomplish one’s goals and goals of society?
A. Spearman
B. Sternberg
C. Gardner
D. Guilford
B. Sternberg (1999) (triarchic theory, IQ includes analytical, creative, and practical abilities)
T/F: Gardner (1998) believed that there are 8 types of cognitive ability: linguistic, musical, logical-mathematical, spatial, bodily-kinesthetic, interpersonal, intrapersonal, and naturalistic; and he believed that everyone possesses all inteligences to some degree and that they are fixed for each person.
F: All true except for the last part - intelligences are not static but can be developed by exposure to appropriate learning experiences
Most reported heritability coefficients for people in industrialized countries range from 60-___% for intelligence
60-80%