What is the definition of a test?
A test is an instrument for the measurement of a person’s maximum or typical performance under standardized conditions, where the performance is assumed to reflect one or more latent attributes
A test is defined to measure performance, 2 types of performances have been distinguished …
- Maximum performance test: the person does his best to solve on or more problems, it measures achievement.
- Typical performance test: the person responds to one or more tasks, where the responses are typical for the person. Personality or attitude test
What is the dimensionality of a test?
The dimensionality of a test is equal to the number of latent attributes
Maximum performance tests are further divided in ..
- power tests (when it is about accuracy)
- speed tests
What is the difference between aptitude/ability and achievement tests?
An aptitude tests measures abilities that are not explicitly taught in education.
An achievement tests is an instrument for measuring performance that is explicitly taught in training and education programs
Typical performance tests are divided into three tests, according to the attribute that the test is measuring.
- personality tests
- interest inventories
- attitude questionnaire
The development of a maximum performance test starts with developing a plan, what are the essential aspects of this plan?
- Construct of interest
- Measurement mode
- Objectives of the test
- Populations and sub populations
- Conceptual framework
- Response mode
- Administration mode
Tests are used for many different purposes, some distinctions:
- scientific versus practical purposes
- individual test taker versus group of test takers
- description versus diagnosis version decision making
What are the most used measurement modes?
- self-performance mode
- self-evaluation mode
- other-evaluation mode
The main distinction in the item response mode is between …
Free response mode or choice response mode
Name the three possible item response scales for achievement tests
- dichotomous: 2 ordered categories correct/incorrect
- ordinal-polytomous: has more than 2 ordered categories
- partial ordinal-polytomous
Name four possible administration modes
- Oral administration
- paper and pencil administration
- computerized test
- computerized adaptive test
Name three types of pilot studies
- Experts pilots
- Test taker pilots
- Rater’s pilots
What does kappa’s coefficient measure?
Kappa measures consistency. Can be used for interrater consistency or intrarater consistency
How is kappa coefficient computed?
Kappa = (O-E)/(1-E) O = observed proportion of identical ratings E = expected proportion of agreement
E -> fy * fx / n –> allemaal bij elkaar optellen en delen door totaal
What does a kappa coefficient of 1 mean? And 0?
Kappa = 1 -> perfect consistency Kappa = 0 -> completely unrelated
DuBois describes the history of modern testing, he describes 3 roots of modern testing
- civil service examinations
- the assessment of academic behavior
- study study of individual differences in behavior
