Who introduced the concept of practical intelligence and why?
Sternberg; to explain success in non-academic pursuits
What are some methods of assessing practical intelligence?
- simulations
- analysis of critical incidents
- situational judgement tests
What are some of the main advantages/innovations of computers in testing, for the future?
- speech recognition input
- ability to correct answers and provide feedback and a report immediately
- the same stimulus is displayed in exactly the same way to each examinee, greatly improving standardisation of presentation
What is the only exception between the administration/responding of pencil-and-paper tests and computerised-testing?
Speeded tests
What was Kyllonen’s (1997) ‘smart test’ designed to do?
to incorporate all current significant technology associated with abilities measurement
___ minimises the error variance around a single trait estimate, whereas ____ minimises the ‘volume of the credibility hyperellipsoid’ round the cluster of all trait estimates
CAT; MAT
What is the main advantage of CAT over MAT?
The potential to reduce testing time without sacrificing accuracy of measurement due to its selection of maximally informative items
What is the main disadvantage of CAT?
Needing to develop an item bank large enough
What is the main disadvantage of MAT?
The likelihood of frequent chopping and changing between item types, as the system selects items from any subtest in the battery
To date item generative techniques have mainly been used to develop what?
Figural ability items
What is the aim of time parameterisation?
To solve the fundamental problem of speed-accuracy trade-off
What is a key disadvantage of internet testing?
- digital divide
- security of information
- bandwidth limitations (e.g. ping latency)
- not currently suited to full-blown psychological assessment
What is ‘ping latency’?
Not knowing when the question appeared on the test taker’s screen after it left the server
How many levels of supervised testing due Bartram (2000) propose?
4
What did Batram (2000) suggest as the main functions of a supervisor?
- authenticating the test taker
- establishing test taker rapport
- ensuring the test is administered according to the manual
- preventing cheating
- ensuring security of the test itself
What are Bartram’s (2004) 4 types of supervision?
- open (anyone can access the test, no user identification, no supervisor)
- controlled (being sent a password and logging onto a testing site, no human supervision)
- supervised (presence of a supervisor, but in a non-secure environment)
- managed mode (formal examination conditions)
Which is deemed the supervision mode of choice for most professionally developed internet tests?
Unproctored controlled mode
What are the two main reasons for the drop in the use of psychological assessment between 1970-2000?
- cost of assessment
- apparent weak link between many forms of assessment and useful therapies
