What are the challenges in measurement?
psychological phenomena are complex, participant reactivity such as demand characteristics, observer bias/expectations, use of composite scores (e.g., compiled list of different items into one construct, and sometimes same item taps into multiple constructs), score sensitivity, lack of awareness of any psychometric information
What are the types of decisions in testing?
- individual (potential for misuse of test, snapshot of behavior, test giver can put too much weight or significance on results of test and then change behavior or future testing) vs institutional (if someone is going to get hired or admitted base on a test, demand characteristics)
- comparative (taking results of test deciding between number of options, e.g., what type of anxiety a person has after showing anxiety on a test) vs absolute (yes vs no, interview or not, continue with Tx or not, likelihood of person being violent, etc.) decision
What are some concerns with testing?
- issues of privacy (lots of personal information can be asked for, how to assume test taker is going to be honest—can try to calm them by saying who will have access to info, what it’ll be used for etc.),
- fair use of test (what is the info going to be used for, what is the outcome is that fair for the test taker. Shouldn’t be unfairly biased towards a particular group of people),
- impact on society (e.g., intelligence testing [bell curve—linking levels of intelligence to weakly associated outcomes, linking it to race, trying to create a cognitive elite], should present honest and accurate information)
Who writes the ethical guidelines for psychologists?
ethical principles of psychologists and code of conduct (by the APA). The standard for educational and psychological testing
What are the themes of issues in testing?
the need for high standards of ethics when administering and using tests; the need for good practice in choosing, administering, interpreting and communicating the results of tests
How should psychologists prove their competence?
- An understanding of norms, reliability, validity, and test construction 2. Knowledge of specific procedures applicable to a particular test (administration, scoring, etc) 3. The psychologist is responsible for continually updating their knowledge and assessment skills 4. Recognizing the boundaries of competence
What are the test developer responsibilities?
- Define clearly what the test measures and who it applies to
- Accurately present characteristics and limitations of the test
- Review test items for insensitive content and language
- Conduct appropriate psychometric procedures for design, standardization and validation
What are the responsibilities involved in test administration?
select tests only after they have conducted a thorough review of all tests available, have and maintain a thorough knowledge of all test materials (including the manual), avoid using the tests for purposes that are not recommended by the test developers, provide the test-takers with information about their rights, inform the test-taker how long scores obtained will be kept on file and to who they can (and will) but released, explain the results of the test in language the test-taker can understand
What are the test takers rights?
be treated with courtesy, respect, and impartiality, regardless of age, disability, ethnicity, gender, national origin, religion, sexual orientation or other personal characteristics; be tested with measures that meet professional standards and that are appropriate, given the manner in which the test results will be used; know, in advance of testing, when the test will be administered, if and when the test results will be available, and if there is a fee for testing services; have the test administered and the test results interpreted by appropriately trained individuals who follow professional codes of ethics; a brief oral or written explanation (prior to testing) about 1. Purpose for the testing 2. Kinds of testing to be used 3. If the results will be reported to them or to others 4. The planned use of the results; inquire and receive information about testing accommodations I they are disabled; know, in advance, whether any accommodations will be made available if they have difficulty comprehending language of the test.
How do you get information about tests?
the mental measurements yearbooks, tests in print, test critiques (must explore scientific literature)
