evaluation

Question 1

What is evaluation?

Answer 1

Gather data about the usability of a design for a particular activity by a specified group of users within a specified environment

Question 2

What are the goals of evaluation?

Answer 2

• Assess the extent of the system’s functionality
• Assess the effect of interface on the user
• Identify specific problems within the system

Question 3

What are the 4 ways to evaluate?

Answer 3

• Empirical (actual users)
• Formal (models & formulas)
• Automated (software)
• Predictive/Critique (expertise & heuristic feedback)

Question 4

What are some evaluation methods for empirical?

Answer 4

• Lab studies
• Field studies
• Think aloud

Question 5

What are some evaluation methods for predictive?

Answer 5

• Heuristic Evaluation

- Cognitive Walkthrough

Question 6

What are user tasks?

Answer 6

• Tasks that are given to users to complete
• Tasks have description (input & expected output, info sheet)
• Decide on measures & questions (measure errors, how many success, how many time they see sheet)

Question 7

What is the think-aloud protocol?

Answer 7

• Ask users to think out loud while completing tasks

- Facilitators may prompt but not give solutions

Question 8

What is predictive evaluation?

Answer 8

• Conducted with expert reviewers in field

- Experts, not users, interact with system and find problems and give feedback

Question 9

What are the 10 usability heuristics?

Answer 9

• Visibility of system status
• Familiar metaphors & language
• User Control & freedom
• Consistency
• Error prevention
• Recognition over recall
• Flexibility & efficiency
• Aesthetic & minimalist design
• Recognize, diagnose, & recover from errors
• Help & Documentation