Lec8 - Evaluation and Testing

Question 1

What is evaluation?
What are the types?

Answer 1

-Goal-directed process to assess idea/design
-Requires clear purpose and criteria
-Concerned with joint performance between human and system

Formative
Assess based on prototypes

Summative
Assess the final product

Question 2

What are the two ways to go about evaluation?

Answer 2

Analytically
Assessing prototype without users. Informal or formal review, carried out by experts.

Empirically
Observing performance of users with prototype

Question 3

What are some types of user studies?

Answer 3

Usability tests
Focus on identifying usability issues. Provides formative evaluation

Lab
Focus on user performance and experience. Controlled environment

Field
Focus on real-world. Little/no control over interaction between user and prototype

Question 4

What is usability evaluation?

Answer 4

Involves users
Controlled with clear tasks
Measures effectiveness, efficiency and satisfaction
Can use SUS but this only collects quantitative data

Question 5

What is think aloud?

Answer 5

User provides running commentary on everything they do whilst they carry out a task

Question 6

What is heuristic evaluation?

Answer 6

Low cost
One or more evaluators inspect UI against list of heuristics
List of issues presented graded by severity.

Question 7

What is cognitive walkthrough?

Answer 7

Formal method for inspecting usability.
Conducted by expert adopting user perspective.
Evaluator checks if the steps the user has to take to achieve a task are believable