Heuristic Analysis

Question 1

What is heuristic analysis?

Answer 1

Non-user testing (aka discount)

Question 2

Why would we use heuristic analysis vs user testing?

Answer 2

• Cheaper (time, money, access to users)
• faster
• comprehensive
• easy to repeat
• don’t require ethics approval

Question 3

How many expert reviewers do you need for HA and what do they require?

Answer 3

1. Need at least 3 expert reviewers
2. Each reviewer needs a scenario
   • Based on task analysis and design
   • Just like in your test plan for users

Question 4

What should you establish before the evaluation?

Answer 4

3. Must establish the aims of the
   evaluation at the outset
   • I.M.P.A.C.T
4. Select appropriate heuristics
   • Use your textbook or online descriptions
5. Instruct the evaluators about how your
   software system is to be used

Question 5

What do the evaluators need to do during HA

Answer 5

6. Evaluators try to use the system
7. Evaluators apply heuristics rigorously and
   systematically
   • Work through scenarios
   • Imagine being the users
   • Assess the severity of mistakes and users
   ability to recover from errors
   • Helpful to use a standard reporting form
   • Need to work through several scenarios

Question 6

What does the evaluation team do after testing has been completed?

Answer 6

8. Evaluation team compiles all problems
• Make list of all potential problems
identified
• Even if only one evaluator predicted
problem it must be considered

Question 7

What does I.M.P.A.C.T stand for?

Answer 7

Intention • What are the users’ characteristics?
• What will the users need/want to do with the software?
Measures • What measures should be applied?
• How will those measures be operationalised and applied?
People Who will the experts be?
Activities Which concrete scenarios will be used?
Context • What is the software to be used in conjunction with?
• Is it part of a larger project?
• How much choice do users have to use this software?
• Is there teamwork and assistance?
• What is the physical set-up? Etc.
Technologies How will the system be represented to the evaluators?

Question 8

How are heuristics different from guidelines? how are they similar?

Answer 8

A heuristic is a process or method, while a guideline is a general rule or principle.
Heuristics may use guidelines to create their methods or influence their processes, but are ultimately about discovery.