SUS Scale
System Usability Scale
Research Question (Quantitative)
Examples
* How effective is this user interface?
* Which of these two designs is better?
* Are users satisfied with the system?
* Did users’ performance improve over time?
* etc.
(Quantitative)Define Measures
How are you measuring what you’re interested in?
* Effectiveness
* Efficiency
* Usability
* Satisfaction
* Improvement in perception
* Improvement in performance
Pre-process data:
Filtering out useless data
* be extremely careful, use manual checks and
* other sanity checks on any manipulations
(Quantitative) What to Do with Data? (Analysis)
Describe it
* Allows reasoning about implications of results
* Allows others to compare with their data
* Caution: are you describing the relevant details?
Compare it
* With control or other experimental conditions
* Caution: are these really comparable?
Interpret it
* Is it plausible? Why did it turn out this way?
* Caution: do you really know?
* Future work?
Descriptive Statistics
Mean
* add up values and divide by number of data points
Median
* middle value of data when ranked
Mode
* value that appears most often in the data
Standard deviation
spread of the data
SD close to zero → data clustered very close to the mean
SD large → data spread over wide range of values
Descriptive Graphs
Histograms: how are the results distributed?
Boxplots: how do multiple distributions compare?
Bar graphs: how do different
categories compare?
Scatterplots: how are two
variables related?
* Line graphs: how did this data change over time?
* continuous data
* Heatmaps: identify clusters of data points (volume of
locations)