EvaluationCommunicationhigherAdvanced

UX Scorecard

Also known as: Usability Scorecard

Graphic synthesis tool that groups multiple metrics to provide a global view of product health.

What is it

Strategic value

Transforms complex usability data into clear performance scores that all team members can understand, including those without UX or statistics training.

Category: Communication and reportingEstimated time: 2-4 hours (post-study, with data already collected)

The UX Scorecard is a graphic synthesis tool that groups multiple metrics to provide a global view of product health. It condenses large amounts of data into an executive visual format, allowing decision makers to understand usability status at a glance without reading extensive reports.

What it is for

Present results to executives or sponsors seeking executive summaries
Compare different design versions (A/B)
Track usability changes across iterations or over time
Transform complex usability data into clear performance scores for the entire team

Research methods that feed it

Usability tests (Think Aloud)Satisfaction surveys (NPS, SUS, CSAT)Behavioral analyticsHeuristic evaluations

When to make it

When to use it

To present results to executives or sponsors seeking executive summaries
To compare different design versions (A/B)
To track usability changes across iterations or over time

When NOT to use it

If development team needs deep qualitative details to fix the interface
In very early phases where only basic qualitative feedback is sought
In extremely fast design iterations where formal measurement is a distraction

How it is made

Required components

Measurement factors (base metrics): metrics chosen to evaluate the product (completion rate, time on task, error rate, satisfaction)
Performance results: actual values obtained in measurement
Visual summary charts: graphic representations that allow understanding data at a glance

Optional components

○Target values: ideal goal for each metric
○Metric weights: weightings if some metrics are more critical
○Radar charts: to summarize results of three or more metrics at global level
○Combined line and column charts: to summarize two different metrics across several tasks
○Harvey Balls: partially shaded circular ideograms for comparative tables

How to create it step by step

1Define measurement factors: Determine what to measure and why (quantifiable metrics).
2Identify specific metrics: Choose data sources (analytics, usability tests, heuristic evaluations).
3Assign target value: Determine ideal score or percentage for each metric.
4Assign weight (optional): Give more weight to more important metrics for final calculation.
5Execute measurement: Conduct study and record results.
6Synthesize and chart: Convert tabular data to visual format (Radar, Harvey Balls) on a single slide.

Tips for small teams

Start with 3-5 key metrics, don't try to measure everything
Use Google Sheets with conditional formatting for a quick version
Always include target value for context
Reuse the format across studies for comparability

Contextualized example

Context: Quarterly evaluation of mobile banking app.

Metrics: Task completion rate (target: 90%, actual: 78%), Average time on task (target: <2 min, actual: 3.2 min), SUS Score (target: 70, actual: 62), NPS (target: 40, actual: 35).

Result: Radar chart shows clear gap in efficiency. Action: redesign transfer flow consuming 45% of excess time.

How to tell it is done well

Quality criteria

Pattern recognition: allows easily detecting general trends and problematic aspects at a glance
Executive clarity: summarizes complex metrics into clear scores that all team members can understand

Common mistakes

Measuring everything at once: trying to measure too many variables simultaneously
Visually overloading the presentation: showing too much data ruins the executive purpose
Using metrics that don't add value: if the metric doesn't help answer a research question, don't include it

Authority quotes

“A scorecard brings together a variety of financial and non-financial metrics into a single, concise report.”
— Content Strategy for the Web

An alternative is to present the metric results graphically in a summary chart.
— Adapted from Tullis and Albert (2008), p. 203

Try to create a single slide that clearly shows the key usability data at a glance.
— Adapted from Tullis and Albert (2008), p. 297