1 of 67

Scorecard

Workforce | EX

Epic Icon

2 of 67

The scorecard is one of the key places where the client will look for both the summary and detailed answers to their survey questions. By revamping the existing scorecard, we are adding features like comparing each block with the overall mean of the survey, customizing the scale favorability & colors, switching decimal points, and exporting the data to Excel. The new enhanced scorecard will be available in the portal as a widget.

Why?

Due to the old UX, the scorecard is difficult to use. It is difficult to understand the mean data and the comparisons are based on which marker or question. Scale favorability customization could be made easier and colors cannot be customized.

Problem

Solution

3 of 67

What are we trying to get out of the Scorecard?

The scorecard is one of the key places where the client will look for both the summary and detailed answers for their survey questions

Note: only likert-type items can be represented in the scorecard. Multiple choice, ranking, etc cannot. At a later date we will need to look for a better solution to this than we have today, but the importance of this scorecard will still remain

Often clients will have specific themes/sections for their surveys, like “diversity & inclusion” or “wellbeing”. Under each of these sections they will have specific items, like “I feel like my opinion at Company X matters”
Some ways that clients will use the scorecard is to know:

What area am I the strongest in? This for example can be diversity & inclusion
What area am I performing the lowest in? This for example could be wellbeing
To know where they are performing the best, today they will know by the difference between the OVERALL survey mean, and the score for a specific section

To dig deeper, if they find that wellbeing is an area where they are performing the lowest, they’ll want to know which specific items they are performing the lowest on and see if they want to take action in that area. Today for this analysis we look at the wellbeing item mean compared to the wellbeing category mean, not the overall survey mean. In reality the ranking of the highest and lowest items will be the same, but the number difference will be different.

In the future, we will likely want to trigger action planning from any specific items where the score was low.

To some clients favorability is even more important than the mean. For example, it’s not as important to them that “I feel like my opinion at Company X matters” had a mean of 4.3, but that it had an 85% favorability score. What is a favorability score? It’s the % of people who either strongly agreed or agreed to that statement.
Scorecard is the only place where the customer can compare results from the current survey to previous surveys. To do so, the mapping has to be done manually from the roster, and it shows up here in table form. We have a widget for trending BUT that only shows one question at a time so it’s not sufficient, and it’s also currently broken.

4 of 67

Problems

Inability to sort results by favorability score, you can only sort by mean

To know the actual number of respondents per favorability (green, yellow, red) you have to manually calculate it

Overall benchmark (to be renamed) is confusing. On the category level it is compared to the overall survey mean, but on the item level it’s compared to the category mean. This is the desired behavior, however the way it’s shown today it’s not intuitive to users.

Labels (distribution should be favorability, benchmark should be something that’s clear that it’s comparing to their score not other companies’)

Scorecard in admin doesn’t allow for comparison between surveys, but it does in Manager in portal. Even in the manager portal, this table view is very confusing.

Jane is an administrator who manages the employee experience surveys and want to analyze the data in scorecard. Due to current scorecard she is not able to fetch the detailed information and is not able to customize her scorecard to add it to her presentation. ��Jane wants the ability to customize and compare the scorecard results to finish her study. She would want the scorecard to give her detailed information.�

�

5 of 67

6 of 67

7 of 67

The purpose of this highlighted in red is to show YoY comparison and see the greatest improvements and the greatest declines

8 of 67

Jane Doe

Demographic

Name

Behaviour and Actions

Needs and Pain Points

Handles the EX Survey product service provided by QP for multiple organizations.
Study the data by categories that displays the percentage of respondents that had favorable, neutral, or unfavorable responses.

Young Women
Married
Own the culture and constantly strive to maintain the best
Handles getting insights from the data & coming up with actions.

User Persona

Not able to customize or edit the data in scorecard.
Doesn’t want mean data in two decimal points.
Wants at each level of question the comparison to marker or overall mean visible.
Not able to customize the colors of scale.

9 of 67

She wants to know the exact number of respondents that had favorable, neutral, or unfavorable responses along with the percentage data. She wants to know how the scale scoring is set and if she can change the scale color similar to heatmap to add the scorecard in her presentation.

She wants to compare the past year’s employee data and would want the ability to set the comparison as delta or base value. The benchmark data in the current scorecard is actually overall and she is not able to edit it.

The mean value shows two decimal places and that is an overload of information for her, it would have been easier to run data analysis with one decimal point.

She wants to run a custom survey on Half-day Friday’s and do not want to set building blocks as it is a short survey. Can the scorecard show data without the blocks.

Jane is an Administrator who manages the employee experience surveys and want to analyze the data in scorecard -

Use Cases

10 of 67

Suggested solution is to do a revamp of the scorecard and significantly increase usability.

Revamp features:

Redesign the Scales - easy to read percentage & number of respondents on hover
Add Scale legend.
Ability to change the scale colors and set the favorability (user can set the scale)
Add column sorting icons & the ability to sort scales as per the data (include favorability sorting)

Note: in the future we may want to think about a possibility to toggle between mean and favorability comparisons. Today everything is based on means, and adding favorability to the same tables would be too much. But there are companies who prefer favorability in their analysis to using the mean, we need to better understand the volume of those companies, and doing research with just our existing clients will not be enough to understand that.

Ability to expand all & collapse all blocks at once
Show questions directly if marker and building blocks are not defined.
Come up with better terminology for “benchmark” that we use today as it’s a comparison to the internal survey scores and benchmarks are often thought of as external
Default data in One Decimal Place & give user ability to switch to two decimal places if they want
Making survey comparison easy to use and read - Manager Portal
Add a Scorecard card in add widget option in portal.

Solution Description

11 of 67

Current Scorecard

12 of 67

Scorecard New Design

13 of 67

Scorecard Default View

Name of the study and overall respondents (n=completed the survey)

Metric’s rows in grey to help identify the user the difference between the Metric and its content when expanded

Study overall mean

Kebab icon triggers a drop down menu with options to customize the color palette, favorability intervals and decimal places displayed.

Add Benchmark comparison

COLLAPSED METRICS

14 of 67

Scorecard Home

EXPANDED METRIC EXAMPLE

Different font weights are assigned to each level to help identify easily the metrics, sub-metrics and questions/items.

Metric - Medium

Sub-metric - Regular

Question - Light

The overall results framework will remain sticky when the table gets too long

A scroll bar will indicate the user content existing beyond its sight

The widget will occupy as much space as possible depending on the screen size but no more than that, respecting a distance of 16 px from the upper menu bar and the bottom of the screen.

15 of 67

Scorecard Comparison Interactions

To understand where the mean comparison is coming from, the hovered-over mean will be highlighted, as well as the mean to which is comparing, in this case it’s the overall mean. A tooltip will be triggered explaining where the comparison result comes from.

METRIC VS OVERALL MEAN

16 of 67

Scorecard Comparison Interactions

METRIC VS OVERALL

17 of 67

Scorecard Comparison Interactions

SUB-METRIC VS METRIC

Individual Question will compare against the category its in, whether its a Sub-Metric or Metric. See next slide.

18 of 67

Scorecard Comparison Interactions

QUESTION/ITEM VS SUB-METRIC

Individual Question will compare against the category its in, whether its a Sub-Metric or Metric. See next slide.

19 of 67

Scorecard Comparison Interactions

QUESTION/ITEM VS METRIC

In the case where there are no Sub-Metrics set up.

20 of 67

Customizing Favorability Color Palette

21 of 67