EZ Comm Email Preference Test
Research Findings Presentation
January 2022
TM
Background & Objectives
Proprietary & Confidential
2
TM
Background
Our members receiving the EZ Comm email for the first time are unfamiliar with Naviguard because they have not had or have not used their out of network benefits before, which might cause confusion on what happens next. If we can solve this problem, it would impact our newer members positively because they could more easily engage and form trust with Naviguard. It would also benefit our business because it would help inform how we prioritize our messaging throughout discovery touchpoints.
Problem Statement
What is this research about?
Proprietary & Confidential
3
Stakeholders
Key Dates
Kick-off | 01/25/22 |
Pilot | 01/28/22 |
Conduct Study | 01/31/22 |
Analysis + Read out | 02/01/22 |
As we develop the EZ Comm email with the new branding and voice of Naviguard, we want to understand what order of information is the most helpful as they are introduced to Naviguard.
TM
Objectives
Success Criteria
Why are we doing this research?
Proprietary & Confidential
4
TM
Research Scope & Methods
Proprietary & Confidential
5
TM
Research Methods
Conduct an unmoderated quantitative preference test with 11 participants, this allow us to be more confident that our findings are generalizable to all users and gives us statistical significance.
We will show participants both designs side by side and have them answer a survey of multiple choice and open-ended questions.
Primary Method
How did we execute this research?
Proprietary & Confidential
6
TM
Key Findings
Proprietary & Confidential
7
TM
Layout Preferences
Key findings
Proprietary & Confidential
8
54%
Preferred Layout A
“You can shorten it up, you know, use the layout A, and take meet Naviguard out completely.”
- Participant 4
TM
Layout Preferences
Key findings
Proprietary & Confidential
9
46%
Preferred Layout B
“I think saying meet Naviguard first and then wrapping up the email with look for an email, just seems like the you know, the way that makes sense. A perfect flow”
- Participant 2
TM
Clarity & Trustworthiness
Key Findings
Proprietary & Confidential
10
63%
Of participants found the designs very trustworthy
72%
Of participants found the designs very clear and understood what was going to happen next
“I think both are trustworthy just because it tells you whom it's from and you’re a member of this plan, where it's going to come from, and that actually is very trustworthy.”
– Participant 1
TM
Brand personality traits expressed
Key Findings
Proprietary & Confidential
11
Dedicated, this company is dedicated to help me resolve my bill
Connected, feels like we’re working together on the situation
Empathetic, presents the situation and offers solution and feels like the company cares
Dedicated, I got the feeling that this email wanted me to be well informed and why I was being contacted
Principled, before connecting me to third party they are informing me about it
Principled, no nonsense, gets you right to where you need to be, disciplined and down to earth
Between dedicated and principled, but went with dedicated because it seems like this is what Naviguard does and can help me resolve this
Connected, personal email to me and it’s going to connect me with Naviguard, I feel connected in the email
TM
Rating System
How to interpret and prioritize key findings from this research.
Proprietary & Confidential
12
Color Coding | Meaning |
| High frequency + high impact = must address now |
| Low frequency + high impact = should address soon |
| High frequency + low impact = consider addressing in the future |
| Low frequency + low impact = keep in mind and consider addressing as you can |
TM
“Meet Naviguard” section
Based on feedback from this test, we have an opportunity to refine our information architecture on how we introduce Naviguard to instill more confidence in our members.
What?
Proprietary & Confidential
13
Why?
How might we integrate a more succinct introduction of Naviguard into the start of the email?
How Might We?
TM
“Look for an email” section
Based on feedback from this test, we have an opportunity to build more trust and clarity to our look for an email section.
What?
Proprietary & Confidential
14
Why?
How might we bring a more human and cohesive solution to this section?
How Might We?
TM
Appendix
Proprietary & Confidential
15
TM
Screener Overview
Who did we test with?
Proprietary & Confidential
16
TM
Survey Results
Proprietary & Confidential
17
TM
Survey Results
Proprietary & Confidential
18
TM
Survey Results
Proprietary & Confidential
19
TM
Survey Results
Proprietary & Confidential
20
TM
Survey Results
Proprietary & Confidential
21
TM