ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
2
PLAN
3
DesignerZoe Nguyen
4
5
Website for test:
https://democracy-lab-staging.herokuapp.com/projects
6
Official website:
https://www.democracylab.org/
7
8
Background:
DemocracyLab is a platform that connects skilled tech volunteers with tech for good projects that seek to tackle the world's most challenging problems.
9
10
Goals:
Discovering usability issues when volunteers search and apply for a project
11
Asses the learnability of “DemocracyLab" for new users interacting with the web app for the first time.
12
Observe and measure if users understand the app’s functionality and values, and users’ satisfaction when using the app.
13
14
Participants and schedule:
People who have tech skill and searching for volunteer opportunities
15
3/3/2021 - 8/3/2021
18
3-5 participants
30-60 mins/session
19
20
Test Objectives
Determine if participants understand what the app is about quickly and easily and the value it provides.
21
Observe how users navigate and find information for accomplishing main tasks—
can they successfully find what they’re looking for?,
How easily they process the task?,
How many attempts for a task successfully done?
How many errors they encounter?
More concrete: find projects, apply projects...
22
23
Methodology and equipments:
Moderated-remote/in-person tests
The tests include a short briefing, task performance with DemocracyLab conducted on a laptop, and a debriefing.
24
25
Equipments
Moderated-in-person tests: laptop, recording by quicktime player
Moderated-remote tests: Via Zoom, participants’ laptops
26
*create a fake account for testing
Account Google:
zoenguyentest@gmail.com
27
March2021
28
SCRIPT:
Hi and thanks again for taking the time to participate in this
study. Before we get started, I’d like to give you a brief
overview of the test, about some context regarding what
we’re testing and why.

Today, I will be asking you to try out an web app
called DemocracyLab and do a few activities on the app, so
I can see whether it works as intended. Please remember
that I am testing the app and not you!
There are no right or wrong answers so don’t worry that
you are going to hurt my feelings. I am doing this to improve
the app, so I will greatly appreciate your honest opinions and
reactions.

I will start by asking you a few general questions about
volunteering activities ann tech-for-good projects, then
move onto some activities using the DemocracyLab app.
As you use the app, I’m going to
ask you as much as possible to try to think out loud: to say
what you’re looking at, what you’re trying to do, and what
you’re thinking. This will be a big help to me.
29
30
If you have any questions at any point, just ask them. I may
31
not be able to answer them right away, since I am interested
32
in how people do when they don’t have someone sitting next
33
to them to help. But if you still have any questions when
34
we’re done I’ll try to answer them then. And if you need to
35
take a break at any point, just let me know.
36
37
Finally, before we get started, would it be okay if I record
38
your screen and voice during this testing session? The
39
recording will only be used within this project to help me
40
understand where I need to improve the app and won’t be
41
used for any other purpose. Is that okay?
42
43
Do you have any questions so far?
44
Are you ready to continue?
45
Okay! We’ll start recording and begin the session.
46
47
Questions:
Demographics questions:
Break the ice: tell me a bit about yourself...
48
How old are you?
sensitive --> if necessary: age range, collect in screening (survey) before test
49
Where are you from?
50
What is your occupation?
51
52
1. What are the skills you would like to use as a volunteer? What is your motivation to join a volunteer project?
What is your experience with volunteering, what specific skills did you use to volunteer
53
2. Have you took part in a civic tech project? / non-profit tech project? If yes, please share your experience
54
3. If yes (answer for 2), how did you find these opportunities? Have you used a web app for searching opportunities like this before? Please share your experience.
55
4. If no (answer for 3), have you heard about them? What is your opinion about this kind of platform?
56
5. What are the factors that you are deciding on a web app that connect volunteer?
57
58
First Impression
Thank you for answering those questions. Now, I’d like to show you
59
the web app and start by getting your initial impressions of the app.
60
61
Without clicking anywhere just yet, can you tell me your first
62
impressions? What do you think about the information displayed on
63
the page?
64
65
Remember to think out loud as much as possible.
66
67
What do you think you would use the app for?
68
69
Thank you. Now, I’d like to ask you to try out some activities using the web app.
70
71
72
Tasks and scenarios:
73
74
You want to search and apply for a volunteer project to .... (based on the motivation of the participant). Go to the web DemocracyLab and
75
1. Search for a relevant project in your interest
Ask in conversational way, let they do by themselve
76
77
Sub-task:
Try to find a relevant issue area that you are interested in
78
Try to find projects that need your skill
79
Following-up question: How do you think about the Information presented in the website? How do you think about the searching experience?
80
81
2. Apply for a project
82
Following-up question: How do you think about the process of applying for a project?
83
84
85
Single Ease Question (SEQ).
Overall, what do you think about the experience
86
doing these tasks? Please evaluate by grading and
87
specify your reasons.
88
[1 (very easy) to 7 (very difficult)]
89
90
Net Promoter Score (NPS).
91
How likely is it that you’ll recommend this app to
92
a friend or colleague?
93
[0 (not at all likely) to 10 (extremely likely)]
94
95
Question after tests:
What could be done to improve your experience with the app?
96
97
98
99
100
101
102