1 of 15

Concept Testing

MAD9034

User Experience Design

1

2 of 15

UX Design Process

Usability testing

2

  • Empathize
  • Define
  • Design/Ideate
  • Prototype
  • Test

Experience and explore possible solutions

    • Ideation
    • Design concept testing
    • Prototype usability testing
  • Implement + Measure

Source: https://www.nngroup.com/articles/design-thinking/

3 of 15

Usability Testing

Definition and Goals

3

Usability testing or user testing refers to evaluating a prototype, product or service by testing it with representative users.

​

Goals

  • Identify problems in the design
  • Discover opportunities for improvement
  • Learn about users

Usability Testing (User Testing)

4 of 15

Usability Testing

What might we do usability testing?

4

​

Know the user

Content

Design

Test & Refine

Usability Testing

​

​

​

​

Usability testing reveals information about:�

  • Ability to complete a task
  • Time to complete a task
  • User satisfaction using the product
  • Opportunities for improvement/alternate paths to complete a task
  • Performance

5 of 15

5

Prototyping and Usability Testing give product teams the confidence to try new ideas, because they will be validated before too much time or money is invested.

6 of 15

Elements of Usability Testing

Usability Testing

Image source

  • What to test (tasks, flow)
  • Level of fidelity required for the prototype
  • Participants who are representative of the target market
  • Appoint facilitator and note taker

6

Usability Testing 101

7 of 15

Execution

Usability Testing

Image source

Participant

  • Completes one task at a time
  • Thinks out loud
  • Fly-on-the-wall
  • Has access to the prototype

Facilitator

  • Ask questions to clarify user actions
  • Record quantitative and qualitative measures

7

8 of 15

Usability Testing

Measure and Analysis

8

Quantitative data

Qualitative data

Success rate

Error rate

Time to complete a task

Satisfaction

Path taken by the participant

Problems encountered

Comments and recommendations

Answers to open-ended question

�Good problem statement

Clicked “Food diary” instead of “Add new food”�Poor problem statement

Clicked the wrong link

​

9 of 15

Usability Testing

Reporting

9

  • Both positive and negative findings.
  • Quantitative data (task completion rate, success rate, satisfaction rate)
  • Level of severity for each problem (critical, serious, minor)

​

  • Recommendation for each problem or group of problems

​

Reporting Usability Test Results

  • Record and report direct user quotes when possible. (persona)
  • Next steps

10 of 15

User Testing

Apple Watch fitness application

Usability (User) Testing

10

11 of 15

Fitness Application Design

Work breakdown

11

Week 2.1

Form groups. Prepare to learn about your user, context of usage and the problems to solve. Conduct user interviews to “know your user.”

Week 2.2

Map out the problem and select a place to focus.

Week 3.1

Sketch ideas and choose the one to proceed with.

Week 3.2 (today)

Create a prototype

Week 4.1

Test the prototype with real people

The Design Sprint

12 of 15

Usability testing prep (10 mins)

Today, in class

Image source

  • 2-3 tasks to test
  • Prototype ready and working
  • Facilitator and note taker appointed

​

12

13 of 15

Usability Testing Execution

Today, in class

Image source

Participant

  • Completes one task at a time
  • Thinks out loud
  • Fly-on-the-wall
  • Has access to the prototype

Facilitator

  • Ask questions to clarify user actions
  • Record quantitative and qualitative measures

13

14 of 15

Exercise 5 and 6

Usability Testing & Final Presentation

14

Details on the course website: Exercise 6

Details on the course website: Exercise 5

15 of 15

Coming up

Testing

15

Mandatory

​

  1. Have the presentation ready to share in class
  2. Exercises 5 and 6 submission