1 of 22

Usability Testing Library Mobile Websites in a Fragmented Smartphone World

Kimberly Pendell & Michael Bowman

1

2 of 22

Outline

  • Smartphone ownership and use
  • Smartphone market and trends
  • Usability test and results
  • Mobile site suggestions and trends

2

3 of 22

Internet Use by U.S. Smartphone Owners

  • 35% of Americans owned a smartphone in April, 43% by December (Nielsen)
  • 69% typically go online daily using their smartphone: 81% of 18–29 yo, 71% of 30–49 yo, 44% of 50+ yo
  • 25% go online mostly using their smartphone, particularly: 42% of 18–29 yo, 38% of African-Americans and Latinos, 40% of < $30,000 annual income, 33% of high school graduates with no college

3

Pew Internet & American Life Project, April–May 2011

4 of 22

The Smartphone Landscape

4

5 of 22

U.S. Smartphone Market Share, 2010–11

5

Sales per quarter

Source: NPD Group Mobile Phone Tracker

6 of 22

U.S. Smartphone Ownership, Q4 2011

6

Installed base

Source: Nielsen Mobile Insight

7 of 22

Android OS Version Market Share

7

January 2012

Source: developer.android.com

8 of 22

Mobile Internet Access Market Share

8

February–December 2011

Source: NetApplications.com

9 of 22

Trends

  • Android’s future
  • Monopoly, duopoly or triopoly?
  • The future of feature phones
  • The effect of tablets

9

10 of 22

Field Testing vs. Laboratory Testing

  • Field testing: difficult to have reliable method for reporting back user experience; high level of participant cooperation required
  • Laboratory testing: important usability problems with mobile website can be easily missed

10

11 of 22

Our Version of Hybrid Usability Testing

  • Recruit participants to test site with their own phones
  • Controlled environment with recording capability
  • Predetermined tasks
  • Time for user to explore site independently
  • Post-test survey

11

12 of 22

Recruiting Participants

  • Facebook post on library account
  • Announcement in library news blog, appearing on library homepage
  • Flyers in the library and campus bulletin boards

12

13 of 22

Document Camera as Recording Device

13

14 of 22

Results

  • Participants slow to connect the task of searching for a book with label “Search PSU-only Catalog”
  • Multiple problems with chat reference
  • Lack of mobile-friendly proxy authentication, error messages and linked forms
  • Slow page loading
  • Problems unique to different devices

14

15 of 22

Website Display Comparison

15

Smartphone vs. Feature Phone

16 of 22

Connectivity & Authentication

16

Internet Connection

Library Mobile Website

Chat Reference

EBSCOhost

PSU unsecure wi-fi

No authentication

Authentication required

Authentication required

PSU secure�wi-fi

No authentication

No authentication

No authentication

Cell network

No authentication

No authentication

Authentication required

Off campus

No authentication

No authentication

Authentication required

17 of 22

Notable Post-Test Survey Results

  • High ratings for appearance and ease of use
  • Search for articles on mobile website
    • 9 of 12 participants selected weekly or more than weekly
  • Use “Find A Computer”
    • 8 of 12 participants selected weekly or more than weekly
    • “Everyday” and “Very important”

17

18 of 22

Usability Tips for Mobile Sites

  • Essential, user oriented content
  • Consider the user’s mobile context
  • Navigation as simple as possible
  • Design for screen rotation

18

19 of 22

Learn From Our Mistakes

  • Consider the variety of ways users connect to your mobile site and how that might impact their use of site features
  • Don’t make your usability tasks so simple that you waste the opportunity to get more in-depth information
  • Expect the unexpected

19

20 of 22

Portland State Smartphone Share

20

Usability study (May) & mobile website analytics (Sept.–Jan.)

Study Volunteers

Website Usage

Android

31%

23%

iOS

52%

70%

BlackBerry

4%

0.6%

Windows Phone

4%

0.5%

webOS

4%

0%

21 of 22

Possible Futures of Mobile Web Design

  • Progressive enhancement
  • Responsive design
  • Mobile first

  • XKCD (n.d.) University Website. http://xkcd.com/773/

21

Text

22 of 22

Questions?

22

Pendell, Kimberly D., and Michael S. Bowman. (In press). “Usability Study of a Library’s Mobile Website: An Example from Portland State University.” Information Technology and Libraries.