1 of 44

Voice UIs

Promises and Challenges of a "New" Technology

Alan Harnum

aharnum@ocadu.ca / @waharnum

Inclusive Design Research Centre, OCAD University

2018 Guelph Accessibility Conference

2 of 44

Introducing Myself and This Talk

3 of 44

Senior Inclusive Developer

4 of 44

idrc.ocadu.ca

5 of 44

I Am Not An Expert About Voice UI

6 of 44

But I’ve Got Some Thoughts About It Anyway

7 of 44

What I Think Might Be Going On

8 of 44

I’m Sorry I’m Going to Use the Phrase “Inflection Point”

9 of 44

Cheaper! Better!

10 of 44

Invasive! Insecure! Surveilling!

11 of 44

The Path Forward

12 of 44

What Are Voice UIs?

13 of 44

Voice-Based Controls

14 of 44

Wide Range of Devices

15 of 44

Science Fiction (Double Voice UI Feature)

16 of 44

Excluding Some Voice-Based Technologies

17 of 44

Several Things Are Happening at Once (As Though This Is Ever Not the Case)

18 of 44

Why Are They of Interest for Accessibility and Inclusion?

19 of 44

www.cbc.ca/radio/spark/380-phantom-traffic-jams-catfishing-scams-and-smart-speakers-1.4482967/smart-speakers-make-life-easier-for-blind-users-1.4482978

20 of 44

Briefly (I Promise) Bringing Up Some Things from My Talk Last Year

www.alanharnum.ca/post/2017-06-01-multimodal-design-for-inclusion/

21 of 44

In the Space of Hopeful Potential

22 of 44

How New Is The “New” Technology?

23 of 44

Live Tech Demos of Experimental Work : Good Idea, or Great Idea?

github.com/colinbdclark/transcribingRecorder/tree/componentization

24 of 44

Voice UI Work Is Easier Than You Think, I Promise

25 of 44

Of Course There Are Some Problems (Even Before We Get Into Privacy and Security)

26 of 44

If You Don’t Speak Certain Languages, You May Be Out of Luck

27 of 44

Even If You Speak Those Languages, You May Have to Speak Them in a Certain Way

www.wired.com/2017/03/voice-is-the-next-big-platform-unless-you-have-an-accent/

28 of 44

Like Everything Else These Days There’s Machine Learning, and Therefore Algorithmic Discrimination

29 of 44

What Are the Privacy and Security Concerns?

30 of 44

“The FBI Can Neither Confirm Nor Deny Wiretapping Your Amazon Echo”

paleofuture.gizmodo.com/the-fbi-can-neither-confirm-nor-deny-wiretapping-your-a-1776092971

31 of 44

“Amazon refusing to hand over data on whether Alexa overheard a murder”

arstechnica.com/tech-policy/2017/02/amazon-wont-disclose-if-alexa-witnessed-a-murder/

32 of 44

“How an Amazon Echo ended up recording and sharing a private conversation”

www.vox.com/2018/5/25/17393870/amazon-echo-alexa-privacy-recording-conversation

33 of 44

“Voice assistants can be hacked by commanding them with inaudible ultrasonic speech”

boingboing.net/2017/09/07/flipper-faster-than-lightning.html

34 of 44

It’s Also Embarassing I Was Talking to Google Past Midnight

35 of 44

“The Privacy Threat From Always-On Microphones Like the Amazon Echo”

www.aclu.org/blog/privacy-technology/privacy-threat-always-microphones-amazon-echo

36 of 44

This All Feels Very Personal?

37 of 44

What Are Some Potential Directions for the Future?

38 of 44

You See Me Now, A Veteran, of the 90s Browser Wars

39 of 44

Open Source Possibilities

40 of 44

Mozilla Common Voice

voice.mozilla.org

41 of 44

Jasper

jasperproject.github.io/

42 of 44

Snips

snips.ai

43 of 44

Questions and Discussion

44 of 44

  1. Do you have interesting examples of voice UI in action from your own life, work or research?
  2. Can you think of ways we could use voice UI to build new technologies that increase inclusion and accessibility?