Motricity in the Immersive Web

Inclusive & Accessible Locomotion and Interaction in XR on the Web

November 5, 2019

@rolanddubois

Overview

  • The trend towards controller-free input
  • Why is XR hardware failing?
  • What can we learn from AT?
  • Experiments, Tools and Projects
  • Discussion

What Is Accessibility?​ #a11y

Is VR inherently inaccessible?

When something is accessible, a person with a disability can
(to the greatest extent possible):​

  • acquire the same information,​
  • engage in the same interactions,​
  • and enjoy the same services as a person without a disability,​
  • with substantially equivalent ease of use.​

Accessibility =​ Designing things to provide equal access to people with disabilities​

In Other Words​:

Immersive Web — making experience accessible

2D Web — making content accessible

The trend towards controller-free input allows no space for graceful degradation

Low-cost brain computer interfaces (BCI)

Emotiv

Muse

Nia

NeuroSky

Neurable

BCI & VR in Research

NeuRow,

Spatial gesture / hand motion control

Kinemic

Gest

Nod

MYO

Bixi

Leap Motion

Hololens 2, Magic Leap, VIVE Hand Tracking SDK, Oculus 2107 - Oculus Hand Tracking OC6

Why is XR hardware failing?

What can we learn from Assistive Technologies (AT) ?

What people think when they hear VR

https://www.flickr.com/photos/yelp/28474934237/

Who do people interact and play in VR

https://www.flickr.com/photos/yelp/28474934237/

Accessible Controllers

Emotiv

Accessible Controllers - 3dRudder

In-Vehicle Assistive Technology (IVAT)

https://spinalpedia.com, Flickr, NYT, Tesla self-drivng car

Driving Game Controllers

Coleco, Logitec, Nintendo, XBox, PXN, Playstation, VisionRacer

Experiments, Tools and Projects

SeeingVR: Low Vision Tools For VR

https://www.youtube.com/watch?v=tr4Ejq5fHMc

https://next.reality.news/news/magic-lines-works-restore-mobility-parkinsons-and-dementia-patients-through-ar-magic-leap-hololens-0204088/, https://medicalxpress.com/news/2019-04-virtual-reality-benefits-parkinson-disease.html, https://www.neurostorm.studio/goodvibrations

WalkinVR: Steam Driver For VR

https://www.youtube.com/watch?v=D4y_Bb3UZ1I

WalkinVR: Steam Driver For VR

https://www.youtube.com/watch?v=KCLSyhUmQ0M

https://gettecla.com/blogs/news/does-pokemon-go-pass-our-accessibility-tests

From Sip-and-Puff To Binary

https://en.wikipedia.org/wiki/Sip-and-puff

Is the fallback input for mobile VR inclusive enough for everyone?

Navigating VR for Physically Disabled Users

with Binary Input Controls

https://blog.prototypr.io/accessible-locomotion-and-interaction-in-webxr-e4d87c512e51

https://realityvirtuallyhack.com

433 Hackers

110 Team submissions

Best Application For Accessibility

Wayfair Way-more

Best Use of an HTC Vive Focus

3x winner at the world’s largest, most diverse XR Hackathon.

January 17-21st, 2019
@ the MIT Media Lab, Boston

Binary Input

Take Action

  • single button control
  • binary input frequencies: on/off - short/long/continuous
  • mapped with the W3C standard Gamepad API to enable assistive technology (AT) devices

Discussion

Discussion

https://www.youtube.com/watch?v=jMcLQoMR78w, Measure of Man and Woman: Human Factors in Design by Henry Dreyfuss, https://www.newsweek.com/double-amputee-gets-first-ever-mind-controlled-arms-293189

  • How can we progressively enhance the XR experience?
  • What do HMI & Ergonomics teach us better than flat GUIs?
  • Can Assistive Technologies guide us to interaction standards?

Engage and Interact

@rolanddubois

Thank You!

Roland Dubois

rolanddubois.com

@rolanddubois

#aframe_nyc

Hello, I am Roland Dubois

@rolanddubois

  • Product UX Lead at Virtual Facility
  • XR Accessibility Lead and co-founder at Virtuleap
  • Mozilla Tech Speaker
  • Creator of GRAVR — a globally recognized avatar for WebVR
  • Member of the W3C Immersive Web CG
  • Member of the XR Access Initiative
  • Host of WebXR (A-Frame NYC) workshops & events
  • Creating immersive experiments that make the current VR/AR industry accessible for everyone.
RolandDubois-MotricityInWebXR_W3Cslides_11:05:19 - Google Slides