1 of 32

Measurement Lab

Open Broadband Measurement Tools for Community Driven Data

Lai Yi Ohlsen laiyi@measurementlab.net

​

Slides: https://bit.ly/33j54FT

@

2 of 32

Outline for Today

  • Setting the stage - the need for better broadband data
  • Introduction to M-Lab
  • Government & Other broadband data sources
  • M-Lab Tools for Community-Driven Data Collection
    • Survey, Speed Test, and Mapping - Piecewise
  • Wrap up / Questions

@

3 of 32

Setting the Stage:�the need for better broadband data

​

​

@

4 of 32

​

​

@

FCC's Fixed Broadband Deployment Map

5 of 32

​

​

@

United States of Broadband Map

6 of 32

Introduction to M-Lab

​

​

@

7 of 32

M-Lab’s Mission

�Measure the internet. �Save the data.�Make it universally accessible and useful.

​

Note: we don’t measure the internet by ourselves -- people measure the Internet, using their own computers/phones and our servers, and we collect the data, and support them in their measurements

@

8 of 32

https://www.measurementlab.net/

9 of 32

What is M-Lab?

  • People/Organization: A joint initiative between staff at Code for Science & Society, Google, and many other contributing partners.
  • Data: An open repository of user-contributed, longitudinal, open-source derived Internet infrastructure data
  • Infrastructure: A global infrastructure deployed, built, and run to aid in the creation of that data repository

@

10 of 32

https://www.measurementlab.net/status

11 of 32

Our Organizing Principles

Learn more about M-Lab:

  • Active Measurements
    • All synthetic data, we take user privacy seriously.
    • Client initiated tests only, Servers do not start tests on their own
  • Experiments are curated and approved by a panel of reviewers, primarily developed by academics
    • Longitudinal research and data
  • Clients come from the community
    • Anyone can develop them
    • Anyone can run tests against the platform
  • Openness
    • All of the data is openly licensed (CC0 1.0 Universal (CC0 1.0) Public Domain)
    • All of the code is open source.

10th Anniversary Convening blog post, videos:

https://www.measurementlab.net/blog/mlab-10year-wrapup/

@

12 of 32

Our Community

Experiment

Designers

Site Host Partners

Researchers (Policy & Internet)

Governments & Regulators

Journalists

Companies

Academics

@

13 of 32

M-Lab Broadband Data

​

​

@

14 of 32

How M-Lab Collects Tests

@

https://www.measurementlab.net/faq/

15 of 32

NDT tests come from lots of places

@

Fingbox

Chrome Extension

https://performance.cira.ca

Network Diagnostic Tool

​

Google Search

16 of 32

Custom NDT Integrations Gather Enhanced Geolocation, but Privately

@

https://performance.cira.ca

17 of 32

M-Lab Data Sources

Network Diagnostic Tool - NDT

@

18 of 32

Government & Other Broadband Data Sources

​

​

@

19 of 32

FCC Data Sources

Measuring Broadband America Program

​

Fixed Broadband Annual Study & Report

​

Mobile Broadband App

  • Android & iOS app
  • De-identified data published by FCC

MBA-Assisted Research Studies (MARS)

@

20 of 32

FCC Data Sources

Form 477 Provider Coverage Data

​

​

  • All facilities-based broadband providers are required to file data with the FCC twice a year (Form 477) on where they offer Internet access service at speeds exceeding 200 kbps in at least one direction.
  • Fixed providers file lists of census blocks in which they can or do offer service to at least one location, with additional information about the service.
  • Mobile providers file maps of their coverage areas for each broadband technology (e.g., EV-DO, HSPA, LTE).

​

@

21 of 32

@

Differences in Data Sources

​

M-Lab NDT

NDT Integration with enhanced Geo

Form 477 Fixed

Form 477 Mobile

Geography

Aggregate by any geography. Test geolocation based on IP address

Aggregate by any geography. Test geo based on GPS, HTML5, address

Census Block

Shapefile defining coverage areas

Speed metrics

Measured speeds to closest off-net server

Measured speeds to closest off-net server

Maximum advertised speeds. Likely reported on-net speeds.

Minimum advertised speeds are collected, but not made public. Can be requested

Mobile vs. Fixed

All results in M-Lab BigQuery dataset. Can delineate mobile/non-mobile using 3rd party services.

All results in M-Lab BigQuery, and in 3rd party integrator maintained database

Fixed only

Mobile only

Provider Information

ASN - Autonomous System Number/Name

ASN - Autonomous System Number/Name, and/or via user survey

- Provider Name �- DBA Name - "Doing business as"

- Holding Company Name

- Provider Name �- DBA Name - "Doing business as"

- Holding Company Name

22 of 32

Recommended Use of M-Lab NDT Data �and 3rd Party “Enhanced” NDT Data

​

M-Lab’s tools and data are useful because of their openness, transparency, and accessibility.

​

Our data are most useful in demonstrating the overall network connection speed and service quality. It is not a replacement for FCC data, or an apples-to-apples comparison to Form 477.

​

M-Lab data is a well respected, public dataset of measurements not simply reported or advertised service levels.

​

Gathering “Enhanced” NDT data provides more precise location accuracy, and can help support your dialogue and advocacy with legislators and agency staff.

@

23 of 32

M-Lab Tools for Community-Driven Data Collection

​

​

@

24 of 32

Survey, Speed Test, and Mapping: Piecewise

@

25 of 32

Piecewise

Piecewise is an open-source public engagement portal that collects both user-volunteered survey responses and speed test data using the Measurement Lab platform. Data collected by Piecewise is visually aggregated on the web and mapped on top of M-Lab's public dataset.

​

@

26 of 32

Piecewise

  • Michigan / MERIT - broadband testing & mapping with a homework gap hook
    • R&E network, K12 statewide systems
    • Homework assignment to run a test
  • https://mi.broadbandtest.us/

​

A Survey & Mapping tool

@

27 of 32

Piecewise

  • Status?
    • ~Q2/Q3 2020, Piecewise will become available as a SaaS app
  • What do you use it for?
    • Collecting enhanced geolocation from data in specific area(s)
      • For example: state collecting data about each of its counties, or an advocacy organization collecting information for a report
    • Mapping the collected data on the web
  • Goal:
    • Communities collecting crowd-sourced data to advocate for their broadband needs

A Survey & Mapping tool

@

28 of 32

How Does Piecewise Work?

@

Standard M-Lab Test Data Flow

29 of 32

How Does Piecewise Work?

@

Piecewise Instance Test Data Flow

30 of 32

How Does Piecewise Work?

People share their location, complete your survey, run speed test

@

  • Design & publish survey questions
  • Customize branding
  • Publicize
  • Standard test data sent to M-Lab
  • Test results, survey answers, and enhanced location saved in your Piecewise instance

You have M-Lab Measurements with geographic accuracy, along with survey results for your analyses, planning, etc.

31 of 32

Wrap up / Questions

@

32 of 32

Measurement Lab

Open Broadband Measurement Tools for Community Driven Data

Chris Ritzo critzo@measurementlab.net

​

Slides: http://bit.ly/mlab-moonshot

@