1 of 20

Censored Planet

@ Open Measurement Gathering

Censored Planet Team�University of Michigan

2 of 20

Censored Planet Analysis Pipeline - v2

Censored Planet API - v1

Censored Planet Dashboard - v2

Censored Planet - Things to come

Agenda

1

2

3

4

CENSORED PLANET LAB

3 of 20

Censored Planet Analysis Pipeline - v2

CENSORED PLANET LAB

4 of 20

Analysis Pipeline - v1

CENSORED PLANET LAB

5 of 20

CENSORED PLANET LAB

6 of 20

Aftermath

  • Hard daily usage limit on the BigQuery API
  • Only 6 months of data available for the Dashboard
  • Google Cloud storage bucket switched to “Requester Pays”

CENSORED PLANET LAB

7 of 20

Analysis Pipeline - v2

CENSORED PLANET LAB

8 of 20

Analysis Pipeline - Hyperquack

Unnesting

Metadata Enrichment

Signature Matching

Domain Categories

Certificate Parsing

Outcome Classification

CENSORED PLANET LAB

9 of 20

Analysis Pipeline - Satellite

Resolver Results

Unnesting

​

Metadata Enrichment

​

Domain Categories

Fetched Pages

Certificate Parsing

Metadata Enrichment

​

​

Union

Signature Matching

CENSORED PLANET LAB

10 of 20

Results

HTTP, DISCARD, ECHO processing in ~1.2 Minutes -> 20× faster (95% time reduction)

HTTPS processing in ~2 Minutes -> 11.5× faster (91% time reduction)

DNS processing in ~10 Minutes -> 9× faster (89% time reduction)�

Analysis Pipeline - v2

CENSORED PLANET LAB

11 of 20

Censored Planet API - v1

CENSORED PLANET LAB

12 of 20

Censored Planet API

CENSORED PLANET LAB

13 of 20

Censored Planet Dashboard - v2

CENSORED PLANET LAB

14 of 20

Censored Planet - Things to come

CENSORED PLANET LAB

15 of 20

Rapid Response Efforts

CENSORED PLANET LAB

16 of 20

censoredplanet@umich.edu

Reach us at:

CENSORED PLANET LAB

17 of 20

⚠️

Censored Planet Alert System

CENSORED PLANET LAB

18 of 20

CENSORED PLANET LAB

19 of 20

CENSORED PLANET LAB

20 of 20

censoredplanet@umich.edu

Reach us at:

CENSORED PLANET LAB