1 of 25

Making Ocean Observations Accessible and Usable: �A Standards and Software Case Study�

FOSS4G 2017, Boston MA

August 17, 2017

Micah Wengren

Richard P. Signell

Luke Campbell

2 of 25

IOOS DMAC Standards

2

This is the theme text

U.S. Integrated Ocean Observing System (IOOS) works with 11 Regional Associations and 17 Federal agencies to build this observing network and distribute information

Federal Partners

3 of 25

What is DMAC?

3

DMAC is the collection of people, process, and technology that enable the dissemination of diverse and distributed data sets using the WWW as the platform.

DMAC = Data Management and Communications

IOOS GitHub OS Projects:

pyoos
compliance-checker
notebooks_demos
ncSOS
sensorml2iso
catalog-harvest-registry
i52N-sos

And more: https://github.com/ioos/

4 of 25

IOOS DMAC Data Distribution

4

5 of 25

DMAC Software

5

THREDDS:

Climate & Forecast Conventions (CF) and ACDD- compatible netCDF files

CF Discrete Sampling Geometry for observations
UGRID (unstructured grid) conventions for forecast model output

THREDDS Services/Extensions used by IOOS DMAC:

ncWMS: extends WMS with custom extensions for scientific data
GeoServer 2.10+ community module: http://bit.ly/2usZrqM implements exts:

GetMap enhancements: dynamic color ramps from data statistics and extra parameters, GetTimeSeries operation, GetCaps filtering

ncISO: output ISO 19115-2 XML metadata from CF attribution
ncSOS: provide IOOS profile compatible SOS service from CF Discrete Sampling Geometry input files - http://bit.ly/2vqvox9

ERDDAP:

GridDAP(gridded data), TableDAP (tabular data) - http://bit.ly/2vT3o8o
RESTful service interface providing translation between many input/output data formats, databases, or data stores

i52N-SOS:

Fork of 52North SOS server meeting IOOS SOS profile requirements

6 of 25

IOOS DMAC Data Discovery

6

7 of 25

netCDF Climate and Forecast (CF) Conventions

7

8 of 25

8

CF Conventions: http://cfconventions.org/cf-conventions/v1.6.0/cf-conventions.html

9 of 25

9

ACDD Documentation: http://wiki.esipfed.org/index.php/Attribute_Convention_for_Data_Discovery

10 of 25

Metadata Conventions and Catalogs

10

11 of 25

CF & ACDD Before and After

11

12 of 25

Cat-Interop Service Type Lookup

12

The Cat-Interop project contains service type identifiers for common data access and GIS web services to promote interoperability in metadata.

https://github.com/OSGeo/Cat-Interop

Used internally by many projects: pycsw, CKAN, ncISO, QGIS Metasearch

13 of 25

Cat-Interop for Service Interoperability

13

14 of 25

14

Demo?

Boston Light Swim

Jupyter Notebook

15 of 25

15

Demo!

So what just happened?

We ran an automated query for obs/forecast data on the IOOS Catalog
Used the derived metadata from netCDF CF and associated conventions to find OPeNDAP services for ‘sea_water_temperature’
Performed analysis
Viewed graphical results in browser
Barely had time to run for coffee

Run this notebook yourself: https://github.com/ioos/notebooks_demos/blob/master/notebooks/2016-12-22-boston_light_swim.ipynb