Community Lightening Slides - Kyle
Integrating Federal Data with the NMWDI
Internet of Water is:
An aspirational concept of linked water data systems
A decentralized, collaborative multi-organization initiative to organize water data on the internet
A project (currently at Duke University) providing key social and technological infrastructure supporting the above
How will Federal Data be Integrated with NM Data?
How will Federal data be interacted with through NMWDI services?
How will other Federal data about a given feature in NM be discovered or de-duplicated from NM data about the same and related feature?
How will Federal Data be Integrated with NM Data?
How will Federal data be interacted with through NMWDI services?
How will other Federal data about a given feature in NM be discovered or de-duplicated from NM data about the same and related feature?
1: Application Layer (see NMWDI Architecture)
2. Via API proxying (see NMED)
- USGS NWIS
- USBR RISE
- USEPA SDWIS/ ATTAINS/ WQX
- USACE A2W
- NOAA NCDC CDO
How will Federal Data be Integrated with NM Data?
How will Federal data be interacted with through NMWDI services?
How will other Federal data about a given feature in NM be discovered or de-duplicated from NM data about the same and related feature?
1: Application Layer (see NMWDI Architecture)
2. Via API proxying (see NMED)
- USGS NWIS
- USBR RISE
- USEPA SDWIS/ ATTAINS/ WQX
- USACE A2W
- NOAA NCDC CDO
Currently…
I wonder how much water is in my favorite lake to visit?
Favorite Lake water levels
Future Vision
I wonder how much water is in my favorite lake to visit?
Oh, I didn’t know these other data existed… Is it safe to swim or fish…
Favorite Lake water levels
CURRENT STATUS
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
Geoconnex Does 3 Things
Well #1
Well #1
Same ???
The water version of a DOI
https://geoconnex.us/epa/hmw/020700110204
Geoconnex
version
of DOI
Organization’s
Unique ID for
Data
+
Registered
organization
name
+
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
Geoconnex Does 3 Things
Well #1
Well #1
Same ???
The water version of a DOI
https://geoconnex.us/epa/hmw/020700110204
Geoconnex
version
of DOI
Organization’s
Unique ID for
Data
+
Registered
organization
name
+
https://geoconnex.us/
Persistent Identifier Registry
Anyone can mint PIDs!
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
(2) Locates Data – provides a stable landing page and redirects users to where data are currently hosted
Geoconnex Does 3 Things
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
Geoconnex Does 3 Things
(2) Locates Data – provides a stable landing page and redirects users to where data are currently hosted
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
(2) Locates Data – provides a stable landing page and redirects users to where data are currently hosted
Geoconnex Does 3 Things
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
(2) Locates Data – provides a stable landing page and redirects users to where data are currently hosted
(3) Links Data – enables data to be linked together based on geography and key words
Geoconnex Does 3 Things
This monitoring station is located inside this watershed
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
(2) Locates Data – provides a stable landing page and redirects users to where data are currently hosted
(3) Links Data – enables data to be linked together based on geography and key words
Geoconnex Does 3 Things
This monitoring station is located inside this watershed
And so are all of
these sites…
sdfsfsdfs
(1) Unique IDs – a persistent identifier unique to each dataset
(2) Locates Data – provides a stable landing page and redirects users to where data are currently hosted
(3) Links Data – enables data to be linked together based on geography and key words
Geoconnex Does 3 Things
Are data located WITHIN a watershed (aquifer, city, county, service area…)?
Does a watershed CONTAIN a stream gauge, well, water intake, etc.
sdfsfsdfs
Locations (e.g. stream gages, wells,
dam locations)
Features of Interest (e.g. public water
systems, lakes)
Cataloging Features (e.g. HUC boundaries, administrative boundaries)
Finding Linked Data
selfie:within/contains
The metadata contains information about how data intersects a container
(“cataloging features”)
Finding Linked Data
sdfsfsdfs
Locations (e.g. stream gages, wells, dam locations)
Features of Interest (e.g. public water systems, lakes)
Cataloging Features (e.g. HUC boundaries, admin boundaries)
Finding Linked Data
sdfsfsdfs
Locations (e.g. stream gages, wells, dam locations)
Features of Interest (e.g. public water systems, lakes)
Cataloging Features (e.g. HUC boundaries, admin boundaries)
Embedded Link to a Watershed
Persistent Id
HUC 12
FUTURE PLANS
“Knowledge Graph”
A search index for water data
Integration with NHD
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
Building a Water Knowledge Graph: Community Reference Features
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
Building a Water Knowledge Graph: Organizations publish data
https://geoconnex.us/{org}/{feature}/{data_id}
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
https://geoconnex.us/{org}/{feature}/{data_id}
Building a Water Knowledge Graph: Organizations Link Data
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
https://geoconnex.us/{org}/{feature}/{data_id}
Building a Water Knowledge Graph: Crawl
Web crawler
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
https://geoconnex.us/{org}/{feature}/{data_id}
Building a Water Knowledge Graph: Crawl
Web crawler
Goes to any site with a geoconnex PID
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
https://geoconnex.us/{org}/{feature}/{data_id}
Building a Water Knowledge Graph: Crawl
Web crawler
Harvests links
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
https://geoconnex.us/{org}/{feature}/{data_id}
Building a Water Knowledge Graph: Crawl
Web crawler
Harvests links
Bridge monitoring location
Reservoir
HUC12
Link: within
Link: within
https://geoconnex.us/ref/{feature_type}/{feature_id}
https://geoconnex.us/{org}/{feature}/{data_id}
Building a Water Knowledge Graph: Crawl
Web crawler
Harvests links
Search and Browse the Graph!
Find all relevant (participating) water data
Database
User Interface
Search by:
Search
Integrating with NHD
USGS is developing the Hydro-Network-Linked Data Index
https://waterdata.usgs.gov/blog/nldi-intro
An open-source, publicly accessible system to index any geospatially-referenced data to NHDPlus catchments and reach codes
Enable hydrologically-relevant search (e.g. upstream/downstream)
Integrating with NHD
https://labs.waterdata.usgs.gov/api/nldi/linked-data/nwissite/USGS-364700114080301
Integrating with NHD
https://labs.waterdata.usgs.gov/api/nldi/linked-data/nwissite/USGS-364700114080301/UM?distance=100
Integrating with NHD
https://labs.waterdata.usgs.gov/api/nldi/linked-data/nwissite/USGS-364700114080301/UT?distance=100
Integrating with NHD
https://labs.waterdata.usgs.gov/api/nldi/linked-data/nwissite/USGS-364700114080301/UT/nwissite?distance=100
Integrating with NHD
https://labs.waterdata.usgs.gov/api/nldi/linked-data/nwissite/USGS-364700114080301/UT/wqp?distance=100
Integrating with NHD
https://labs.waterdata.usgs.gov/api/nldi/linked-data/nwissite/USGS-364700114080301/UT/wade?distance=100
Integrating with NHD
Integrating with NHD
To contribute data:
Need:
Integrating with NHD
To contribute data:
Require:
NMWDI representations can be used for this
In summary:
This use case can be accomplished only if everyone is willing and able to document and add links in their data to data that is not theirs
Are we all willing to care
a little
about how our data relates to others’?
Learn More
Internet of Water : https://internetofwater.org
Project Geoconnex: https://geoconnex.us
Geoconnex reference features: https://info.geoconnex.us
Contact: kyle.onda@duke.edu