1 of 14

INTERACTIVE ACCESS AND EXPLORATION OF SCIENTIFIC DATA PRODUCTS

Steve Petruzza�Glenn Tarcea�Giorgio Scorzelli�Valerio Pascucci

2 of 14

CHALLENGES WITH ACCESS TO SCIENTIFIC DATA PRODUCTS

Data portals are Implementing FAIR principles
Metadata help both search and understanding of what is stored in the data product
Data portals often do not take full advantage of modern web technologies and state of the art data formats

3 of 14

NEON DATA PORTAL

Sensor measurements, plots over time
Aerial Observation Platforms

List of images (part of a large orthomosaic)�

4 of 14

MATERIALS COMMONS WEB PORTAL

5 of 14

WEB BASED TOOLS ALLOW

Portability and easy data share
Could be used also for analysis and visualization leveraging

Hierarchical and streamable/Cloud Optimized data formats
New computing technologies like WebGPU

6 of 14

DATA ACCESS AT DIFFERENT LEVEL OF DETAILS

Using hierarchical data formats for structured and unstructured data
E.g., Particle data

Adaptive spatially aware i/o for multiresolution particle data layouts. 2021 IEEE IPDPS

Usher, W., Huang, X., Petruzza, S., Kumar, S., Slattery, S. R., Reeve, S. T., ... & Pascucci, V. �

7 of 14

VOLUMETRIC DATA STREAMING AND VISUALIZATION

8 of 14

LARGE SCALE GRAPHS VISUALIZATION AND ANALYSIS

Use the power of GPUs from your browser (WebGPU)
Not only rendering, but (Primarily) computation

Rendering

Graph layout

GraphWaGu: GPU Powered Large Scale Graph Layout Computation and Rendering for the Web.

Dyken, L., Poudel, P., Usher, W., Petruzza, S., Chen, J. Y., & Kumar, S. EGPGV 2022. �

9 of 14

DATA LABELING/SEGMENTATION

10 of 14

INTEGRATING DATA STREAMING AND VISUALIZATION AND ANALYSIS SERVICE INTO EXISTING DATA PORTALS/COMMONS

data conversion
where/how to store derived data product?

Limit access
Obfuscation

data streaming service
web UI

Web Tool UI

Data Portal UI

Streaming Server

Data

Streamable data

Container

11 of 14

INTEGRATING WITH MATERIALS COMMONS

Globus data transfer
Data conversion to streamable data format
Data on object storage was mounted on filesystem
Based on the datatype of the file MC builds the HTML to view the data

Includes the webviewer IFrame which based on the parametrization renders the right dataset

Server traditional filesystem, symbolic links

13 of 14

NEXT STEPS

Bypass OpenVisus Server, direct queries to object storage (OpenVisus+ARCO)
Customize interface to suite MC user interactions
Make sure that dataset are accessed only by authorized users
Define some mechanism to set automatically visualization parameters or add those to the metadata information