1 of 8

Using OSG Services and the Open Science Pool

2023

2 of 8

OSG �Formerly known as the Open Science Grid

The OSG is a consortium dedicated to the advancement of open science via the practice of distributed High Throughput Computing, and the advancement of its state of the art.

​

​

​

3 of 8

Open Science Pool (OSPool)

The OSG Consortium builds and operates a set of pools of shared computing and data capacity for distributed high-throughput computing (dHTC).One of these pools, known as the Open Science Pool (OSPool) is operated for all of US-associated open science. 

​

Domestic Contributors to the OSPool

4 of 8

What types of work run well on the OSPool?

Research problems that can be run as numerous, self-contained jobs.

  • image analysis (including MRI, GIS, etc.)
  • text-based analysis, including DNA read mapping and other bioinformatics
  • parameter sweeps
  • model optimization approaches, including Monte Carlo methods
  • machine learning and AI executed with multiple independent training tasks, different parameters, and/or data subsets
  • And more!

5 of 8

What types of work run well on the OSPool?

 

Ideal Jobs!

Still Very Advantageous!

Less-so, but maybe

Expected Throughput (per User)

1000s concurrent cores

100s concurrent cores

Contact a Facilitator to discuss further

Cores

(GPUs)

1

(1; non-specific type)

<8

(1; specific GPU type)

>8 (or MPI)

(multiple)

Walltime

<10 hrs*

*or checkpointable

<20 hrs*

*or  checkpointable

>20 hrs

RAM

<few GB

<10s GB

>10s GB

Input

<500 MB

<10 GB

>10 GB

Output

<1 GB

<10 GB

>10 GB

Software

‘portable’ (pre-compiled binaries, transferable, containerizable, etc.)

most other than  →

Licensed software; non-Linux

* the “less-so, but maybe” column could still be an HTC workload, but one that would run more effectively on a local, dedicated HTC system instead of the OSPool

��

6 of 8

Who can use OSG Resources?

Any researcher affiliated with an Open Science project at a US-based academic, government, or non-profit institution.

  • All resources are free-of-charge
  • No allocation needed

​

7 of 8

OSG Policies

OSG policies prohibit:

  • Use of restricted data (e.g., requiring HIPPA compliance)
  • Work benefitting for-profit organizations or entities
  • Improper system use (e.g., mining)

​

​

A full list OSG Policies is provided at https://portal.osg-htc.org/documentation/overview/references/policy/

​

​

If you are concerned that your work may violate our policies, contact the Research Facilitation Team (support@osg-htc.org) prior to starting your work.

8 of 8

Learning to Use OSG Resources

  • Monthly new user and special topic trainings
  • OSPool User documentation website
  • 2023 OSG User School – applications now open!
  • Research Computing Facilitation Team
    • Drop-in Virtual Office Hours every Tuesday (3-4:30pm CT) and Thursday (10:30-12pm CT)
    • Email: support@osg-htc.org

Showmic Islam

​

​

Rachel Lombardi

​

​

​

Mats Rynge

​

​

​

Christina Koch

Andrew Owen

​

​

​

Research Computing Facilitators