1 of 10

GIL Status update

OSG/PATh Staff Meeting - Feb 23rd, 2022

​

Igor Sfiligoi for the GIL group

2 of 10

Staffing

Main team:

  • Frank Wurthwein – PI/Lead
  • Igor Sfiligoi – Group lead
  • Fabio Andrijauskas

​

Support team:

  • Diego Davila
  • Jonathan Guiang
  • Aashay Arora

3 of 10

GIL Mission

Evaluate technologies and provide guidance

​

  • Typically deliver written reports
  • May help test and debug existing software/services
  • May develop prototypes for new services
    • Our focus is not on providing new production software/services

​

4 of 10

Plan of work

  • Y2Q1:
    • Data Federation robustness versus scale
  • Y2Q2:
    • Monitor resource utilization
    • Benchmark new data infrastructure�of OSG connect
  • Y2Q3:
    • Dynamic pilot scheduling for Lancium
  • Y2Q4:
    • Evaluate HEPCloud’s Decision Engine

​

  • Y3Q1:
    • Evaluate CRIU checkpointing
  • Y3Q2:
    • Assess OSG integration with XSEDE follow-up project
  • Y3Q3:
    • Asses HTCondor Annex scalability
  • Y3Q4:
    • Asses HTCondor VPN capabilities

5 of 10

Where we are now?

  • Y2Q1:
    • Data Federation robustness versus scale
    • HTCondor files vs tgz

​

Completed.�Fabio will provide�more details.

6 of 10

Where we are now?

  • Y2Q1:
    • Data Federation robustness versus scale
    • HTCondor files vs tgz
  • Y2Q2:
    • Monitor resource utilization
    • Benchmark new data infrastructure�of OSG connect

​

In progress.�Fabio will provide�more details.

Waiting for HW delivery at OSG Connect.

7 of 10

Reports available on the GIL web page

https://path-cc.io/GIL/

8 of 10

Upcoming tasks

  • Y2Q3:
    • Dynamic pilot scheduling for Lancium

NEW

Background:�Lancium is currently using backfill containers to contribute resources to the OS Pool.�But often those containers start and stay there idle because there are no jobs in the OS Pool that would match.�(Note that, currently, gWMS cannot be used as a solution)

Aim:�Evaluate alternatives for “smarter” dynamic provisioning at Lancium.

9 of 10

Upcoming tasks

  • Y2Q4:
    • Evaluate HEPCloud’s Decision Engine

​

Designated replacement for the gWMS Frontend

HEPCloud Decision Engine v2�should be suitable for OSG�needs

Release expected by �end of Feb 2022.

10 of 10

That’s all for me

  • Fabio will provide more details on the recent activities�
  • Will be glad to answer questions after he is done.