1 of 14

OSCARS Improvements

for IRI and Beyond

Evangelos Chaniotakis

Orchestration and Core Data

2 of 14

What is OSCARS

  • On-demand Secure Circuit Advance Reservation System
  • The name of ESnet’s L2VPN service offering
    • Also the codename of the software that manages the service
  • Layer 2 Virtual Private Network
    • A private connection…
    • … between two (or more) distant sub-networks,
    • And, the sub-networks behave as if they are directly connected

2

3 of 14

The OSCARS Service from 60,000 Feet

3

ESnet edge router

Customer

campus

VLAN 183

VLAN 183

OSCARS Layer 2 VPN

over ESnet

VLAN 209

4 of 14

..and from 55,000 Feet

ESnet

Customer campus

VLAN 183

VLAN 183

VLAN 209

MPLS LSPs

VPLS instance

Quality of Service marking

Physical Port

OSCARS-managed

router config at ESnet edge routers

5 of 14

Integrated Research Data Flows

5

Instrument

Compute

Storage

Research Institution

Automation such as Rucio coordinates and co-schedules compute, storage, and the network interconnects

Processed data arrives at scientific for research

Scientific experiment produces raw data

6 of 14

OSCARS Software Ecosystem

​

6

​

ESnet internals

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

OSCARS

​

​

​

​

​

​

​

​

​

​

​

​

​

​

Browser Interface

PCE, topology, reservations

Orchestrator

REST API

SOAP API

Network

devices

NSO

ESDB

ESnet customers, scientists

ESnet Engineers

Rucio

SENSE

NSI Orchestrator

Compute, storage, etc

7 of 14

Moving bulk data w/ OSCARS & Rucio

7

8 of 14

OSCARS supporting ARIES

8

Bandwidth not critical - but needs low jitter

Maximum = 24.2 ms

Minimum = 23.6 ms

Average = 23.90 ms

Variance = 0.02 ms

Maximum = 369 ms

Minimum = 20 ms

Average = 27.15 ms

Variance = 11.5 ms

SuperLab 1.0 (2017)

SuperLab 2.0 (today)

9 of 14

The AutoGOLE Infrastructure

​

​

9

10 of 14

Some Challenging Numbers

  • Currently active L2VPNs: 127
  • Years in production: 18
  • L2VPNs instances provisioned, all time: 20,000+
    • On average, one every few hours
  • Time to provision an L2VPN: ~60 sec
  • Stress test from SENSE: 50 batched requests
    • How can we support this rate of change to the network?

10

11 of 14

OSCARS Software Improvements

  • Pathfinding performance
    • From ~30 sec for pathfinding stage, down to ~1.5 sec
  • Utilizing NSO for network configuration
    • Config templating, input validation & a lot of logic
  • In-service modifications and redeployment
  • Integration with SSO, ESDB, and the rest of ESnet6 stack
  • Build / deploy with Gitlab, Docker and Ansible
  • Operational state view & diagnostic tools
  • New software engineer hired

11

12 of 14

12

13 of 14

13

14 of 14

Future Work

  • Focus on reliability and performance
  • Investigate alternate L2VPN technologies (i.e. EVPN)
  • Enrich APIs for SENSE support
  • Integrate with ESnet Orchestrator
  • Utilize new ESnet Network Discovery Service
  • Enhance OSCARS service model

​

Comments, ideas: haniotak@es.net

14