1 of 84

Integrating EOSC Core Services

into European Research Practice:

An Introduction for Research Service Providers

The EOSC Future project is co-funded by the� European Union Horizon Programme call �INFRAEOSC-03-2020, Grant Agreement 101017536

eoscfuture.eu @EOSCFuture EOSCfuture

2 of 84

Aim of the video

This video is aimed at Research Providers : research services who are integrating their offerings with EOSC Core Services

“Being part of EOSC environment”

https://eosc-portal.eu/about/eosc

eoscfuture.eu @EOSCFuture EOSCfuture

3 of 84

Aim of the video

EOSC Science Clusters

This video is aimed at Research Providers : research services who are integrating their offerings with EOSC Core Services

“Being part of EOSC environment”

eoscfuture.eu @EOSCFuture EOSCfuture

4 of 84

EOSC Core Services

eoscfuture.eu @EOSCFuture EOSCfuture

5 of 84

EOSC Core Services

eoscfuture.eu @EOSCFuture EOSCfuture

6 of 84

EOSC Future Science Projects: enabling data-driven interdisciplinary research

https://eoscfuture.eu/data-in-action/

eoscfuture.eu @EOSCFuture EOSCfuture

7 of 84

EOSC AAI Architecture

With many thanks to the EOSC AAI Team

Community AAI

Infrastructure

Proxy

Service

eoscfuture.eu @EOSCFuture EOSCfuture

8 of 84

Community AAI

Examples of Community AAI include:

eoscfuture.eu @EOSCFuture EOSCfuture

9 of 84

EOSC Infrastructure Proxy

Community AAI

EOSC

Infrastructure

Proxy

EOSC

Service

EOSC Service

eoscfuture.eu @EOSCFuture EOSCfuture

10 of 84

Infrastructure Proxies enabling cross-domain research

Community AAI

Infrastructure

Proxy

Escape Service

Panosc Service

Community AAI

Infrastructure

Proxy

Escape Service

Panosc Service

eoscfuture.eu @EOSCFuture EOSCfuture

11 of 84

EOSC AAI Federation

Community AAI

Infrastructure

Proxy

Community AAI

Infrastructure

Proxy

Infrastructure

Proxy

eoscfuture.eu @EOSCFuture EOSCfuture

12 of 84

EOSC Core Infrastructural Proxy

https://wiki.eoscfuture.eu/display/PUBLIC/EOSC+Core+Infrastructure+Proxy+-+Policy+for+connecting+services

eoscfuture.eu @EOSCFuture EOSCfuture

13 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

14 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

15 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

16 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

17 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

18 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

19 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

20 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

21 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

22 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

23 of 84

Integrating SSHOC Open Marketplace within the

EOSC AAI Federation

Community AAI

Infrastructure

Proxy

EOSC Service

eoscfuture.eu @EOSCFuture EOSCfuture

24 of 84

DARIAH Infrastructure Proxy

https://wiki.de.dariah.eu/display/publicde/DARIAH+AAI+Documentation#DARIAHAAIDocumentation-RegisteringyourServicewiththeDARIAHAAIIdPProxy

eoscfuture.eu @EOSCFuture EOSCfuture

25 of 84

Integration of additional EOSC Core Services

eoscfuture.eu @EOSCFuture EOSCfuture

26 of 84

Key References for EOSC AAI Integration

European Commission, Directorate-General for Research and Innovation, Vaghetti, D., Kanellopoulos, C., Johansson, L., et al., EOSC Authentication and Authorization Infrastructure (AAI) : report from the EOSC Executive Board Working Group (WG) Architecture AAI Task Force (TF), Publications Office, 2021, https://data.europa.eu/doi/10.2777/8702

Authentication and Authorisation for Research and Collaboration (AARC) Blueprint Architecture (BPA) 2019 https://doi.org/10.5281/zenodo.3672784

European Commission, Directorate-General for Research and Innovation, EOSC rules of participation, Publications Office, 2021, https://data.europa.eu/doi/10.2777/30541

eoscfuture.eu @EOSCFuture EOSCfuture

27 of 84

EOSC Core Services Integration

Contact: info@dariah.eu

Helpdesk: https://www.dariah.eu/helpdesk/

The EOSC Future project is co-funded by the� European Union Horizon Programme call �INFRAEOSC-03-2020, Grant Agreement 101017536

eoscfuture.eu @EOSCFuture EOSCfuture

28 of 84

Integration of additional EOSC Core Services

eoscfuture.eu @EOSCFuture EOSCfuture

29 of 84

EOSC Monitoring Service: ARGO

http://argoeu.github.io/overview/

eoscfuture.eu @EOSCFuture EOSCfuture

30 of 84

Research use cases

A researcher from one of the science clusters can login to multiple services within their own scientific domain

A researcher from one science cluster can login to services from another science cluster enabling interdisciplinary research

eoscfuture.eu @EOSCFuture EOSCfuture

31 of 84

Integration with the CESSDA Data Catalogue

https://argo.eosc-portal.eu/eosc/dashboard/Default/CESSDA%20Data%20Catalogue

eoscfuture.eu @EOSCFuture EOSCfuture

32 of 84

Integrating SSHOC Open Marketplace with EOSC AAI

Community AAI

Infrastructure

Proxy

EOSC Service

eoscfuture.eu @EOSCFuture EOSCfuture

33 of 84

References….

eoscfuture.eu @EOSCFuture EOSCfuture

34 of 84

https://marketplace.sshopencloud.eu

eoscfuture.eu @EOSCFuture EOSCfuture

35 of 84

Community AAI

Examples of Community AAI include:

[Delete] Communities can using existing generic Community AAI services:

eoscfuture.eu @EOSCFuture EOSCfuture

36 of 84

EOSC Infrastructure Proxy

eoscfuture.eu @EOSCFuture EOSCfuture

37 of 84

Infrastructure Proxies enabling cross-domain research

Community AAI

EOSC

Infrastructure

Proxy

EOSC Core Service

Panosc Service

Community AAI

Infrastructure

Proxy

EOSC Core Service

Escape Service

EOSC Core Service

Panosc Service

eoscfuture.eu @EOSCFuture EOSCfuture

38 of 84

Domain-specific Infrastructure Proxy

Community AAI

Infrastructure

Proxy

EscapeService

Escape Service

eoscfuture.eu @EOSCFuture EOSCfuture

39 of 84

Infrastructure Proxies enabling cross-domain research

Community AAI

Infrastructure

Proxy

Escape Service

Panosc Service

Community AAI

Infrastructure

Proxy

Escape Service

Panosc Service

eoscfuture.eu @EOSCFuture EOSCfuture

40 of 84

The EOSC Future project is co-funded by the� European Union Horizon Programme call �INFRAEOSC-03-2020, Grant Agreement 101017536

Thank you for

your attention

eoscfuture.eu @EOSCFuture EOSCfuture

41 of 84

https://www.dariah.eu/helpdesk/

info@dariah.eu

The EOSC Future project is co-funded by the� European Union Horizon Programme call �INFRAEOSC-03-2020, Grant Agreement 101017536

Get in touch

eoscfuture.eu @EOSCFuture EOSCfuture

42 of 84

https://www.dariah.eu/helpdesk/

info@dariah.eu

The EOSC Future project is co-funded by the� European Union Horizon Programme call �INFRAEOSC-03-2020, Grant Agreement 101017536

Get in touch

eoscfuture.eu @EOSCFuture EOSCfuture

43 of 84

D6.2 - Video

Integration of EOSC-Core Services into European Research Practice

……[check official name of the deliverable]

The EOSC Future project is co-funded by the� European Union Horizon Programme call �INFRAEOSC-03-2020, Grant Agreement 101017536

eoscfuture.eu @EOSCFuture EOSCfuture

44 of 84

EOSC Infrastructure Proxy

Community AAI

Infrastructure

Proxy

EOSC Service

Community AAI

Infrastructure

Proxy

Infrastructure

Proxy

eoscfuture.eu @EOSCFuture EOSCfuture

45 of 84

EOSC AAI Federation

Community AAI

Infrastructure

Proxy

Community AAI

Infrastructure

Proxy

Infrastructure

Proxy

eoscfuture.eu @EOSCFuture EOSCfuture

46 of 84

Trust between Users and Service Providers

Science Clusters

Research Infrastructures

EOSC

Researchers

eoscfuture.eu @EOSCFuture EOSCfuture

47 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

48 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

49 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

50 of 84

Demonstrating the value to the research community through EOSC Future Science Projects

Climate change and the environment

Health

Understanding the universe

Access to Data

https://eoscfuture.eu/data-in-action/

eoscfuture.eu @EOSCFuture EOSCfuture

51 of 84

EOSC Exchange

Execution Framework

Horizontal services from e-Infrastructure organisations

Horizontal services from EOSC provisioning projects

Expanded horizontal services from Cluster communities

Horizontal services from wider community

EOSC Core

Core platform

Helpdesk

Monitoring & accounting

AAI

SMS

Configuration Management

Marketplace/Order Management

Validation/usage stats of sources

Portal

Core coordination

EOSC Interoperability Framework

Rules of Participation

Security Coordination

Service PIDs

Resources/Res. Prods Catalogue

Open Science Monitor

Service Catalogue

PID Policy

Onboarding

Knowledge base

Procurement

EOSC Support Activities

Training and education

Engagement and promotion

Business collaboration & the Digital Innovation Hub

Open Science Policy Framework

AAI framework

PID

Open Metrics Framework

Data access Framework

Service Management Framework

Metadata Framework

Security Framework

Operational Support Framework

Procurement Framework

………… Framework

Resource Description Framework

Community A

Thematic service

Thematic research products

Local resources

Local execution

Thematic portal

Cluster B

Thematic service

Thematic research products

Local resources

Local execution

Thematic portal

Regional D

Regional service

Regional research products

Local resources

Local execution

Regional portal

Community C

Thematic service

Thematic research products

Local resources

Local execution

Thematic portal

EOSC Future output: Detailed EOSC structure

https://eoscfuture.eu/data-in-action/

eoscfuture.eu @EOSCFuture EOSCfuture

52 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

53 of 84

Slide from P.Manghi - EGI conf

eoscfuture.eu @EOSCFuture EOSCfuture

54 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

55 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

56 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

57 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

58 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

59 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

60 of 84

RoP screenshot

eoscfuture.eu @EOSCFuture EOSCfuture

On behalf of the SSHOC Science Cluster, DARIAH-ERIC, as a legal entity, signed an agreement in order to register the Marketplace as a service within the EOSC AAI Federation.

To become a member of the EOSC AAI federation the service provider has to adhere to the Rules of Participation as well as the technical requirements, the Interoperability Framework and the security policy. A detailed description of what this entails can be found in the references included at the end of the video.

Furthermore, it is necessary to provide contact information for administrative, technical, and security matters as well as a name and identifier for the responsible organisation.

Therefore, it was important in the case of SSHOC, a project in which several partners were collaborating, to decide on the responsible partner who will

act as a service provider in the EOSC AAI federation. In SSHOC, DARIAH-ERIC has taken on this role.

61 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

62 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

63 of 84

https://wiki.eoscfuture.eu/pages/viewpage.action?pageId=16876491 - with blurry parts - GDPR

eoscfuture.eu @EOSCFuture EOSCfuture

64 of 84

Code screen cast - SSHOC gitlab??

eoscfuture.eu @EOSCFuture EOSCfuture

65 of 84

Code screen cast - SSHOC gitlab??

eoscfuture.eu @EOSCFuture EOSCfuture

66 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

As well as establishing trust between the parties on a contractual and technical level, adjustments to the user management of the service application were necessary. The application still needs a representation of the user, however the authentication is not handled locally anymore, but delegated to the identity providers via the EOSC AAI federation. Therefore, most importantly, the user login page needs to be adjusted to accommodate a link/button for EOSC AAI-login.

From the login page the user is first redirected to the WAYF or “where are you from” interface, where they can pick their home organization.

After which, the user is redirected to the login page of the home organization.

Following successful authentication the user is redirected back to the originating application (i.e. the Marketplace in this case) together with an implicit grant token as an URL fragment.

This sends the user first to the so-called WAYF or “where are you from” service, where she can pick her identity provider and is redirected to the login page of that provider.

After successful authentication user is redirected back to the originating service, i.e. the Marketplace, however with the request enriched with authentication information about the user, at the very least a stable identifier.

This can be used by the service, Marketplace to recognize and identify the user.

67 of 84

Priorities - what is urgent/important?

D6.2 - demonstrator - end of February
Starting real integration (monitoring)

Risk of underspending - 202 PMs on the task
Even if not Core services?
Only with Science Projects?

Preparing January meetings

One with science clusters only - we need concrete use cases from them
One with all task members - work plan discussion, starting reporting/following-up on the different lines of work

eoscfuture.eu @EOSCFuture EOSCfuture

68 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

69 of 84

AAI: Identity and Service Providers

eoscfuture.eu @EOSCFuture EOSCfuture

70 of 84

D6.2 Demonstrator

https://marketplace.sshopencloud.eu/contribute/create-an-individual-item

https://marketplace.sshopencloud.eu/auth/sign-in

eoscfuture.eu @EOSCFuture EOSCfuture

71 of 84

Example: Monitoring

Monitoring (2nd video) = Service PlayList….

eoscfuture.eu @EOSCFuture EOSCfuture

72 of 84

EOSC Core platform

EOSC Federated AAI, Monitoring, Accounting, Helpdesk, Metrics, registry,

provider portal, marketplace, PIDs for services, ‘knowledgebase’ registry

Cluster A

Cluster B

e-Infra services (Network, compute, store, scholarly communication)

Generic utility & value add services (Data management, visualisation)

Cluster eInfra

Cluster generic utility services

Cluster Research service

A

B

A

B

Cluster Research service

C

Research service

A

Research service

B

Research service

A

C

B

C

D

EOSC-EXCHANGE

EOSC Interoperability Framework

EOSC Support activities

C

EOSC Future output: Forms of integration and composability

73 of 84

Benefit of Core Services

EOSC is the Open Science Cloud - from the EOSC website

eoscfuture.eu @EOSCFuture EOSCfuture

74 of 84

To show the diversity of identity providers

eoscfuture.eu @EOSCFuture EOSCfuture

75 of 84

EOSC Context

Diving into the EOSC context from a research service provider point of view

Benefits - single sign on (EOSC AAI)

Identity Providers (Institutions or Research Infrastructures)
Where are you from: users can pick:

DARIAH
Institutional
Google … (just demonstrate one)

eoscfuture.eu @EOSCFuture EOSCfuture

76 of 84

Why to onboard

EOSC integration and added value

Collaborate with the commercials sector in providing or exploiting EOSC resources

Assess the impact of research through Open Science tools

Provider

Resource

EOSC registry

Assess usage of EOSC Core and Exchange services. Demonstrate quality of providers and resources.

Integrated support for use of EOSC. Connection between helpdesks, Helpdesk as a Service for small communities.

Onboarding

Helpdesk

Open Science Monitor

EOSC DIH

Monitoring

Demonstrate usage and impact of EOSC. Justify funding and support. Analyse usage patterns.

Accounting

Collect, collate, distribute and process orders. Support delivery of single and composite resources.

Order Management

Harmonise and simplify access across the EOSC community.

AAI Federation

New Core services, horizontalised services from clusters, coordination functions etc

Other core functions...

Integration

Options

Slide from Owen Appleton - EGI conf.

@EGI_eInfra

www.egi.eu

10/10/2021

76

77 of 84

Task 6.2 in its environment

WP6 - Science WP

T6.1 onboarding EGI
T6.2 integration DARIAH
T6.3 Science Projects Lifewatch

Core services dependencies

WP3 architecture; WP4& wp5 Core services development; WP7 service management and delivery

T6.2 rationale and motivation of having DARIAH leading

Linking EOSC Core services to research practices
Knowledge of EOSC services and their providers
Benefits for DARIAH services

eoscfuture.eu @EOSCFuture EOSCfuture

78 of 84

T6.2 Matchmaking

T6.3 Science Projects

T6.1 thematic services onboarded

Core services

eoscfuture.eu @EOSCFuture EOSCfuture

79 of 84

https://wiki.eoscfuture.eu/display/EOSCF/EOSC+Services

eoscfuture.eu @EOSCFuture EOSCfuture

80 of 84

4 main lines of work for the task & where we are

1	Factsheets = Core services description & integration options	List from T7.4 Core delivery Factsheets collected here - email sent to all core service owners this morning
2	Science = Identification/support in the identification of domain-specific services interested in integrating EOSC Core services	3 dimensions identified: SPs coming from T6.3 (are listing their technical requirements) Research services already onboarded on the EOSC catalogue might need/ should be contacted for further integration As clusters, we might be able to identify horizontal/domain-agnostic services needed by all/several research communities
3	JIRA = Integration monitoring workflow	JIRA ticketing space to support the TASK6.2: https://jira.eoscfuture.eu/projects/WP6TASK2
4	Demonstrator D6.2	Collecting and scripting here SSHOC MP AAI? ??

eoscfuture.eu @EOSCFuture EOSCfuture

81 of 84

Task 6.2 members & PMs

E-infras = 133.50 PMs

Not all core service providers

EGI & EUDAT

RIs = 68.50 PMs

All clusters except ESCAPE

Cyfronet	Core service: EOSC Portal frontend & Marketplace	18.00
ATHENA	Core service: Provider Portal & Resource Registry	15.00
CNRS	Core service: Order Processing	5.00
EGI	liaison with T6.1 / service catalogue onboarding Core service: Accounting Topology and Service Registry Monitoring?	10.50
STFC (EGI LTP)		24.00
STFC (EGI LTP)		24.00
SRCE (LTP to EGI)		6.00
DKRZ (EUDAT LTP)	support for (meta) data source onboarding (for external data providers)	8.00
GRNET	Core service: Monitoring	21.00
OpenAIRE	Core services: Open Science monitor & Data usage statistics	26.00

DARIAH	Task lead SSHOC	8.00
PSNC		8.00
GWDG (LTP to DARIAH)		7.00
OEAW (LTP to DARIAH)		7.00
BBMRI (EOSC-Life)	EOSC-Life	3.50
CRS4 (BBMRI LTP)	EOSC-Life	7.50
CESSDA (SSHOC)	SSHOC	2.00
ADP (CESSDA LTP)	SSHOC	4.00
CLARIN (SSHOC)	SSHOC	6.00
ESRF (PaNOSC)	PaNOSC	5.00
CNR IREA (EPOS ERIC LTP) / (ENVRI-FAIR)	ENVRI-Fair	1.00
KNMI (EPOS ERIC LTP) / (ENVRI-FAIR)	ENVRI-Fair	1.00
ICOS (ENVRI-FAIR)	ENVRI-Fair	2.50
Lifewatch (ENVRI-FAIR)	ENVRI-Fair	4.00
MARIS (with ENVRI-FAIR)	ENVRI-Fair	2.00

eoscfuture.eu @EOSCFuture EOSCfuture

82 of 84

eoscfuture.eu @EOSCFuture EOSCfuture

83 of 84

Communication & organisation

Teams (WP6 folder, rolling minutes work plan for t6.2…)
Confluence (private & public spaces)
Mailing lists wp6 and 6.2
GDrive for DARIAH internal use

3 circles

DARIAH & LTPs - internal discussion & decisions
WP6 task leaders - weekly meetings Thursday, at 15h with EGI and Lifewatch
T6.2 - monthly meetings starting January?

-> who of you 2 and when?

eoscfuture.eu @EOSCFuture EOSCfuture

84 of 84

DARIAH-EU lead with LTPs

DARIAH-EU - 8 PMs

Frank -> Toma -> Sally - task lead
Laure & Arnaud supporting organisation & communication

PSNC - 8 PMs

Piotr

DARIAH/OEAW - 7 PMs

Matej

DARIAH/GWDG - 7 PMs

Tibor
Part-time recruitment between EOSC-Future and DICE

eoscfuture.eu @EOSCFuture EOSCfuture