1 of 18

MultiRATE: EU R&D Readiness Level Evaluation Framework

Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or REA. Neither the European Union nor the granting authority can be held responsible for them.

Dimitris Kavallieros, stefanos vrochidis

RESEARCH AND INNOVATION SYMPOSIUM FOR EUROPEAN SECURITY AND DEFENSE 2023 | MAY 29TH – MAY 31ST | RHODES, GREECE

2 of 18

SETTING THE SCENE

  • TRL was conceived as idea in 1974 from nasa while it was formally defined at late 80’s with 7 levels. During the 90’s nasa introduced the 9 level trl. It was focused on space missions

  • US DoD is using the 9 level TRL from early 2000

  • European Space agency (esa) adopted it in 2008

  • In 2013 iso 16290:2013 “Space systems — Definition of the Technology Readiness Levels (TRLs) and their criteria of assessment” defined the trl as part of standard

  • In 2014 trl was employed for the eu horizon Europe

3 of 18

SETTING THE SCENE

TRL

NASA usage

European Union

1

Basic principles observed and reported

Basic principles observed

2

Technology concept and/or application formulated

Technology concept formulated

3

Analytical and experimental critical function and/or characteristic proof-of concept

Experimental proof of concept

4

Component and/or breadboard validation in laboratory environment

Technology validated in lab

5

Component and/or breadboard validation in relevant environment

Technology validated in relevant environment (industrially relevant environment in the case of key enabling technologies)

6

System/subsystem model or prototype demonstration in a relevant environment (ground or space)

Technology demonstrated in relevant environment (industrially relevant environment in the case of key enabling technologies)

7

System prototype demonstration in a space environment

System prototype demonstration in operational environment

8

Actual system completed and "flight qualified" through test and demonstration (ground or space)

System complete and qualified

9

Actual system "flight proven" through successful mission operations

Actual system proven in operational environment (competitive manufacturing in the case of key enabling technologies; or in space)

4 of 18

SETTING THE SCENE

  • Multiple domains – Readiness levels/ assessments

  • Different approaches

  • Different processes

  • Different interpretation

5 of 18

PROJECT INFORMATION

Programme

Horizon Europe

Topic

HORIZON-CL3-2021-SSRI-01

A maturity assessment framework for security technologies

Project No: 101073929

Duration: 01/12/2022 – 31/05/2025 (30 months) – M6 (currently)

Partners: 12 expert organisations (7 Research organisations, 1 Industry, 1 University, 1 SME, 1 Ministry and 1 LEA) from 10 countries

6 of 18

MULTIRATE AIM

  • The ambition of MultiRATE is to develop a holistic, homogenous and harmonised RL evolution methodology and calculator for R & D projects and solutions in the security domain, available to the EU R&D community.

7 of 18

MULTIRATE OBJECTIVES

Conduct research in multiple fields to create solid ground for the development of the holistic, homogenous and harmonised RL evaluation methodology

Develop unique methodology and indicators as each field measures different aspects, assets and has different objectives

Develop a holistic RL evaluation methodology for security related solutions

Establishment of a network of projects, organisations and experts

Evaluating accurately the RL of EU and National R&D solutions to support the investment forecasting of these solutions

8 of 18

MULTIRATE RLS

9 of 18

MULTIRATE RLS

  • Technology RL is defined as a means for measuring or indicating the maturity of a particular technology during its acquisition phase

  • The Security RL mainly focuses on security requirements combined with adopted standards ensuring that appropriate plans are in place as regards to the assets, critical services, access control systems, business continuity and security awareness

10 of 18

MULTIRATE RLS

  • The Legal, Privacy and Ethics RL tackles the maturity level of sensitive data, privacy and data protection. Respective best and worst practices will be analyzed under this RL, aiming also in the strategies that need to be developed in order to comply with data protection requirements

  • Societal RL refers to the readiness of the society to accept a particular innovation

11 of 18

MULTIRATE RLS

  • The Manufacturing RL is used to assess the maturity of a given technology, system, subsystem, or component from a manufacturing perspective

  • The Commercialisation RL framework is addressed to demonstrate both novelty and scalability in terms of near commercial products, processes and services

  • The Integration RL is defined as a systematic measurement of the integration maturity between various technologies

12 of 18

MULTIRATE PHASES

13 of 18

MULTIRATE METHODOLOGY

The methodology of MultiRATE is based on continuous development, testing and updating cycles

The starting point will be the Network establishment of the project which will be based on the project’s partners networks, EC agencies, initiatives (e.g. EACTDA), individual organisations from the industry, academia, private, public and research organisations – in short, the EU R&D community

14 of 18

MULTIRATE IMPACT AND RESULTS

Scientific:

  • Update existing RL assessment methodologies and/or develop new methodologies in seven domains
  • Development of new holistic RL assessment methodology that will be open for use from the EU R&D community

Economic/Technological:

  • Better planning of investments in R&D solutions to lead to the market
  • Better planning of future programmes
  • Clear picture of the potential use of solutions, based on holistic and quantitative maturity assessment
  • Open access without cost in the developed tool

Societal:

  • minimize the societal barriers between funding instruments, different consortiums and beneficiaries.

15 of 18

MULTIRATE IMPACT AND RESULTS

  • Result 1: Harmonised methodology and approach across EU regarding the assessment of the maturity level of solutions developed from the EU R&D community

  • Result 2: Development of holistic framework for maturity assessment (RL) to be used in EU R&D projects

  • Result 3: Development of at least seven RLs from different fields which will be integrated into the holistic framework

New product: Web-based, open access holistic and cross disciplinary maturity evaluation calculator

16 of 18

QUESTIONS

17 of 18

ACKNOWLEDGEMENT

Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or REA. Neither the European Union nor the granting authority can be held responsible for them.

18 of 18

THANK YOU FOR YOUR ATTENTION

RESEARCH AND INNOVATION SYMPOSIUM FOR EUROPEAN SECURITY AND DEFENSE 2023 | MAY 29TH – MAY 31ST | RHODES, GREECE