State of The CLAW Address; The Long version

Project history and background

Fedora 4 Interest Group

Fedora 3 is End of Life

ils sont en fin de parcours

3.8.1

What's that mean?

Community Support

Phase 1

December 2014-August 2015

Thank you to our sponsors:

I’m going to blur Phase 1 and Phase 2

Atonement

ethos

Community

We have to do this together

​

github.com/Islandora-CLAW/CLAW

​

Contributing

http://islandora-claw.github.io/CLAW/contributing/contributing

​

“All contributions are welcome: use-cases, documentation, code, patches, bug reports, feature requests, etc. You do not need to be a programmer to speak up!”

CLAW Calls

Wednesdays at 1PM EST

Documentation

http://islandora-claw.github.io/CLAW

I love Markdown...

...and I have this theory...

MkDocs!

DevOps

DevOps

DevOps

DevOps

DevOps

vagrant up

(that’s it!)

future.islandora.ca

Thank you Univeristy of Manitoba!

Code4Lib 2015

Portland, Oregon

PCDM

Fedora, Hydra, Islandora… Repository communities unite!

Hylandora Day

iCamp CT

Phase 2;

November 2015-Present

DevOps

Community

Community

Community

Community

CLAW Calls

Wednesdays at 1PM EST

CLAW Lessons

CLAW Calls

Wednesdays at 1PM EST

This is us.

Make the lobster happy, not sad.

Project Plan & Priorities

PHP Services

Project Restructuring

Drupal 8

AuthN

Drupal 8; CAS, Shibboleth, OpenLDAP

AuthZ

WebAC

WebAccessControl

...nobody likes XACML

DIEGO!!!

Islandora 2.x

Tech Intro to Claw

https://github.com/Islandora-CLAW/CLAW

What we know about current Islandora (7.x-1.7)

https://github.com/islandora/islandora

DRUPAL 7.X CMS

Islandora (MIDDLEWARE)

Fedora 3.81 (Storage and preservation)

Design Goals for Islandora 2.x

Utilize Fedora 4/ Drupal to its fullest.

• Easier to use
• Better user experience
• Faster searching, display, and ingest
• Expose more control of your repository through UI
• Easier to install/configure
• Easier to develop and contribute
• Easier to scale
• Community Based design.

Islandora is no longer Middleware

​



​

Islandora 2.x (zoom level 0)

Where is Islandora here?

Islandora-CLAW is a bit everywhere

(and among us)

https://github.com/islandora-CLAW/CLAW

I make use of existing tools integrating myself into each one. I’m not a layer, i play roles in multiple ones.

Multi Language

Distributed

Role Separation

Not a layer

Islandora Claw Ecosystem

Diagrams are good

Quick Facts about Islandora CLAW

(or how we achieve the Goals)

• Makes use of Drupal CMS completely (tight and close)
• Islandora Solution Packs? Real Drupal Modules
• Resources Live in Drupal and in Fedora 4 (same meaning, different representations)
• There is no “Source Master”.
• Bi-directional Sync between Drupal and Fedora via CAMEL
• Exposes endpoints everywhere (RESTful API)
• It’s written in PHP(variety of frameworks), JAVA, Spring, Blueprint XML
• It deals with data in a very Async fashion (event driven)
• We have Microservices (Silex, PHP)
• It’s a stack of moving pieces that depend on each other

​

Data definition @ Islandora-CLAW

Islandora generates real Drupal Content.(In the future Entities)

Islandora CRUDs Real Fedora 4 Resources

So we need to transform back and forth

(Welcome to the data flow)

Apache Camel

(Java?)

Don’t be scared of Apache Camel

Camel is a framework for building middleware

• Provides workflow-like structure for the code
• Routes can be written in multiple languages
• Message splitting, transformations, concurrent processing, error handling / redelivery
• Works out of the box with everything you can think of
• Used by Islandora for JMS Processing, bi-directional Sync and more
• Runs on Karaf/ OSGI

​

Simplified Islandora-CLAW data flow

The immediate Future�¿microservices in CLAW?

https://github.com/Islandora-CLAW/CLAW/tree/sprint-002/services

A simple idea

Instead of having a Big chunk of all purpose code

We build slim, lightweight PHP Services that do a particular task, reusing code, classes or full packages

​

​

I’m a Specialist in all styles

ResourceService �I handle RDF, do some stuff, pass it to chullo

Chullo Here.� I pass messages to F4

A simple idea

Micro Services: These are not just classes reusable /php code. �These are services that run at an HTTP URL/PORT listening and processing what you send them.

​

​

ResourceService �I will take that HTTP POST “BUllet” for YOU

Chullo

Invoke me with that message when you are done processing( whatever you do, I don’t care)

Role separation: Chullo, where all started (not a service)

https://github.com/Islandora-CLAW/chullo

Uses EasyRDF and Guzzle to talk to Fedora 4. Has interfaces.

�Provides Classes

​

Islandora\Chullo

• FedoraAPI (full api)
• Chullo (simplified access to api)
• TriplestoreClient (talks to triple store)

Islandora\Chullo\Uuid

• UuidGenerator (UUID V4 and V5 generator)

​

Class Namespace (hu!)

Class Name

Simple ideas require new knowledge

ResourceService �I was built In SILEX. i can USE YOU, simple PHP PACKAGE!!

I’m not SILEX

there is More: WE built these Microservices using a PHP Framework named SILEX!

​

Let’s avoid reinventing the wheel and do some cool apps!

Silex in a few words

http://silex.sensiolabs.org/doc/usage.html

• It’s a Micro-framework (you can build a one file app!)
• Imagine something “like” Camel but in PHP with less stuff.
• Makes handling HTTP requests so simple
• It’s based on a larger framework named Symfony (DRUPAL 8 is Symfony!)

​

Silex will replace CAMEL?

You want to replace ME!

No WAY! You are better at Async. But i’m PHP. My people loves PHP

Conclusions

​

Benefits of this approach

• The Real Drupal Experience
• 3rd Party Modules(Drupal)
• Use all that is out there as normal Drupal users do
• Fedora 4 is better, faster, safer than Fedora 3
• Async is good
• Common Data modelling (standard Ontologies)
• Simpler contributing to code
• Less code
• Community based

​

BACK TO NICK

Upgration!

How are we going to get there?

​

...or portmanteaus are awesome!

York University

Solution Packs:

Collection, Audio, Book, Compound, Large Image, Video, Web Archive

Property Mappings

fcrepo3->fcrepo4

Object properties

fcrepo3->fcrepo4

Datastream properties

fcrepo3->fcrepo4

RELS-EXT/RELS-INT

Islandora Ontology

http://islandora.ca/ontology/relsext/#

http://islandora.ca/ontology/relsint/#

​

Islandora Ontology

https://github.com/Islandora/islandora_ontology

​

fcrepo3->fcrepo4

auditTrail

migration-utils

https://github.com/fcrepo4-labs/migration-utils

​

Questions/Discussion