1 of 18

Linked Data Import Module�mod-linked-data-import

Alvaro López B.

Linked Data Editor – Product Owner

2 of 18

Challenges to be solved

  • In order to have a complete workflow for the Linked Data Editor, Data Import capabilities are needed
  • Not just Data Import but bulk Data Import
  • Current Data Import app in FOLIO, doesn’t support RDF files
  • To make the Data Import app compatible with RDF, it would involve refactoring the whole app from top to bottom

​

3 of 18

Proposed Solution

  • An independent, RDF-compatible Data Import module:

mod-linked-data-import

  • Feature: UXPROD-4600 covers it. Approved by TC: TCR-59
  • Expected to be part of the Trillium release
  • This module is able to ingest 100,000s RDF instances through a JSON-LD file
  • Not available to regular users via UI, since it can hurt a catalog if left that way
  • Available to SysAdmins through permissions and via API
  • A JSON-LD file is uploaded to an S3 bucket, and then through an API call, mod-linked-data-import, ingests the instances and feeds them to the Linked Data module

4 of 18

Linked Data Import Workflow

5 of 18

Development

Feature: UXPROD-4600

�In scope

  • Import of Works, Instances and Hubs
  • Currently Hubs import capabilities are being perfected

Future development

  • Authorities and Items/Holdings support

6 of 18

Linked Data Import Actual Workflow

Upload a file a to a S3 bucket

7 of 18

Linked Data Import Workflow

Upload a file a to a S3 bucket

8 of 18

Linked Data Import Workflow

Configure the API

9 of 18

Linked Data Import Workflow

After it’s done, we can get the job number

10 of 18

Linked Data Import Workflow

We run the failed lines GET method

11 of 18

Linked Data Import Workflow

Checking the imported instances

12 of 18

Linked Data Import Actual Workflow

13 of 18

Linked Data Import Workflow

The import had 2 instances

14 of 18

The import is visible in Linked Data search

Linked Data Import Workflow

15 of 18

Linked Data Import Actual Workflow

The import can also be rendered as MARC

16 of 18

Linked Data Import Workflow

The import also exists in Inventory

17 of 18

Thank you very much!��Questions?

18 of 18

Overlap management rules

  • If the imported resource has matching values in the fingerprint fields, the new values are added to the existing resource, which is updated
  • If the fingerprint is different, a different instance is created
  • That new instance creates a new derived MARC record

Fingerprint fields (they are all configurable)

Work

Creator�Main Title�Subject�Language

Instance

Statement of responsibility�Main Title�ISBN�LCCN

Hub

Creator�Title�Language