1 of 11

Practice Learning Think-Tank�Investigating online portfolio solutions for clinical assessment

Stephen Pyne – Learning Technologist

2 of 11

Initial investigation

Current solution creates silos for single points of failure
Robust and agile software
Futureproofing
Enhance student experience

Scoping exercise required
Phase 1 – high level fact finding
3 tools (as per professional network advice)

PebblePad
MyKnowledgeMap
OnlinePARE (Practice Assessment Record & Evaluation)

3 of 11

4 of 11

PebblePad - The Learning Journey Platform

PebbleVision - Capturing skills - PebblePad

5 of 11

List of considerations for online portfolio tool – Pebble Pad

Students to enter statements which are graded pass/fail or present/not present - Yes
Provision for a logbooks and timesheets - Yes
Option for staff & patient feedback using a ratings – Likert scale/Emoji
integration into Moodle – Yes LTI -1.3. SSO included
Turnitin integration – No (copy and paste)
Any other marking tools such as plagiarism checker or student marks/ feedback options – No (captured in ATLAS)
Tool will need to be accessible to staff, students, NHS supervisors and patients (patients can use it while the students is logged in) – Yes possible *Check data collection with patients – how is it verified for authenticity*
What levels of support are offered to staff/students? No support after onboarding
Amazon web services – Cloud hosted
Free alumni accounts for life

How much does it cost? Is it per student, is there a cost for staff?

Approx. £11,000 = 1000 licenses plus 10% free external accounts *expected 5% YOY increase*

6 of 11

7 of 11

List of considerations for online portfolio tool – My Knowledge Map

Students to enter statements which are graded pass/fail or present/not present – Yes, standardised templates,
Provision for a ratings scale of students work - Likert scale/other
Student tracking – Yes, logs and practice hours/timesheets
Option for patient feedback using a ratings/ smiley face scale - Yes, offline forms for patients or direct feedback
integration into Moodle – Yes LTI 1.3 & SSO
Turnitin integration - No
Any other marking tools such as plagiarism checker or student marks/ feedback options – Rubrics/marking forms
Tool will need to be accessible to staff, students, NHS supervisors and patients (patients can use it while the students is logged in) – Yes, NHS supervisors can request access which is managed by MKM
Cloud/Web hosted via Microsoft Azure
What levels of support are offered to staff/students? – Onboarding to include academic and admin staff training. Live copy test server, 3rd line support function for limited staff. Student training bespoke
Progress/analytics dashboard available to teaching staff and practice facilitators

8 of 11

https://onlinepare.net/

Online Practice Assessment Record and Evaluation (PARE) has been funded by Health Education England (North) since 2013 as both the definitive healthcare practice placement quality monitoring tool, and as a means of shaping information technology integration and development across healthcare practice learning. Designed by a team hosted within the University of Chester, PARE is the result of a substantial collaboration of Northwest universities and healthcare provider organisations.

Core Features of PARE include:

Collaboration and standardisation of online practice learning assessment and practice hour monitoring.
Online portfolio of anonymised evidence for practice assessor / supervisor activities.
Instant messaging and cross organisation communication aids to support clinical educator / learner / university integrated working.
Multi professional, and cross organisation 'real time' educator registers.
Generation of real-time multi professional practice capacity, usage, learner results, and placement quality metrics.
Online PARE can be accessed from any web browser on any device, via the PARE website.

What is PARE?

9 of 11

Radiography: https://demo.onlinepare.net/dashboard.php?startdemo=y&type=radiography_generic_doc

I have copied links below to a few document sets on our PARE demonstration site that are based on national documents, and which will give you a good feel for how the documentation works on PARE:��Nursing Associate: https://demo.onlinepare.net/dashboard.php?startdemo=y&type=npn_tna_generic��Nursing: https://demo.onlinepare.net/dashboard.php?startdemo=y&type=par_north��Midwifery: https://demo.onlinepare.net/dashboard.php?startdemo=y&type=mw_nat_22� �Physiotherapy: https://demo.onlinepare.net/dashboard.php?startdemo=y&type=physio_national� �Radiography: https://demo.onlinepare.net/dashboard.php?startdemo=y&type=radiography_generic_doc��Just copy and paste a link into your browser URL to browse the online document set in each case. The link takes you to the student's view of the PARE dashboard. Click on any of the document images displayed on the dashboard to navigate around the document and test out data entry and section/page sign off. No data entered is retained - these documents are single-use and for test purposes only. The documents are created afresh each time the link to the dashboard is accessed. ��The PARE dashboard also includes sections and links to examples of the PARE timesheets and placement evaluations, and a 'View User Guides' button in the left panel to view and download more detailed guidance on the features available to students and practice educators. There are more guides available on the main website for senior HEI and placement provider PARE users, detailing additional features available to senior staff for importing student placement allocation data into PARE, assigning staff to student documentation on PARE, viewing Mark Sheets, and running reports relating to placement timesheets, evaluations, audits and other placement information.��From the student dashboard you can also switch to a practice educator's view of the dashboard by clicking on the demo username at the top right-hand corner of the PARE screen, and selecting the 'Switch to Placement Educator (Mentor) Account' link in the drop-down:��PARE also includes a placement audit tool, for documenting and monitoring placement audits. The following link takes you to an example online placement audit document, as viewed by senior HEI staff. Again, you can switch to another view of the audit documentation , this time as seen by the senior placement provider staff. To navigate around the audit document just click on an item in the document menu panel to the left of the document page:�https://aq5zjofnn.demo.onlinepare.net/audit-tool/view-audit-details.php?id=29&aolc=1

10 of 11

List of considerations for online portfolio tool – Pebble Pad

Students to enter statements which are graded pass/fail or present/not present – Yes + electronic signitures
Provision for a ratings scale of students work – Yes, Likert/other
Option for patient feedback using a ratings/ smiley face scale - Yes
integration into Moodle – no – Url only
Turnitin integration – No (document download in full, upload to TII)
Any other marking tools such as plagiarism checker or student marks/ feedback options – Standard evaluation tools, Algorithms to support marking
Tool will need to be accessible to staff, students, NHS supervisors and patients (patients can use it while the students is logged in) – Various roles built into the tool – *Manual creation and management of accounts*
Can we use SSO? Not available
Are there examples of portfolios we can view or videos? - Yes (Demo site)
What levels of support are offered to staff/students? Onboarding, document design

Development costs – 5-6k per document build

License fee – (inc 2 x a year changes) 1-500 student £14:90 per license per year up to 1000 students £12:20. 500 licenses = £7.450

Yr 1 = £13,450

11 of 11

Please scan the QR code or navigate to the URL in the Teams chat

Questions and feedback?