ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
Recruitment Office
Specialty and LevelScore Handling Process
2
Physicians Specialty Recruiitment Office
Internal Medicine Training CT1Weightings and tie break ranking settings are inputted in Oriel and applied to applicants' self assessment scores. Rankings are generated via Oriel. No manual manipulation of data is undertaken. Checks are undertaken to ensure the rankings are processed accurately. Invitations to interview are based on the rankings
Interviewers input their scores directly into the Qpercom digital scoring system. Once all interviews are complete, scores are transferred from Qpercom to Oriel using an Application Programming Interface (API). Multiple checks are performed to ensure scores have transferred properly
Weightings and tie break ranking settings are applied in Oriel and the system calculates the final score and ranking. No manual calculations or editing are undertaken
Multiple level quality assurance checks are completed to ensure scores and ranks have been calculated correctly
3
Acute Internal Medicine ST4
Audiovestibular Medicine ST3
Cardiology ST4
Clinical Genetics ST3
Clinial Neurophysiology ST3
Clinical Pharmacology and Therapeutics ST4
Dermatology ST3
Endocrinology and Diabetes Mellitus ST4
Gastroenterology ST4
General (Internal) Medicine ST4
Genitourinary Medicine ST4
Geriatric Medicine ST4
Haematology ST3
Medical Oncology ST3
Medical Ophthalmology ST3
Neurology ST4
Palliative Medicine ST4
Rehabilitation Medicine ST3
Renal Medicine ST4
Respiratory Medicine ST4
Rheumatology ST4
Sport and Exercise Medicine ST3		Unverified self assessment scores and transferred from Oriel to Qpercom via an API. Quality checks are undertaken to ensure the data has transferred properly
Verified scores are input directly into Qpercom by assessors. Once the verification process is complete (including appeals), scores are transferred back to Oriel via API. Multiple level checks are undertaken to ensure the data has transferred correctly
Interviewers input their scores directly into the Qpercom digital scoring system. Once all interviews are complete, scores are transferred from Qpercom to Oriel via an API. Multiple checks are undertaken to confirm the scores have transferred correctly
Weightings and tie break settings are inputted into Oriel and the system calculates the final score and ranking. No manual calculation or editing of data is undertaken. Multiple checks are undertaken to confirm that the scores and rankings have been calculated correctly
4
Allergy ST3
Immunology ST3
Combined Infection Training ST3 and ST4		Applicant self asssessment data is exported from Oriel in separate Excel spreadsheets. Applicants who have applied to both specialties (Allergy and Immunology, Combined Infection Training ST3 and ST4) have duplicate records removed so that they only appear once in Qpercom. Multiple checks are completed to ensure that the data has been imported correctly
Once the verification process is complete (including appeals), scores are exported into separate Excel spreadshhets to upload into the separate vacancies on Oriel. Multiple checks are undertaken to confirm that the data has been imported correctly
Shortlisted applicant data is exported from Oriel into separate Excel spreadsheets. Applicants who have applied to both specialties (Allergy and Immunology, Combined Infection Training ST3 and ST4) have duplicate records removed so that they only appear once in Qpercom. Multiple checks are carried out to ensuree that data has been imported into Qpercom correctly
Interviewers input their scores directly into Qpercom. Once all interviews have been completed scores are exported from Qpercom to separate spreadsheets that can be uploaded into the separate vacancies in Oriel, ensuring that dual applicants have a score recorded against each vacancy. Extensive checks are undertaken to ensure scores have been imported correctly
Weightings and tie break rank settings are inputted into Oriel and applied to the scores. Oriel calculates the final score and rank. Multiple checks are carried out to ensure that ranks have been calculated correctly and that tie break settings have been applied as expected
5
Paediatrics National Recruitment Office
Paediatrics ST1Shortlisting is undertaken within Oriel so the scores are already within the system and do not need to be imported
Selection score is the interview score alone
Assessors input their interview scores into the Qpercom digital scoring system and scores are transferred back to Oriel via an API. Checks are undertaken to ensure scores have transferred correctly
Interview scores are ranked within Oriel and a manual process is used to break tied ranks
6
Paediatrics ST3 and ST4Shortlisting is undertaken within Oriel so the scores are already within the system and do not need to be imported
Selection score is the interview score alone
Assessors input their interview scores into the Qpercom digital scoring system and scores are transferred back to Oriel via an API. Checks are undertaken to ensure scores have transferred correctly
Interview scores are ranked within Oriel and a manual process is used to break tied ranks
7
Obstetrics and Gynaecology National Recruitment Office
Obstetrics and Gynaecology ST1Final scores comprise of scaled MSRA score and weighted interview score
MSRA scores are provided on a spreadsheet and are uploaded into Oriel and checked by the team
Interviewers input their scores directly into the Qpercom digital scoring system. Interview scores are transferred from Qpercom into Oriel via an API and weightings are applied by Oriel. Rankings are applied to the scores by Oriel
Quality checking of the data is undertaken by the recruitment team at all stages. No manual manipulation of data is undertaken
8
Obstetrics and Gynaecology ST3Final score comprises of shortlist and interview scores.
Shortlisting is undertaken within Oriel so the scores are already contained within the system and do not need to be imported
Interviewers input their scores directly into the Qpercom digital scoring system. Interview scores are transferred from Qpercom to Oriel using an API
The recruitment team quality checks the scores in Oriel at all stages of the selection process
There is no manual manipulation of data
9
Psychiatry National Recruitment Office
Core Psychiatry Training CT1Only score used in selection is MSRA
Scores uploaded to Oriel from a spreadsheet and checked by the team
Ranks are provided to the scores by the system
Tied ranks are manually broken using additional data
Manually breaking tied ranks is unlikely to happen in the future with the implementation of additional decimal places for MSRA scores
10
Psychiatry ST4 (all specialties)Final score is a combination of verified self assessment, interview score and a scaled examination score
Verified self assessment scores are input into the Qpercom digital scoring system by assessors. These scores are transferred to Oriel via an Application Programming Interface (API)
Interviewers input their scores directly into Qpercom. Interview scores are transferred to Oriel via an API
Examination scores are processed manually from a spreadsheet
11
General Surgery National Recruitment Office
General Surgery ST3Weightings are applied at both the self assessment verification stage and at interview. These are applied using spreadsheets with appropriate formulae
Applicant self assessment scores are exported from Oriel to an Excel spreadsheet. Weighting is applied using a formula and weighted scores are then imported into the Qpercom digital scoring system. Checks are performed to confirm all data has transferred properly
Once the self assessment verification process has been completed (including the appeals process), scores are exported from Qpercom to a spreadsheet, weighting is applied and then weighted scores are imported back into Oriel. Checks are performed to confirm all data has transferred properly
Interview scores are inputted directly into the Qpercom digital scoring system by interviewers. Once all interviews are complete, scores are transferred from Qpercom to Oriel using an API. One of the portfolio questions is weighted and this weighting is applied in Oriel. Checks are performed to confirm all data has transferrd correctly.
Weighting are inputted into Oriel to enable the overall selection score to be generated (33.33% self assessment verification, 66.67% interview). Ranks are generated based on the total score. Checks are undertaken to ensure this is correct
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100