| A | B | D | E | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | AA | AB | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | BE Number | Description | Automated Test Procedure | Non-automated Test Procedure | Expected Result | Test Frequency | Action upon Failure | Grace Period | Recourse after Grace Period | Notes | |||||||||||||||||
2 | IdP 1 | Operated with organizational-level authority | Email To: SAs requesting annual attestation. Parallel but separate message to: InC Exec. | Notice to new InC Exec when they initially onboard | Attestation received: 1: All contacts are correct, all entity issues are being addressed. 2: ACKing your message, but we have work to do/may need your help. | Yearly | Try to reach out/solve at the lowest level. Temporary email bounce: retry. Permanent bounce: contact organization No bounce, no response after N tries: contact organization. SUMMARY: make deliberate attempt to contact organization and prompt response. | 2 months to respond to email | Service Management process | Enhance existing Service Management procedures to address. | |||||||||||||||||
3 | IdP 2 | Trusted enough to be used to access the organization’s own systems | InC Exec annual attestation | Notice to new InC Exec when they initially onboard | Yearly | Try to reach out/solve at the lowest level. Temporary email bounce: retry. Permanent bounce: contact organization No bounce, no response after N tries: contact organization. SUMMARY: make deliberate attempt to contact organization and prompt response. | 1 month to respond to email | Service Management process | |||||||||||||||||||
4 | IdP 3.1 | Complies with SIRTFI v1.0 | automate to Check Sirtfi entity attribute Sirtfi required for all new entities; can be checked with annual Security Contact check. | self-reported or another entity reports to CTAB (incidental discovery) | o email: response accepts everything we said. o entity attribute: it is there. o security contact: acknowledged in response to the email. | annual | Failure = annual email goes without reply before the end of the email cycle period. In that case, CTAB dispute procedure process | 1 month to respond to email | CTAB dispute procedure process | Security contact email (per entity) should remind them that their entity is marked Sirtfi compliant, and ask if that's still true. | |||||||||||||||||
21 | IdP 3.2 | Endpoints secured with current and trustworthy transport layer encryption | Scan endpoints using SSLLabs or equivalent. | alternative here? | SSLLabs score of A or better, or equivalent. | Annual | Lower than A or unscannable - reach out to operator, coordinate mitigation strategy and timeline. Mitigation should be made within 1 year. | 1 year | CTAB dispute procedure process | ||||||||||||||||||
22 | IdP 4 | Metadata is accurate and complete, including site contact information | - | - | |||||||||||||||||||||||
23 | - Technical contact | Periodic email sent to contact with appropriate body and link to click. | - | link clicked | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
24 | - Administrative contact | Periodic email sent to contact with appropriate body and link to click. | - | link clicked | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
25 | - Security contact | Periodic email sent to contact with appropriate body and link to click. | - | link clicked | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
26 | - Display name | Parse metadata for relevant string(s). | (Already done by JWK's group when IdP metadata is first created). | Metadata string exists and provides reasonable display name. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
27 | - Logo URL | Parse metadata for relevant string(s) and that it points to a url that returns a reasonable response code (e.g. 200 OK). | - | Metadata string exists, URL resolves, a suitably sized image resides there. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
28 | - Privacy policy URL | Parse metadata for relevant string(s) and that it points to a url that returns a reasonable response code (e.g. 200 OK). | - | Metadata string exists, URL resolves, a document resides there. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
29 | IdP 5 | Includes a current errorURL | Parse metadata for relevant string(s) and that it points to a url that returns a reasonable response code (e.g. 200 OK). | - | Metadata string exists, URL resolves, an HTML document resides there. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | ||||||||||||||||||
30 | SP 1 | Controls are in place to reasonably secure information and maintain user privacy. | Email To: SAs requesting annual attestation. Paralell but separate message to: InC Exec. | Notice to new InC Exec when they initially onboard | Attestation received: 1: All contacts are correct, all entity issues are being addressed. 2: ACKing your message, but we have work to do/may need your help. | Yearly | Try to reach out/solve at the lowest level. Temporary email bounce: retry. Permanent bounce: contact organization No bounce, no response after N tries: contact organization. SUMMARY: make deliberate attempt to contact organization and prompt response. | 2 months to respond to email | Service Management process | ||||||||||||||||||
31 | SP 2 | Information received from IdPs is not shared with third parties without permission and is stored only when necessary for SP’s purpose. | Email To: SAs requesting annual attestation. Paralell but separate message to: InC Exec. | Notice to new InC Exec when they initially onboard | Attestation received: 1: All contacts are correct, all entity issues are being addressed. 2: ACKing your message, but we have work to do/may need your help. | Yearly | Try to reach out/solve at the lowest level. Temporary email bounce: retry. Permanent bounce: contact organization No bounce, no response after N tries: contact organization. SUMMARY: make deliberate attempt to contact organization and prompt response. | 2 months to respond to email | Service Management process | Discuss in CTAB whether we can go beyond attestation. | |||||||||||||||||
32 | SP 3.1 | The SP complies with the requirements of the REFEDS SIRTFI v1.0. | automate to Check Sirtfi entity attribute Sirtfi required for all new entities; can be checked with annual Security Contact check. | self-reported or another entity reports to CTAB (incidental discovery) | o email: response accepts everything we said. o entity attribute: it is there. o security contact: acknowledged in response to the email. | annual | Failure = annual email goes without reply before the end of the email cycle period. In that case, CTAB dispute procedure process | 1 month to respond to email | CTAB dispute procedure process | Security contact email (per entity) should remind them that their entity is marked Sirtfi compliant, and ask if that's still true. | |||||||||||||||||
49 | SP 3.2 | All SP service endpoints are secured with current and trustworthy transport layer encryption. | Scan endpoints using SSLLabs or equivalent. | alternative here? | SSLLabs score of A or better, or equivalent. | Annual | Lower than A or unscannable - reach out to operator, coordinate mitigation strategy and timeline. Mitigation should be made within 1 year. | 1 year | CTAB dispute procedure process | ||||||||||||||||||
50 | SP 4 | The SP’s published metadata is accurate and complete: | - | - | |||||||||||||||||||||||
51 | - Technical contact | Periodic email sent to contact with appropriate body and link to click. | - | link clicked | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
52 | - Administrative contact | Periodic email sent to contact with appropriate body and link to click. | - | link clicked | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
53 | - Security contact | Periodic email sent to contact with appropriate body and link to click. | - | link clicked | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
54 | - Display name | Parse metadata for relevant string(s). | (Already done by JWK's group when IdP metadata is first created). | Metadata string exists and provides reasonable display name. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
55 | - Logo URL | Parse metadata for relevant string(s) and that it points to a url that returns a reasonable response code (e.g. 200 OK). | - | Metadata string exists, URL resolves, a suitably sized image resides there. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
56 | - Privacy policy URL | Parse metadata for relevant string(s) and that it points to a url that returns a reasonable response code (e.g. 200 OK). | - | Metadata string exists, URL resolves, a document resides there. | semi-annually | email to Exec & SA: might want to check up on this | N/A. Covered in annual attestation. | N/A. Covered in annual attestation. | |||||||||||||||||||
57 | SP 5 | Unless governed by an applicable contract, attributes required to obtain service are appropriate and made known publicly. | Email To: SAs requesting annual attestation. Paralell but separate message to: InC Exec. | Notice to new InC Exec when they initially onboard | Attestation received: 1: All contacts are correct, all entity issues are being addressed. 2: ACKing your message, but we have work to do/may need your help. | Yearly | Try to reach out/solve at the lowest level. Temporary email bounce: retry. Permanent bounce: contact organization No bounce, no response after N tries: contact organization. SUMMARY: make deliberate attempt to contact organization and prompt response. | 2 months to respond to email | Service Management process | Discuss in CTAB whether we can go beyond attestation. | |||||||||||||||||
58 | |||||||||||||||||||||||||||
59 | |||||||||||||||||||||||||||
60 | |||||||||||||||||||||||||||
61 | |||||||||||||||||||||||||||
62 | |||||||||||||||||||||||||||
63 | |||||||||||||||||||||||||||
64 | |||||||||||||||||||||||||||
65 | |||||||||||||||||||||||||||
66 | |||||||||||||||||||||||||||
67 | |||||||||||||||||||||||||||
68 | |||||||||||||||||||||||||||
69 | |||||||||||||||||||||||||||
70 | |||||||||||||||||||||||||||
71 | |||||||||||||||||||||||||||
72 | |||||||||||||||||||||||||||
73 | |||||||||||||||||||||||||||
74 | |||||||||||||||||||||||||||
75 | |||||||||||||||||||||||||||
76 | |||||||||||||||||||||||||||
77 | |||||||||||||||||||||||||||
78 | |||||||||||||||||||||||||||
79 | |||||||||||||||||||||||||||
80 | |||||||||||||||||||||||||||
81 | |||||||||||||||||||||||||||
82 | |||||||||||||||||||||||||||
83 | |||||||||||||||||||||||||||
84 | |||||||||||||||||||||||||||
85 | |||||||||||||||||||||||||||
86 | |||||||||||||||||||||||||||
87 | |||||||||||||||||||||||||||
88 | |||||||||||||||||||||||||||
89 | |||||||||||||||||||||||||||
90 | |||||||||||||||||||||||||||
91 | |||||||||||||||||||||||||||
92 | |||||||||||||||||||||||||||
93 | |||||||||||||||||||||||||||
94 | |||||||||||||||||||||||||||
95 | |||||||||||||||||||||||||||
96 | |||||||||||||||||||||||||||
97 | |||||||||||||||||||||||||||
98 | |||||||||||||||||||||||||||
99 | |||||||||||||||||||||||||||
100 | |||||||||||||||||||||||||||
101 | |||||||||||||||||||||||||||
102 | |||||||||||||||||||||||||||
103 | |||||||||||||||||||||||||||
104 | |||||||||||||||||||||||||||
105 | |||||||||||||||||||||||||||
106 | |||||||||||||||||||||||||||
107 | |||||||||||||||||||||||||||
108 | |||||||||||||||||||||||||||
109 | |||||||||||||||||||||||||||
110 | |||||||||||||||||||||||||||
111 | |||||||||||||||||||||||||||
112 | |||||||||||||||||||||||||||
113 | |||||||||||||||||||||||||||
114 | |||||||||||||||||||||||||||
115 | |||||||||||||||||||||||||||
116 | |||||||||||||||||||||||||||
117 | |||||||||||||||||||||||||||
118 | |||||||||||||||||||||||||||
119 | |||||||||||||||||||||||||||
120 | |||||||||||||||||||||||||||
121 | |||||||||||||||||||||||||||
122 | |||||||||||||||||||||||||||
123 | |||||||||||||||||||||||||||
124 | |||||||||||||||||||||||||||
125 | |||||||||||||||||||||||||||
126 | |||||||||||||||||||||||||||
127 | |||||||||||||||||||||||||||
128 | |||||||||||||||||||||||||||
129 | |||||||||||||||||||||||||||
130 | |||||||||||||||||||||||||||
131 | |||||||||||||||||||||||||||
132 |