ABDHIJKLMNOPQS
1
Tool Priority LevelOwnerIn Progress% CompleteQADevNeeded?Operating System Tested withSakai 22
Regression Script
Time to Completion (TTC) in HoursQA CommentsScript Status CommentsSakai 22 JIRAs
(new features listed first)
AGS-Comments
2
Server to use for testing: https://qa22-mysql.nightly.sakaiproject.org/ (Will be reset every Monday)

If test script mentions a property look here to see if it is enabled by default: https://qa22-mysql.nightly.sakaiproject.org/sakai/sakai.properties
3
Account1-HighDeepthi

Andrea
Testing Complete100%NoWin 10Sakai 22 - Account - Regression ScriptAGS: Updated SAK-41686, users can actually modify their account
SAK-41686 :This JIRA is open however it states that the modifying button should be removed. Tried to grant this ability by accessing realms and clicked on the !user.template.registered realm and tried to uncheck the user.upd.own permission and Save.However that permission is not present. The rest of the old script is based on the ability to modify.Referrred to the help documentation and the same process is listed under account help. Awaiting result for the Open JIRA to update the script as needed.

AGS: SAK-41686 deals with removing the permission for a user to update their account and this is 1.16 in the script. Up until that point, the script should be followed, testing the ability to modify account details as the user.

Script needs to be rewritten for nightly servers
4
Accessibility1-HighChris Knapp / Vision AidTesting in ProgressSakai 22 - Accessibility Regression Script
5
Accessibility Lite1-HighUjwala Merugu, Sai Chandrika NeradabilliTesting Complete100%NoWin 10, Chrome,Firefox, EdgeSakai 22 - Accessibility Lite - Regression Script
6
Assignments1-HighSteveTesting Complete100%NoWin10 (Chrome, Edge, Firefox) / Mac (Safari)Sakai 22 - Assignments - Regression ScriptSAK-46444 (Assignments: No Message Detailing If Or Why Assignment Submitted After Due Date Does Not Submit)
Verified on 10-22-2021

SAK-43596 (Private Notes Should Not be Displayed in the Instructor's Student View of the Assignment) -- adjusted script to account for this location of Private Notes
Open

SAK-46653 (Dark Theme: Assignments - Viewing Assignment - Student View - Low Contrast) -- doesn't affect the functionality of the script tasks, but needs to be addressed at some point
Verified 02-14-2022


Finished testing. 12-11-2021, pending Kristine's okay that she is finished with rewrites.

SAK-46415: blocker for video submissions
Verified on 02-25-2022
7
Assignments with Groups1-HighSteveTesting Complete100%NoWin10 (Firefox, Chrome, Edge)
Mac OS( Safari, Chrome)
Sakai 22 - Assignments with Groups - Regression Script
8
Bullhorn1-HighSteveTesting Complete100%NoWin10 (Firefox, Chrome, Edge) and Mac Big Sur OS (Safari, Chrome, Firefox)Sakai 22 - Bullhorn - Regression ScriptTesting complete except for Lessons portion -- awaiting expected behavior so scripts may be written

Two Jiras, not blockers:

SAK-44623: No bullhorn notification is thrown when an assignment's Opening Date is in the future
Open

SAK-44622: No bullhorn notification is thrown when an announcement's Beginning Date is in the future
Open
Still do not have the expected behavior for Lessons, that will need to be added once it's known
9
(New) Full Calendar - 22x1-HighLuis. Chandrika Neradabilli, Ujwala MeruguTesting in Progress100%NoWin 10, (Chrome, Frefox)Sakai 22 Full Calendar - Regression ScriptStill needs the widget scripts added
10
CKEditor1-HighRamana Reddy BattulaTesting in Progress100%Sakai 22 - CKEditor - Regression ScriptHorizontal lines and tables are not clearly visible; have to look into video formats allowed; available options in the editor and its size doesn't seem to be related.
11
CKEdit: file and tool browser (elfinder)1-HighAndreaTesting Complete100%Sakai 22 - Elfinder - Regression ScriptTested elfinder, but there are still open Jiras This is a duplicate of ckeditor - not an elfinder script
Script needs to be rewritten
12
Commons1-HighSteveTesting Complete100%NoWin10 (Chrome, Edge, Firefox)Sakai 22 - Commons - Regression ScriptTwo Jiras, neither is a blocker:

SAK-43067: Commons / unable to edit link or image
Awaiting Review

SAK-33587 : Thumbnail option does not work when adding a link in commons
Open
13
Conversations1-HighAndreaTesting in Progress50%Multiple issues still open that need to be fixed before testing can be completed
14
Dashboard1-HighAndreaTesting in Progress50%Sakai 22 - Dashboard - Regression ScriptMultiple issues still open that need to be fixed before testing can be completed

BLOCKERS:
SAK-46994
SAK-46986
Blank - needs test scriptsNew:
SAK-46656 Open
SAK-46659 Resolved
SAK-46660 Open
Existing:
SAK-46272 Open
SAK-46329 Closed/Verified
15
Discussions (formerly Forums)1-HighKristine, UjwalaTesting Complete100%Win10 ChromeSakai 22 DiscussionsShould be done by 2/4/22
16
Gradebook (GradebookNG)1-HighChristinaTesting Complete100%Sakai 22 - Gradebook (GradebookNG) - Regression ScriptSAK-44389 is stil an issue (type score + enter) In Progress

SAK-46438 and SAK-46439 created for keyboard navigation issues Closed
SAK-46450 - Course grade override points do not match % Closed
Script has not been updated, but is usable. A few steps have old/incorrect expected steps, but so far have been easy to spot and make note of.
18
Overview (Site Overview)1-HighSteveTesting Complete100%Win10 (Chrome, Edge, Firefox) / Mac (Safari)Sakai 22 - Overview (Site Overview) - Regression Script
19
Lessons1-HighAndreaTesting Complete100%Sakai 22 - Lessons - Regression ScriptNew:
SAK-46771 Open
SAK-46833 Open
20
LTI1-HighAndreaUpdating ScriptSakai 22 - Basic LTI - Regression ScriptOnce all the assignment Jiras have been resolved, the tests need to be added
21
MathJax1-HighRamana Reddy BattulaTesting Complete100%Win 10 (Chrome, Firefox)Sakai 22 - MathJax - Regression ScriptNew : SAK-46664 Open

22
Messages (Message Center)1-HighSteveTesting Complete100%NoWin10 (Chrome, Edge, Firefox) / Mac (Safari)Sakai 22 - Messages (Message Center) - Regression Script
23
Preferences1-HighSteveTesting Complete100%NoWin10 (Chrome, Edge, Firefox) / Mac (Safari)Sakai 22 - Preferences - Regression ScriptCompleted except for those items that required email; one unresolved Jira, but no blockers.

Open Jiras: SAK-44609 Open
24
Resources1-HighAndreaTesting Complete100%Win10: Edge, Firefox, ChromeSakai 22 - Resources - Regression ScriptOpen Jiras:
SAK-46421 Open
SAK-46334 Open
SAK-44257 Open
SAK-46247 Resolved
SAK-46201 Open
SAK-45984 Open
SAK-43844 Open
SAK-44704 Open
SAK-44521 Open
SAK-41524 Open
Blank - needs test scripts
25
Resources - WebDAV1-HighHeatherTesting Complete100%Mac/ChromeSakai 22 - Resources (WebDAV) - Regression Script Script has not been updated for 22, but is usable
26
Roster1-HighAyyapu naidu SankranthiTesting Complete100%NoWindows (Chrome)Sakai 22 - Roster - Regression ScriptScript has not been updated for 22, but is usable
27
Rubrics1-HighSteveTesting Complete100%NoMac (Chrome, Safari, Firefox)
Win10 PC (Chrome, Edge, Firefox)
Sakai 22 - Rubrics - Regression ScriptJiras in RED are preventing testing from completing:

SAK-46567 (Rubrics-GB-Assignments: Graded group submissions rubric does not display in the GB) Fixed/Verified 1/14/2022
SAK-46580 (Graded Items in Lessons Are Not Marked As "Returned")(Open)
SAK-42085 (Instructor: Manage Rubrics Cannot access the Add Rating icons and Edit Rating icons) Fixed/Closed/Verified 02-25-2022
SAK-46579 (Cannot Unselect Ratings in Graded Rubric) (Open)

AGS: Blocker for discussions/rubrics SAK-46690
Fixed/Verified 1/11/2022
Script has not been updated for 22, but is usable

Scripts are missing for
- Gradebook - Grading and Feedback
- Forums - Rubric Setup & Preview, Forums
- Student View & Submission
- Forums - Grading & Feedback

Unlink & Remove Rubrics is incomplete
28
Site Info (Sections)1-HighHeatherTesting Complete100%NoSakai 22 - Site Info (Sections) - Regression ScriptNeeds work
29
Site Info (Import from Site)1-HighAndrea, Matt ZeppetelliTesting in Progress90%Mac/Chrome
Win10/Edge, Firefox
Sakai 22 - Site Info (Import from Site) - Regression ScriptBlocker: SAK-46858

New:
SAK-46831 Open
SAK-46829 Open
SAK-46831 Open

Existing:
SAK-42033 Awaiting Review
Script has not been updated for 22, but is usable
30
Site Info (Add Participants)1-HighHeatherTesting Complete100%NoMac; ChromeSakai 22 - Site Info (Add Participants) - Regression ScriptThere's an email bit that may need a QA dev or someone else who can determine email activity. I've highlighted email-related things in yellow.

ags: I've tested all the items that were highlighted and they passed
31
Site Info (Edit Site Information)1-HighUjwalaTesting Complete100%NoWin 10; Chrome, EdgeSakai 22 - Site Info (Edit Site Information) - Regression ScriptScript has not been updated for 22, but is usable
32
Site Info (Manage Groups)1-HighAndreaTesting in Progress90%Sakai 22 - Site Info - Manage Groups - Regression ScriptSAK-46802 (Blocker) - Fixed/verified
SAK-46801 (Regression) Closed

Blocker: SAK-46858: assignments Open

Tested assignments, lessons, discussions, T&Q with groups
Integrations with other tools needs to be added once the Jiras are resolved and the expected behavior is known
33
Syllabus1-HighKristineTesting in Progress90%Win 10 ChromeSakai 22 - Syllabus - Regression ScriptScript has not been updated for 22, but is usable
34
Tests & Quizzes (Samigo) Delivery includes Exceptions Feature1-HighChristinaTesting Complete100%NoSakai 22 - Tests and Quizzes (Samigo) - Regression ScriptSAK-46539, SAK-42940, SAK-44062, SAK-46539, SAK-46617, SAK-46759New features, changes to assessments and settings page not updated in script
35
Tests & Quizzes (Samigo) Rubrics1-HighAndrea, SteveTesting in Progress90%Sakai 22 - Tests and Quizzes (Samigo) - Rubrics - Regression ScriptNEW: SAK-45656

Restore options with rubric are not working as expected. Script needs updated - rubrics/steps don't match up

Existing: SAK-45525 (negative points)
SAK-45564 - Adjusted score rubrics not keeping selected cells in instructor grading view (Open)
SAK-41588 - When modifying graded rubric from adjust to default, scores and cells do not match (Resolved/verified)
SAK-45695 - Tests & Quizzes: Rubrics with adjusted scores does not keep rating selection in Instructor view (Open)
SAK-47000: Tests & Quizzes: Not Showing Graded Rubric for All Questions (New)
36
T&Q: Minimum Points - Regression Script 1-HighKunal JaykamTesting Complete100%NoMac; Chrome,SafariSakai 22 - T&Q - Minimum Points - Regression Scriptlink to the cell : https://docs.google.com/spreadsheets/d/18UkCTzuRR1bLFZqkbtDmvSwvqEQnI2xe/edit#gid=304051830&range=G38New features, changes to assessments and settings page not updated in script
37
T&Q - Question Types - Regression Scripts1-HighKunal JaykamTesting Complete100%NoMac; Chrome,SafariSakai 22 - T&Q - Question Types - Regression ScriptNew features, changes to assessments and settings page not updated in script
38
Tool Order (PageOrderHelper)1-HighSteveTesting Complete100%NoMac (Chrome, Safari, Firefox)
Win10 PC (Chrome, Edge, Firefox)
Sakai 22 - Tool Order - Regression ScriptUnresolved Jiras, but no blockers:

Awaiting resolution of three Jiras in order to complete testing:
SAK-43751 (Unlock a tool in "Site Info" > "Tool Order" will override previous visibility settings for a tool) (open)
SAK-43750 (Invisible tools are still visible on course overview page) (awaiting info)
SAK-43749: (Invisible tool cannot be accessed by students via direct link) (awaiting info)
Script has not been updated for 22, but is usable
39
Worksite Setup1-HighAndreaTesting Complete100%Sakai 22 - Worksite Setup - Regression ScriptSAK-44589 Open
New Jira: SAK-46575 Open
Script has not been updated for 22, but is usable
40
Announcements2-Medium Ramana Reddy BattulaTesting Complete100%NoMac OS (Safari/ Chrome)Sakai 22 - Announcements - Regression ScriptAnnouncements that are supposed to be grayed out because of unavailability are indistinguishable; email notification checks are not tested; what is instructor workspace(sheet 2 - line 15 and 16); just an observation, while creating announcements and selecting show dates option why to have seperate selecting options for start and end dates.Script has not been updated for 22, but is usable
41
Chat Room2-MediumAndreaTesting Complete100%NoSakai 22 - Chat Room - Regression ScriptNew: SAK-46601 OpenScript has not been updated for 22, but is usable
42
Contact Us (Feedback Tool)2-MediumKunal JaykamTesting Complete100%NoSakai 22 - Contact Us (Feedback Tool) - Regression ScriptNeeds the mailcatcherScript has not been updated for 22, but is usable
43
Delegated Access2-MediumSteveTesting Complete100%NoSakai 22 - Delegated Access - Regression ScriptNew Jira: SAK-46736 (Admin Workspace: Delegated Access - Dark Theme Makes List Unreadable) Closed/Verified 02-21-2022Script has not been updated for 22, but is usable
44
Drop box2-MediumRamana Reddy BattulaTesting Complete100%NoWindows 10Sakai 22 - Drop Box - Regression ScriptScript has not been updated for 22, but is usable
45
Email Archive2-MediumAyyapuTesting in ProgressYesChrome;MacOSSakai 22 - Email Archive - Regression ScriptCan be tested (somewhat) if email tool is added to site and set to send emails to the archiveScript has not been updated for 22, but is usable
46
External Tool (LTI) - this is the same as basic LTI2-MediumUse the BasicLTI test script for thisBlank - needs test scripts
47
External Tools Tool2-MediumAndreaReady to TestSakai 22 - External Tools Tool - Regression ScriptBlank - needs test scripts
48
Job Scheduler2-MediumAndreaTesting in Progress75%Sakai 22 - Job Scheduler - Regression ScriptSAK-46675 (regression) Closed/Fixed
SAK-46665 (Blocker) Resolved for 23x - needs merged

Script has not been updated for 22, but is usable
49
PA System2-MediumSteveTesting Complete100%Win10, mac OS Big SurSakai 22 - PA System - Regression ScriptJiras needing attention, but not blockers:

SAK-44033 (PA System: Clear date button has no ico
n) Verified 12-16-2021
SAK-44
032 (PA System: Multiple popups require user log out to view all) Open
SAK-4
1152 (PA System 'Show System Alerts' banner doesn't always 'stick' to the header) Open
SAK-
43953 (PA System: Modifing Banner priorities) Open
Script has not been updated for 22, but is usable
50
Post'Em2-MediumSteveTesting Complete100%NoWin10, MacOS Big SurSakai 22 - Post'Em - Regression ScriptCompleted testing, except for one question I'm awaiting response for on an expected behavior

AGS: I've never heard of a Post'Em file being pulled from Resources. I've only known Post'Em to require an actual upload.
Script has not been updated for 22, but is usable

While testing, I did basic updates to match up with current messages, screen sequences, and button titles.
51
Profile (Profile2)2-MediumSteveTesting Complete100%NoWin10, MacOS Big SurSakai 22 - Profile (Profile2) - Regression ScriptCompleted testing -- SAK-46625 (Profile: Profile - Basic Info - Birthday Default Set to Checked) was created to determine what the preferred default-setting for birthday should be. OpenScript has not been updated for 22, but is usable
52
Search2-MediumChristinaTesting in Progress50%Sakai 22 - Search - Regression ScriptSAK-46838 - fixed on trunk, needs merged into 22 to test the WC Search.
SAK-46301 - Announcement body text. Verified
SAK-46868 - Announcement date lock. Open
SAK-46873 - Assignment drafts visible. Open
Skeleton script - needs work
53
Sign up2-MediumAndreaTesting in Progress90%Sakai 22 - Sign Up - Regression ScriptSAK-46753 (Blocker) Verified
SAK-46755 Open
SAK-46765 (minor) Open

Waiting on answer on export: SAK-44773
Script has not been updated for 22, but is usable
54
Statistics2-MediumSteveTesting Complete100%NoWin10, MacOS Big SurSakai 22 - Statistics - Regression ScriptExisting Jira:

SAK-44572 (Statistics ->Activity -> By user should show total activity tracked instead of itemized) (Open)
55
Tutorial2-MediumChristinaTesting Complete100%Sakai 22 - Tutorial - Regression ScriptBasic test script, good enough
56
Admin Site Perms3-LowSteveTesting Complete100%NoWin10Sakai 22 - Admin Site Perms - Regression ScriptBlocker: SAK-46869. Fixed/closedScript has not been updated for 22, but is usable
57
Aliases (Admin Site Management)3-LowAndreaTesting Complete100%YesSakai 22 - Aliases (Admin Tool) - Regression ScriptNew: SAK-46715 Open
58
Announcements (MOTD) (Admin Site Management)3-LowSteveTesting Complete100%NoSakai 22 - MOTD - Regression ScriptJiras (no blockers):
SAK-43683 Open
SAK-44790 Open
59
Become User (SUTool)3-LowAndreaTesting Complete100%Sakai 22 - Become User (SU Tool) - Regression ScriptBlank - needs test scripts
60
Citations Helper3-LowSteveTesting Complete100%NoWin10Sakai 22 - Citations (Reading List) - Regression Script
61
Email (Mail Sender)3-LowAndreaReady to TestSakai 22 - Email (Email Sender) - Regression ScriptSAK-46162 Resolved (email problem is standing issue)
SAK-46341 Resolved (do not seem to be fixed properly. Mailinator accounts are not receiving an email)
Blank - needs test scripts
62
Email Templates3-LowSteveTesting CompleteWin10Sakai 22 - Email Templates - Regression ScriptSAK-46830 Open
63
Gateway3-LowSteveTesting Complete100%NoWin10, MacOS Big SurSakai 22 - Gateway - Regression ScriptOnly 1 error - on the Acknowledgements page, only one link did not work (404 page not found): Sakai Community

AGS: 1/15/2022 - all links are working now including Sakai Community
64
Help Content3-LowSteveTesting Complete100%NoWin10, MacOS Big SurSakai 21 - Help Content - Regression Script
65
Internationalization3-LowAyyapu naidu SankranthiTesting Complete100%Win10Sakai 22 - Internationalization - Regression ScriptUsed the old scripts to test this tool and worked fine. In the script where I used there are few things related to this tool like time zone and language. old scriptsBlank - needs test scripts
66
Membership3-LowSteveTesting Complete100%NoWin10Sakai 22 - Membership - Regression ScriptNo breakers.

One discrepancy: after checking help files, I don't believe that a student user of a site that is unpublished should be able to login to the site until it is published. This contradicts one instruction in the scripts.

AGS: I believe the instructions should have been log into Sakai because then the user needs to verify that the site no longer displays in Current Sites or Joinable Sites
67
Memory3-LowReady to TestYesSakai 22 - Memory - Regression ScriptBlank - needs test scripts
68
Message Bundle Manager3-LowEarleReady to TestYesSakai 22 - Message Bundle Manager - Regression ScriptBlank - needs test scripts
69
New Account3-LowAndreaTesting Complete100%Sakai 22 - New Account - Regression Script
70
News (RSS)3-LowSteveTesting Complete100%NoWin10, MacOS Big SurSakai 22 - News (RSS) - Regression Script
71
OAuth3-LowReady to TestYesSakai 22 - OAuth - Regression ScriptBlank - needs test scripts
72
On-Line (Admin Site Management)3-LowReady to TestSakai 22 - On-Line (Admin Site Management) - Regression ScriptBlank - needs test scripts
73
Podcasts3-LowKunal JaykamTesting in ProgressYesSakai 22 - Podcast - Regression ScriptSetup scripts *Required
74
Polls3-LowHeather Testing Complete100%Mac Big SurSakai 22 - Polls - Regression ScriptBlank - needs test scripts
75
Portlet (SVN module)3-LowReady to TestYesSakai 22 - Portlet (SVN module) - Regression ScriptBlank - needs test scripts
76
Publish Now Button3-LowHeatherTesting Complete100%Mac Big SurSakai 22 - Publish Now Button - Regression ScriptBlank - needs test scripts
77
Realms (Admin Site Management)3-LowReady to TestSakai 22 - Realms (Admin Site Management) - Regression ScriptScript from Sakai 11 - needs updated
78
Reset Password3-LowSteveTesting Complete100%NoWin10Sakai 22 - Reset Password - Regression ScriptAGS: Not in the script, but reset password from the gateway is not working
BLOCKER: SAK-46740 - Fixed/Verified 1/14/2022
79
Rwiki3-LowSteveTesting Complete100%NoWin10Sakai 22 - Rwiki - Regression ScriptFinished testing (Duplicate Site was tested on 23 Trunk Experimental)

Jiras set to Won't Fix and Rwiki Search doesn't work and the site Search tool doesn't work with Wiki

SAK-44421 (hide Rwiki Search box) - open feature request Open

SAK-46766 (RWiki: Multiple Users Editing Same Wiki Page Causes Error and Confusion) Open - linked to SAK-9955 Closed/Won't Fix

Generation of .rtf format files is not an option available to users on 22 nightly; however, Jiras indicate this option is only available on Experimental branch

Wiki displays the user as who created the site, not who is currently editing the site, as test scripts indicate

SAK-46764: Wiki math tags not working
Note: 02-13-2022 -- the $$ tags are working in Firefox and Chrome, but the {math display}{math} are not. Open
80
Section Info3-LowSteveTesting Complete100%NoWin10Sakai 22 - Section Info - Regression ScriptNew Jira, but there is a workaround.

SAK-46749 (Section Info: Instructor May Only Select Checkboxes When Changing from Automatically Managing to Manually Managing Class Sections) Verified
New: SAK-46749
81
Site Archive (Admin Site Management)3-LowAndreaTesting in Progress50%YesSakai 22 - Site Archive (Admin Site Management) - Regression ScriptI believe there is ann issue when creating the zip file. Extracted the file and it's missing content: SAK-45064 Verified 22x

Imports without errors, but there is no content imported
Blank - needs test scripts
82
Site Overview Display3-LowSteveTesting Complete100%NoWin10Sakai 22 - Site Overview Display - Regression Script
83
Site Stats Admin3-LowLuisReady to TestNoSakai 22 - Site Stats Admin - Regression ScriptBlank - needs test scripts
84
Sites (Admin Site Management)3-LowSteveTesting Complete100%NoWin10Sakai 22 - Sites (Admin Site Management) - Regression Script
85
User Membership (Admin Workspace)3-LowSteveTesting Complete100%NoWin10Sakai 22 - User Membership - Regression ScriptBlocker: SAK-46732 Verified
86
Users (Admin User Management)3-LowReady to TestSakai 22 - Users (Admin User Management) - Regression ScriptScript from Sakai 11 - needs updated
87
View Site As3-LowHeather ValliTesting Complete100%Sakai 22 - View Site As - Regression ScriptBlank - needs test scripts
88
Web Content3-LowHeather ValliTesting CompleteMacSakai 22 Web Content - Regression ScriptSome functionality seems to be missing (change icon, etc.). I noted it in the testing script.

AGS: Once you click on the web content tool you added and select edit, you will see the ability to choose a custom icon. The Edit button is at the top of the page.

HRV: Clicking on the web content tool does not bring up an edit to select in either the left-hand menu or Manage Tools. There's an edit function in Tool Order, but that does not affect the missing functionality I mentioned above.
https://sakaiproject.atlassian.net/browse/SAK-46982 Awaiting Review
89
Web Services3-LowReady to TestYesSakai 22 - Web Services - Regression ScriptScript from Sakai 11 - needs updated
90