Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Overview

The Sakai 20 QA Hub is the home page for the Sakai 20 Quality Assurance effort.

For questions please contact sakai-qa@apereo.org


Testing

The web page for all the testing servers can be found here:

http://nightly2.sakaiproject.org/

The web page you want to use for testing Sakai 20 is: 

https://qa20-mysql.nightly.sakaiproject.org/

The above link for testing Sakai 20 can be found under 20.x test instances on the testing servers web page.


Communication Channels

Sakai QA list

Join the Sakai QA list (sakai-qa@ apereo.org) to keep up to date on all things QA in Sakai. Anyone can join the group here: https://groups.google.com/a/apereo.org/forum/#!forum/sakai-qa

Sakai QA Slack Channel

We have a very active Sakai QA channel in Apereo’s Slack instance. We use this for communicating during Test Fests and asking QA questions to the group or to individuals anytime. If someone at your institution has already joined, then you can self join at: https://apereo.slack.com/signup

Otherwise, send an email to  sakai-qa-planners@apereo.org  to have your institution's domain added for self signup. For a quick overview of Slack (along with some helpful tips n’ tricks), see the following video: https://youtu.be/aB8PsAn97uo


Meetings

Weekly QA Planning Calls

The QA Planning Group meets every  Wednesday from 5:30 pm - 6:30 pm, Eastern time . This group guides the overall direction of the Sakai QA effort, creates testing materials and processes, and participates in testing. Meetings agendas and notes can be found by following this etherpad link: https://etherpad.nightly.sakaiproject.org/p/QA-Planning-Call. All are welcome! We meet in the QA Room in BigBlueButton:

http://apereo.blindsidenetworks.net/apereo/ 
QA Room
password: apereo


Latest Version - Sakai 20.5

Per Wilma and the release announcement:

Sakai 20.5 has 119 improvements including 

  • 23 fixes in Assignments
  • 13 fixes in Gradebook
  • 24 fixes in Tests & Quizzes

Other areas improved include:

  • A11y
  • Announcements
  • Basic LTI
  • Bullhorns
  • Calendar
  • Commons
  • Content Review
  • Dropbox
  • Entity Broker
  • Forums
  • Lessons
  • Messages
  • Profile
  • Resources
  • Roster
  • Rubrics
  • Section Info
  • Sign Up
  • Site Info
  • Statistics
  • Syllabus
  • Wiki

There were 2 security issues fixed in 20.5 (details will be sent to the Sakai Security Announcements list).


QA Testing this week 

This week for QA, we will want to continue testing

Sakai 22 using the regression scripts found in

for the Sakai 22

Tool sign-up spreadsheet. The link to the spreadsheet can be found here: 

.1 release. 

The server we want to use for testing is the Sakai 22 branch.

This branch can be found here: https://qa22-mysql.nightly.sakaiproject.

org/

org


Sakai 22
Regression Script
Testing
Progress
:
  • High Priority Tools:
    • 25 out of 36 high-priority tools are marked Complete.
    • 10 out of 36 high-priority tools are marked Testing in progress.
    • 0 out of 36 high-priority tools are marked Ready to Test. 
    • 1 out of 36 high-priority tools is marked Updating Script. 
  • Medium Priority Tools:
    • 9 out of 16 medium priority tools are marked Complete.
    • 4 out of 16 medium priority tools are marked Testing in progress.
    • 2 out of 16 medium priority tools are marked Ready to Test.
  • Low Priority Tools:
  • 18 out of 34 low-priority tools are marked Complete.
  • 5 out of 34 low-priority tools are marked Testing in progress.
  • 11 out of 34 low-priority tools are marked Ready to Test. 

    Verifying master JIRAs if nothing left to verify. 

    • Any JIRA resolved. 
    • project = Sakai AND resolution = Fixed AND status = Resolved and resolutiondate >= -2w
    • Anything fixed or resolved in the last 2 weeks. 
    • MASTER VERIFICATION only

    The Friday conference call (aka TestFest) will be held in the Sakai QA Room in BigBlueButton. BigBlueButton can be found by following this link: https://apereo.blindsidenetworks.net/apereo/. In the drop down menu for rooms select Sakai QA Room. The password is apereo. Starting time is 10:00 AM EST. 

    Look forward to seeing everyone at Test Fest this week.

    Server to use for testing
    Unless otherwise stated, all testing is taking place on the Sakai 20 server (refreshed weekly on Mondays).

    When testing notifications/email, you can check the Mail Catcher server to confirm sent messages - https://mail.nightly.sakaiproject.org/

    Reporting Issues via Jira

    Weekly Test Fests

    Join our QA “Test Fests” every Friday from 10am to 11 am, Eastern time! This is an opportunity to jump into testing Sakai with the support of the QA Team and other community members. You do not need to be an functional expert to get involved. Test Fest agendas and notes can be found by following this etherpad link here: https://etherpad.nightly.sakaiproject.org/p/QA-Test-FestWe begin our Test Fests in the QA Room in BigBlueButton (see left). Throughout the course of the Test Fest, we communicate using our new SakaiQA channel in Apereo’s Slack instance described under Communication Channels on this page. 

    *QA testing is informed by updates on the Core Team call and QA planning meetings which are held on Tuesday every week.  Therefore, QA testing cycles usually run from Wednesday to Wednesday the following week.  Longer QA cycles may be held during QA for major releases to accommodate more in-depth testing such as regression testing.


    Useful Details / Resources

    Video: How to create a Jira

    Sakai QA bug fix workflow.pdf

    Sakai 20 Regression Scripts

    Testing Resources - test files and content for Calendar, Gradebook, Lessons, Tests & Quzzies, CK Editor and general media/text files

    QA Team Testing Resources