Page Comparison

...

• The QA5 server has been used in the past by UM for testing Release candidates.  It can be found here:
  Quick link: http://qa5-us.sakaiproject.org/portal
• Login to the Qa5 server: 
  • UserID = admin
  • Password = (traditional Sakai login)  contact Cathy Crouch if you need additional information (crouch@umich.edu)
• On the Sakai QA servers, each user can create his or her own test accounts and sites.
• Test accounts have been setup for the following IDs:  Instructor01, Student01, and Student02.  See the Information page of the test plan for details.
• Navigation for Teaching Evaluations for the 1.4.x Release:  Click on "More Sites" at the top of the page > "TQ-test" site > Evaluation System tool
• Set up 2 or 3 Sakai course and/or project sites, i.e. EvalTest01 and EvalTest02EvalTest02, EvalTest02, and EvalTest03
• Add an instructor to each 1 instructor to a site; add multiple instructors to a site
• Add at least 1 student to each site.  Multiple students should be added ; add multiple students to at least 1 site to fulfill the requirements for testing as a Teaching Assistant and to simplify the process of testing many student test conditions..                 

Evaluation Dashboard

The Evaluations Dashboard provides a summary of group information and the current status of your evaluations. Links at the top of the page when selected will display the following:

...

• Instructions- Instructions for completing the test plan and preliminary steps that are necessary to complete before testing features in the test plan.
• Create Items - Test scripts that focus on creating, modifying and removing items.  These are the questions or statements which the evaluator responds to.
• Create Templates - Templates store items in a layout and are used to create evaluations.  This page contains test scripts for creating and editing templates.
• Create Evaluations - Test scripts that focus on authoring assessments. The conditions will focus on creating new and updating previously creating evaluations.

K. Check evaluation

...

• evaluations

...

L. Change evauation (BEFORE Start Date)

1. Change an existing order START_DATE or END_DATE
2. Change an existing order - Template change.
3. Instructor changes existing order. Add/Remove an Instructor question.
4. Add/Remove an Instructor
5. Remove an existing evaluation.

M. AFTER Start Date and BEFORE End date

1. "Evaluations are Available"  and email notifications are generated to students and instructors.
2. Change existing order End Date should not be an available option.
3. Add or remove students from the roster for a course
4. Remove an eval should not be an available option

N. Teaching Assistant - User is a student (evaluator) and an instructor (evaluatee)  

The following default setting must be turned on in EvalSys > Administrate, "Enable Teaching Assistant Item category"    

1. Log into Sakai as an instructor who is teaching courses and currently enrolled for at least one course. Both the course that the instructor is teaching and the course that the instructor is taking has evaluations created.
2. Click on the Evaluation link in the left menu.
3. Instructor clicks on a link under the "Groups I can be evaluated in."  Can only preview the evaluation.
4. Instructor clicks on a link under the "Groups I can evaluate" and completes the evaluation.
5. Click Submit

O. User is an instructor (evaluatee) only. The following tests require the tester to become an instructor that matches each test condition.

1. Login as an instructor who is teaching one course but not enrolled for any courses
2. Click on the Evaluation link in the left menu.
3. Evaluation for the course displays under "Groups I can be evaluated in."
4. Open evaluation.  Instructor can view questions for all instructors teaching the course, but is unable to edit questions or submit.
5. Login as an instructor who is teaching multiple courses.
6. Click on the Evaluation link in the left menu.
7. Evaluation links display for all courses.
8. Open evaluations.  Instructor can view questions for all instructors teaching the course, but is unable to edit questions or submit.

P. General Student Conditions. The following tests require the tester to become a student that matches each test condition.

1. Log in as a student who is taking courses but no evaluations have been assigned. The Evaluation tool is not listed in the menu.
2. Create an evaluation for a class that the student is taking.  Student receives an email notification for the evaluation.  (NA for 1.3.0 testing)
3. Log in as a student who is enrolled in multiple courses to which an evaluation has been assigned.
4. Click on Evaluation tool in the left menu.  Should not have options to add an evaluation or create templates.  Student sees evaluations under "Groups I can evaluate."
5. It is between the start date and end date. The evaluation has an active link.
6. Click on link.  The correct evaluation appears for the class.
7. Complete evaluation and click Submit. The evaluation is submitted and the student is taken to the main evaluation dashboard.
8. Student clicks on the link for another active evaluation. – The correct evaluation appears for the class.
9. Answer a few of the questions and Submit (SAVE is not an option).
10. Open the above evaluation. – The completed answers appear in the evaluation.
11. Answer the rest of the questions and click the submit button.  The evaluation is submitted and the student is taken to the main evaluation dashboard.  Can submit multiple times through the End Date.
12. Student clicks on the link for another active evaluation. – The correct evaluation appears for the class.
13. Student has an evaluation that has not been taken and it is past the end date. – Link for the evaluation is inactive. Status = Closed.
14. Student has an evaluation but it is prior to the start date. – Students should not see evaluations until after the Start Date.
15. Student has an evaluation which has not been taken two days past the start date. – Student receives an email reminder containing a link to the evaluation. (NA for 1.3.0 testing)
16. Student clicks on the link in the email. – Student is taken to a login page. (NA for 1.3.0 testing)
17. Student logs in. – Student is taken to the evaluation. (NA for 1.3.0 testing)
18. Student is taking a class with only one instructor.  Student sees the correct instructor name listed on the evaluation and questions appear one time.
19. Student is taking a class with only multiple instructors.  Student sees both instructor names listed on the evaluation and questions appear once for each instructor.
20. Once a student submits an evaluation, email reminders should stop.  – Verify that a student does not receive an email reminder during the evaluation period. (NA for 1.3.0 testing)
21. Logout as a student and login as an instructor in one of the above classes where an evaluation has been submitted.
22. Click on the Evaluation link in the left menu. – Verify that the count of submitted evaluations changed.

Q. AFTER End Date

...

• .

...

• General Student Conditions - Test scripts that focus on student submissions and email notifications.

...

Re-order question block using menus Re-ordering blocks with drop-down menus is not implemented in 1.3.x

1. Go back and edit template.
2. Try to reorder the items inside a bock of items by using the drop-down menu box for the numbered items.
3. Exit edit mode and re-enter template and determine if order was saved.
4. Preview template to be sure the order of items is displayed correctly.
5. Go back to template edit view (from preview mode) and make sure order is still retained.

...