QA.Improving the User Interface

Improving the User Interface

Test Preparation

To use the scripts in this section (Improving the User Interface), you will need access to an established portfolio worksite on an OSP test server; user accounts for the coordinator, evaluator, and student roles; and several published and unpublished wizards and matrices. If this environment does not already exist, follow these steps to create it.

Steps	Description	Expected Outcome
1	Create three user accounts on a http://qa2-osp.sakaiproject.org:8084/osp-portal or http://nightly2.sakaiproject.org:8084/osp-portal; These accounts will be assigned to the coordinator, participant, and evaluator roles in the portfolio site, so you may wish to name them accordingly (e.g., your_name_coord, your_name_student, your_name_eval).
2	Log in using the coordinator account and create a new portfolio site.
3	Add the student and evaluator users to the site and assign to the CIG Participant and CIG Evaluator roles respectively.
4	Download the attached sample matrix: PUL Matrix.zip
5	Click Import from the options area at the top of the Manage Matrices page	The 'Import Scaffolding' page appears.
6	Click Choose File... next to 'Import File'.	The Resources area appears
7	Click Add, and then Upload Files from the menu.
8	File to Upload: Click Browse to locate PUL Matrix.zip. Click Upload Files now	The 'Upload Files' screen is displayed, user selects file to upload, then user's file appears on the 'Add Attachment' screen under 'Items to attach'.
9	Click Continue	The 'Import Scaffolding' page re-appears with your .zip file appearing in the 'Import file' textbox.
10	Click the Import Scaffolding button to complete the import.	The matrix should import without error and you should now be on the 'Revise Matrix Properties' page where you can update the title and other attributes of the matrix
11	Click Save Changes.	The 'Edit Matrix' page is shpwn.
12	Click Return to Return to List.	The "Manage Matrices" page is displayed, and the 'Preview' link should be available.
13	Click Preview in the row of the newly imported matrix.	The Preview link is replaced with a Publish link
14	Click Publish in the row of the newly imported matrix. Then click Continue to publish the matrix.	The status of the matrix is now "Published".
15	Download the attached sample wizard: PUL Wizard.zip
16	Click Import from the options area at the top of the Wizard Manager page	The 'Import Wizard' page appears
17	Click Select files next to the field 'Name'	The Resources area appears.
18	Click Add, and then Upload Files from the menu.
19	File to Upload: Click Browse to locate PUL Wizard.zip. Click Upload Files now	The 'Upload Files' screen is displayed, user selects file to upload, then user's file appears on the 'Add Attachment' screen under 'Items to attach'.
20	Click Continue	The 'Import Wizard' page re-appears with your .zip file appearing in the 'Name' textbox.
21	Click the Import button at the bottom of the page to complete the import.	The wizard should import without error and you should now be on the 'Wizard Manager' page where you can click Revise to update your wizard properties. 'Preview' link should be available.
22	Click Preview in the row of the newly imported wizard.	The status of the wizardis now "Published".
23	Click Publish in the row of the newly imported wizard. Then click Continue to publish the wizard	The status of the wizardis now "Published".
24	Click Permissions, add View and Evaluate to the CIG Coordinator's permissions and click Save.	The Manage Wizards page appears. Adding these permissions will minimize the number of users that must log in for a given script.

Autonaming Forms

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

Specification: OSP-SPEC-#
Script author: Lynn Ward
Purpose: To verify that completed forms have unique names/titles when two or more copies of same the form are saved by the same user.

Steps	Description	Expected Outcome
1	As the student, click Collect and Reflect from the tools menu.	Links to the tools in this category (matrices, wizards, resources) appears.
2	Click Matrices to open the Matrices tool.	The "Manage Matrices" screen appears.
3	Click PUL Matrix to open the sample matrix.	The PUL matrix opens, displayings learning outcome labels for each row and developmental level labels for each column.
4	Click cell one/column one (core skills:writtem communication/introductory) to enter the cell.	The page for that cell appears showing empty regions for items, reflection, general feedback, and evaluation.
5	Click Add Expectation, enter sample text into the Expectation form, and click Save Changes.	Return to the main page for the cell. the saved form is listed under "Expectaion" with a name like "PUL Matrix- Core Skills: Written Communication - Introductory -Expectation "
6	Repeat step 5 two or three times to create additional instances of the form.	same as above
7	Examine the filenames in the "Items" area of the cell.	The name of the second second expectation form should be followed by a "(2) and the third should be followed by a "(3)"
8	Click Submit for Evaluation confirmation and confirm.	Matrix cell should turn from green to yellow.
9	Log out as student.	Return to the login screen.
10	Log in as evaluator and open the Matrices tool under Collect and Reflect.	The Manage Matrices screen appears.
11	Click PUL Matrix to open the PUL Matrix.	he PUL matrix opens, displayings learning outcome labels for each row and developmental level labels for each column.
12	Open the username pulldown and select the student from the list of site members.	The message "Viewing the READ ONLY matrix of Student_Name" should apprea immediately above the Matrix.
13	Click on the yellow (pending) cell.	The main page for that cell appears.
14	Click Add Evaluation, fill out the form, and click Save changes.	The "Status and Progression" screen appears.
15	On the "Status and Progression" screen under "Choose workflow option," select No changes to status and click Submit. By leaving the cell in the pending state, the evaluator can create and submit another evaluation.	You will be returned to the data entry screen for the evaluated cell.
16	Repeat steps 14 and 15 two or three more times.	sam as above
17	Examine the filenames in the "Evaluations" area of the cell.	The name for the secodn second evaluation should be followed by a "(2), the third should be followed by a "(3)", and so on.
18	Go to "Resources" in "My Workspace" and locate the evaluations files in the "Portfolio Interactions" folder. Verify that the numbers at the end of the filenames were properly sequenced.	The names of all but the first file should end with a number in parentheses and the numbers should increase by one from oldest to newest.

Wizard Dropdown User List

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

Specification: OSP-SPEC-#
Script author: Lynn Ward
Purpose: To verify that the dropdown user list in the Wizards tool has been moved from the main Manage Wizards page to the first (or main) page of each Wizard and that the list is sorted alphabetically. In release 2.4, the drop-down list of users in the Wizards tool was not sorted alphabetically and the order changed with each refresh.

Steps	Description	Expected Outcome
1	As the CIG Coordinator, click Collect and Reflect from the tools menu.	Links to the tools (matrices, wizards, resources) in this category should display.
2	Click Wizards to open the Wizards tool.	You should not see a dropdown list of usernames.
3	Click the title of a published wizard.	You should see the first (or main) page of the selected wizard. The dropdown list of usernames should appear jsut beneath the wizrad title and description.
4	Open the drop-down menu and note the order of the names in the list.	The list names should be sorted in alphabetical order.
5	Click the refresh icon ( ), return to the wizard selected in setp #3, and note the order of names in the list.	The list of names should still be in alpha order.

Suppression of Unused Labels Widgets in Matrices and Wizards

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

Specification: OSP-SPEC-#
Script author: Lynn Ward
Purpose: To verify that labels and widgets associated with forms, features, and guidance fields do not display in the published view of the matrix or wizard. The CIG coordinator will populate a matrix cell with all possible forms and widgets, observe their presentation in the published matrix. Then the coodinator will edit the matrix and remove the forms one at a time. When the form is removed, the associated widgets, labels, and screen regions should no longer appear in the published matrix.

Suppression of Form Labels and Widgets and the Select Item(s) Button

Steps	Description	Expected Outcome
1	As the CIG Coordinator, click Collect and Reflect from the tools menu.	Links to the tools (matrices, wizards, resources) in this category should display.
2	Click Matrices to open the Matrices tool.	The "Manage Matrices" screen appears.
3	Click Permissions and give the CIG Coordinator "Use" permissions if "Use" is not already turned on.	Return to "Manage Matrices." CIG Coordinator can now test and add data to a matrix.
4	Click the Edit link under "PUL Matrix" to edit the sample matrix.	The "Edit Matrix" screen appears.
5	Click an unused cell, for example, row 6 column 1 (critical thinking: introductory) to enter the cell.	The "Edit Cell" screen appears for that cell.
6	Verify that forms have been assigned to Reflection, Feedback, and Evaluation. If forms have not been assugned, select a form for each category.
7	Click Save Changes to save the form settings.	Return to the "Edit Matrix Screen"
8	Click Return to List.	You should return to the Manage Matrices screen.
9	Click PUL Matrix to enter the PUL Matrix.	The PUL matrix opens, displayings learning outcome labels for each row and developmental level labels for each column.
10	Your CIG Coordinator persona should be the selected user in the dropdown user list. If not, select the CIG Coordinator from the list.	The CIG Coordinator's matrix loads.
11	Click the same cell you selected in step 5.	The main data entry screen/page for that cell appears.
12	Verify that the cell contains the following regions: Items, Reflection, General Feedback, and Evaluation.
13	Click the refresh icon ( ) to return to the "Manage Matrices" screen.	The "Manage Matrices" screen appears.
14	Click the Edit link under "PUL Matrix" to edit the sample matrix.	The "Edit Matrix" screen appears.
15	Click the same cell you selected in step 5.	The Edit Cell screen appears.
16	Unselect the current Reflection form by setting the drop down to Select an item.
17	Click Save Changes to save the form settings.
18	Click Return to List and then PUL Matrix to view the published matrix.	The "Edit Matrix" screen appears.
19	Click the same cell you selected in step 5.	The Reflections region of the screen should no longer be visible.
20	Repeat steps 13 - 15.
21	Unselect the current Feedback form by setting the drop down to Select an item.
22	Repeat steps 17 - 19.	The General Feedback region of the screen should no longer be visible.
23	Repeat steps 13 - 15.
24	Unselect the current Evaluation form by setting the drop down to Select an item.
25	Repeat steps 17 - 19.	The Evaluations region should no longer be visible.
26	Click Select items and select and/or upload one or more artifacts for the cell.	The Submit for Evaluation confirmation button should not display. Previously, this button appeared even if an evaluation form was not associated with the cell.
27	Delete all artifacts attached in step 26 by clicking Delete next to the name of each item	Links to artifacts should disappear.
28	Repeat steps 13 - 15.
29	Click the "Suppress Evidence Attachments" checkbox.
30	Repeat steps 17 - 19.	The Add Other Evidence link should no longer be visible.

Variation: Conduct a similar test on a sample wizard.

Guidance Display

Steps	Description	Expected Outcome
1	As the CIG Coordinator, click Collect and Reflect from the tools menu.	Links to the tools (matrices, wizards, resources) in this category should display.
2	Click Matrices to open the Matrices tool.	The "Manage Matrices" screen appears.
3	Click Permissions and give the CIG Coordinator "Use" permissions if "Use" is not already turned on.	Return to "Manage Matrices." CIG Coordinator can now test and add data to a matrix.
4	Click the Edit link under "PUL Matrix" to edit the sample matrix.	The "Edit Matrix" screen appears.
5	Click an unused cell, for example, row 7 column 1 (Intellectual Depth, Breadth, and Adaptiveness: Introductory) to enter the cell.	The "Edit Cell" screen appears for that cell.
6	Click Add Instructions.	The Instructions form will open
7	Add some content to the rich text field and click Save.	You are returned to the "Edit Cell" screen.
8	Repeat steps 6 and 7 for Rationale and Examples.	You are returned to the "Edit Cell" screen.
9	Click Save Changes to save the form settings.	Return to the "Edit Matrix Screen"
10	Click Return to List.	You should return to the Manage Matrices screen.
11	Click PUL Matrix to enter the PUL Matrix.	The PUL matrix opens, displayings learning outcome labels for each row and developmental level labels for each column.
12	Your CIG Coordinator persona should be the selected user in the dropdown user list. If not, select the CIG Coordinator from the list.	The CIG Coordinator's matrix loads.
13	Click the same cell you selected in step 5.	The main data entry screen/page for that cell appears.
14	Verify that the guidance you entered in steps 6-8 displays in the following order: Instructions, Rationale, Examples.	If the guidance is not visible, click the expand iconto expose it.
16	Click the refresh icon ( ) to return to the "Manage Matrices" screen.	The "Manage Matrices" screen appears.
17	Click the Edit link under "PUL Matrix" to edit the sample matrix.	The "Edit Matrix" screen appears.
18	Click the same cell you selected in step 5.	The Edit Cell screen appears.
19	Click Edit Examples, delete all text from the the Examples form, and save your changes.
20	Repeat steps 10 through 14 and verify that the Instructions and Examples content displays in the correct order, and that the label for Examples does not display.
21	Repeat stepes 16-19 and 10-14, each time populating a different combination of the three guidance forms. Verify that only the populated forms display and in the correct order.

Variation: Conduct a similar test on a sample wizard.

Managing and Displaying Cell/Page Status

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

type	status	key	summary	assignee	resolution	updated
Unable to locate Jira server for this macro. It may be due to Application Link configuration.

Specification: OSP-SPEC-#
Script author: Lynn Ward
Purpose: Several new capabilities for managing the status of individual cells and pages have been incorporated into release 2.5. Previously, the main page of a wizard did not have a Manage Status link, so status could only be changed following the evaluation of the main page. A manage status link has been added to the page. In addition, the main page now shows the status for each of the subpages of the wizard. Finally, the Manage Status link on matrix cells and wizard subpages should now give the coordinator full control over page status. The coordinator can change the status of any cell/page to ready, pending, complete, or locked for the current user or all users. The following scripts test for all of these improvements.

Manage Status of the Wizard Main Page

Steps	Description	Expected Outcome
1	As the CIG Participant (student), click Collect and Reflect from the tools menu.	Links to the tools (matrices, wizards, resources) in this category should display.
2	Click Wizards to open the Wizards tool.	The list of published a wizards appears.
3	Click PUL Wizard to open the wizard.	You should see the first (or main) page of the selected wizard.
4	Click Create a Reflection.	The Reflection form appears.
5	Enter some sample text and click Save Changes to save the form.	You are returned to the Wizard main page.
6	Click Submit for Evaluation Confirmation and the click Submit to confirm.	You are returned to the "Manage Wizards" page.
7	Click PUL Wizard and verify that you can no longer edit the main page.	You can view, but not edit your reflection. Also, a status message at the top of the page should read "Status is Pending and cannot be altered".
8	Click Return to Wizards.	The "Manage Wizards" page appears.
9	Open a new instance of your browser or a different browser in login as CIG Coordinator.
10	Go to your test portfolio site and click Collect and Reflect from the tools menu.	Links to the tools (matrices, wizards, resources) in this category should display.
11	Click Wizards to open the Wizards tool.
12	Click PUL Wizard to open the wizard.	The main page of the wizard displays. A Manage Wizard Status link appears at the upper left.
13	Choose the CIG Participant name from the username pulldown.	The main page of the CIG Participant's wizard displays and the Add Evaluation link is visible, indicating that the page is in pending status. Also, a status message at the top of the page should read "Status is Pending and cannot be altered".
14	Click Manage Wizard Status.	The "Manage Wizard Status" screen appears.
15	Set the page status to "Ready" and click Continue.	You are returned to the main page of the Participant's wizard and the Add Evaluation link is no longer visible.
16	Return to the Participant browser window.	You are on the "Manage Wizards" page.
17	Click PUL Wizard.	You should see the first (or main) page of the selected wizard. Your main page has been returned to Ready status.
18	Verify that you can edit your reflection.
19	Click Return to Wizards.	The "Manage Wizards" page appears.
20	Return to the CIG Coordinator browser window.	The main page of the participant's wizard displays.
21	Click Manage Wizard Status.	The "Manage Wizard Status" screen appears.
22	Set the page status to "Pending" and click Continue.	You are returned to the main page of the Participant's wizard and the Add Evaluation link is visible. Also, a status message at the top of the page should read "Status is Pending and cannot be altered".
23	Return to the Participant browser window.	You are on the "Manage Wizards" page.
24	Click PUL Wizard.	You should see the first (or main) page of the selected wizard. Your main page has been set to Pending status. You should no longer be able to edit your reflection.
25	Click Return to Wizards.	The "Manage Wizards" page appears.
26	Return to the CIG Coordinator browser window.	The main page of the participant's wizard displays.
27	Click Manage Wizard Status.	The "Manage Wizard Status" screen appears.
28	Set the page status to "Complete" and click Continue.	You are returned to the main page of the Participant's wizard and the Add Evaluation link is no longer visible. Also, a status message at the top of the page should read "Status is COMPLETE and cannot be altered".
29	Return to the Participant browser window.	You are on the "Manage Wizards" page.
30	Click PUL Wizard.	You should see the first (or main) page of the selected wizard. A status message at the top of the page should read "Status is COMPLETE and cannot be altered".
31	Click Return to Wizards.	The "Manage Wizards" page appears.
32	Repeat steps 20-31, this time changing the status of the page to locked.	The participant should not be able to edit his/her reflection and the coordinator should not be able to add an evaluation. The status message at the top of the participant's main page should read "Status is COMPLETE and cannot be altered".

Variant: repeat with a squential wizard.

View and Change Status of Wizard Subpages

Steps	Description	Expected Outcome
1	As the CIG Coordinator, click Collect and Reflect from the tools menu.	Links to the tools (matrices, wizards, resources) in this category should display.
2	Click Wizards to open the Wizards tool.	You should not see a dropdown list of usernames.
3	Click PUL Wizard to open the wizard.	You should see the first (or main) page of the selected wizard. The dropdown list of usernames should appear jsut beneath the wizrad title and description.
4	Select names from the dropdown wizard and view the main page of each user.	The status of each subpage should be given in parenthesis next to the page title.
5	Select the CIG Participant name from the dropdown.	The main page of the participant's wizard should appear. Note the status of "PUL 1: Criterion 1".
6	Click PUL1: Criterion 1 to open that page in the participant's wizard.	The subpage PUL1: Criterion 1 appears.
7	Click Manage Status.	The "Manage Status" page appears.
8	Change the status to "Locked" "For this user only" and click Continue.	The participant's subpage PUL1: Criterion 1 appears with the following message at the top of the page " Status is LOCKED and cannot be altered"
9	Click Back to Wizard.	You are returned to the wizard main page.
10	User the username dropdown to note the status of "PUL 1: Criterion 1" for each user.	The participant's subpage PUL1: Criterion 1 appears with the following message at the top of the page "
11	Select the CIG Participant name from the dropdown.	The main page of the participant's wizard should appear.
12	Click PUL1: Criterion 1 to open that page in the participant's wizard.	The subpage PUL1: Criterion 1 appears.
13	Click Manage Status.	The "Manage Status" page appears.
14	Change the status to "Pending" "For all users" and click Continue.	The participant's subpage PUL1: Criterion 1 appears with the following message at the top of the page " Status is PENDING and cannot be altered"
15	Click Back to Wizard.	You are returned to the wizard main page.
16	User the username dropdown to note the status of "PUL 1: Criterion 1" for each user.	The status of "PUL 1: Criterion 1" should now be PENDING for all users.
17	Repeat steps 11-16 using different status and all/for this user only selections.	Each time, verify that the correct status has been applied to the correct user (or all users)

Repeat for the PUL Matrix using cell color to determine status.