2.6 Evaluations Tool Help

Evaluations Overview

The Evaluations tool allows users with appropriate permission to evaluate work in a wizard page or matrix cell after it has been submitted for evaluation by a site participant. If you are an evaluator, you use this tool to access the appropriate part of a participant's wizard or matrix, review the work shown there, and provide an evaluation of it.

As an evaluator, you enter your ratings and comments in an evaluation form. This form is created by the CIG Coordinator (site organizer or other user in that role). By carefully designing evaluation forms for wizard pages and matrix cells, the CIG Coordinator can incorporate your institution's existing evaluation practices and assessment rubrics, such as evaluation scales and prompts for subjective evaluation, into the process of evaluating wizards and matrices.

To ensure effective reporting and avoid confusion, we strongly recommended that your institution standardize evaluation scales across all wizard pages and matrix cells and across all wizards and matrices.

After you have evaluated a page or cell, your ratings and comments are available to the participant whose work you have evaluated. Your evaluation is also available to other site members who have permission to evaluate or review the page or cell.

The home page contains a list of participant work that is ready to be evaluated. For each title, the list contains its owner (if you have permission to see the name of the owner), the date the work was submitted, and whether the work is contained in a matrix cell or wizard page.

If the list is longer than one page, use the buttons near the top of the screen to find the item you want.

• To display the first page of the list, click First.
• To display the previous page of the list, click Previous.
• To display the next page of the list, click Next.
• To display the last page of the list, click Last.

Evaluating Submitted Work

To review submitted work, access the Evaluations tool and follow these steps:

1. If the Evaluations home page is not displayed, click the Reset button.
2. Click the desired title in the list. Sakai displays the appropriate matrix cell or wizard page for the title you have selected.
3. Review the instructions and all forms and other attachments that have been submitted. Note: To return to the Evaluations home page at any time, click the Reset button.
4. In the Evaluation section, click the Add Evaluation link.
5. Complete the boxes in the form. Be sure to enter a title for your evaluation. This entry is required.
6. To add your comments, click the Add button. Sakai attaches your comments to the participant's wizard page or matrix cell and redisplays the Evaluations home page. Or, to return to that page without attaching comments, click Cancel.

Changing Permissions

Permissions are more complex for evaluators than for most other site members. In order for you to act as an evaluator of work in a specific matrix cell or wizard page, the following conditions must be met:

• You must be assigned the role of evaluator on this site.
• On the specific matrix cell or wizard page, your role or your user name must be specified as an evaluator.
• Your role must have "evaluate" permission in both the Matrices or Wizards tool and the Evaluations tool

To change the default permissions for the Evaluations tool, access the tool and follow these steps:

1. If the Evaluations menu bar is not displayed, click the Reset button.
2. Click the Permissions button on the menu bar. Sakai displays the Permissions screen.
3. Referring to the table below, check boxes to select the appropriate permissions for users in each role.

4. To save the permissions settings, click save. Sakai saves the settings and displays the Evaluations home page. Or, to return to that screen without saving your changes, click cancel.

Editing / Removing Evaluations

To edit or remove submitted evaluations, access the Matrices tool and follow these steps:

1. Click within the matrix cell where your evaluation form is located.
2. In the Evaluation section, click the Edit or Remove link.
3. If you click on the Remove link, your evaluation will be removed immediately.
4. If you click on the Edit link, to add your changes, click the Save Changes button.

Aggregating Evaluations across sites via My Workspace

To aggregate evaluations across sites, access the My Workspace site and follow these steps:

1. If your My Workspace does not have an Evaluations tool listed, click on the Site Info tool.
2. Click on the Page Order link located on the Site Info menu bar.
3. Click on the Add page(s) to your site link located on the Site Info menu bar.
4. Check the box next to the Evaluations tool.
5. Verify that the Evaluations tool has been added and is in your preferred page order.
6. Click on the Save button.
7. Once the Evaluations tool has been added to your My Workspace, click on the Evaluations tool to manage evaluations across all sites.
8. Follow the steps for Evaluating Submitted Work.

Note: Different institutions may or may not enable the Evaluations tool in My Workspace.  If the Evaluations tool has not been enable in My Workspace, if Site Info is not a tool in My Workspace, or if the Evaluations tool does not appear in Edit Tools in My Workspace Site Info, then you will need to ask your system admin to modify the template for your My Workspace site. Additionally, the Evaluations tool by default only appears in My Workspace for maintain-level users.