Multiple evaluator workflow related requirements

This is a list of requirements that were distilled from the Multiple Evaluator Workflow (MEW) user stories. Altough these requirements are related to MEW it may not be neccecery to implement all these requirements in order to get the MEW functionality.

ID

Description

Priority

1

Evaluators should only see students they are assigned to evaluate (this may achieved with the group-aware function implemented in Sakai 2.5)

 

2

Students should optionally receive a notification when evaluations become available.

 

3

Evaluators should optionally receive a notification when they are required to provide an evaluation.

 

4

Evaluators should be able to save evaluation forms in an in-progress state for later completion.

 

5

Evaluators and administrators should be able to remove evaluation forms while the cell / portfolio is under evaluation.

 

6

Evaluation forms (either complete or incomplete) should only be visible for the student when the cell/portfolio is not under evaluation.

 

7

Cells that have been evaluated once (but were found unsatisfactory) should be distinguishable from ones that have never been evaluated (Add visual status for INCOMPLETE/RETURNED/REJECTED?). Should store the number of resubmissions. If number of resubmissions is high, perhaps assignment is unclear.

 

8

Evaluators should have an overview of cells/portfolio's that are pending evaluation, in-progress evaluations or resubmitted.

 

9

Evaluators should be able to return a cell to the student without completing an evaluation form (e.g. when the student accidentally submits a matrix cell for evaluation).

 

10

Like matrix cells portfolio presentations should remain locked while the student's portfolio is under evaluation. (Syracuse)

 

11

Each time a portfolio presentation is submitted for evaluation a snapshot should be created of its current state (creating multiple versions of the portfolio). (Syracuse)

 

12

Evaluators should be able to browse and compare all available versions of a student's portfolio when evaluating. (Syracuse)

 

13

It should be possible to select a different evaluation form for each evaluator when using multiple evaluators.

 

14

It should be possible to set the number of evaluations that are required before the cell status is set to COMPLETED.

 

15

It should be possible to hide the identity of the student under evaluation.

 

16

The cell / portfolio status (OPEN / PENDING EVALUATION / COMPLETE) and rating (eg. PASS / FAIL) should be separated. (UIPUI / rSMART).

 

17

Evaluators should be able to decide if the student can resubmit a cell / portfolio after the workflow has been completed (restart workflow).

 

18

It should be possible to set if evaluators are able to read evaluations from other evaluators

Â