Tests & Quizzes: Feedback settings should specify "Rubrics"

Description

In Tests & Quizzes, the feedback options are:

  • Student Response

  • Correct Response

  • Question-Level Feedback

  • Selection-Level Feedback

  • Grader's Comments

  • Student's Question and Part Scores

  • Student's Assessment Scores

  • Statistics and Histograms

Which of these options allows students to see a graded rubric? It's Question-Level Feedback, but there is nothing here that indicates that. I would like to see this option renamed to "Question-Level Feedback & Rubrics (not hidden from students)" or to have "Rubrics (not hidden from students)" as it's own feedback option to select to help make the settings clear to instructors. 

Activity

Show:

Christina Schwiebert June 25, 2021 at 7:01 AM

I agree that having Rubrics as its own separate feedback option would be the ideal solution. I included the possibility of simply renaming the feedback option as the 'easy' fix, as it would not change the functionality at all, just text.  

I also can see John's perspective, especially as instructors can provide comments for the rubric criterion that are not affected by the selection of the Grader's Comments feedback item. Instead of changing which feedback option Rubrics are associated with, it may at this point be a similar amount of work (but easier testing) to have rubrics be it's own feedback option. 

Tiffany Stull June 24, 2021 at 4:33 PM
Edited

I don't think simply changing the label is helpful. Some institutions (like UVA) do NOT have rubrics enabled. In these cases, it would not be correct to have a label that includes them.

In my opinion, the following should be done:

  1. Dissociate Rubrics from all other feedback options, to allow them to be their own checkbox and selected independently. This would also allow for the very valid use case of releasing question-level feedback for auto-graded questions prior to grading manually-graded questions with rubrics.

  2. Make the Rubrics checkbox ONLY appear in Settings if the Rubrics tool is included in the site where the assessments are created.

  3. Create a conversion script for existing instances that will do the following: if assessment has rubrics attached and "Question-Level Feedback" enabled, automatically check "Rubrics" in all affected assessments. This may only need to be done in the published assessments DB table, as instructors will be able to fix working copies ("drafts") prior to publication.

Reasoning:

  • Instructors are extremely picky about what they release as feedback and when. We frequently get the following requests from instructors (#1 below is requested by multiple instructors, and some use very complex and cumbersome workarounds of exporting a CSV from Samigo, modifying it, and importing it into Post'Em to accomplish the goal):

    1. Show only the questions students answered incorrectly as feedback - SAK-44333.

    2. Show correctness (checkmark/red X) as feedback WITHOUT showing Answer Key - SAK-40527.

    3. Reveal assessment-level comments WITHOUT showing question text - SAK-34711.

    4. Allow feedback during assessment, but don't allow student to change their answer to a particular question after viewing the feedback for that question - SAK-34704.
      Splitting off rubrics to its own option would reduce confusion and allow instructors greater control of when they reveal rubrics vs. other feedback types.

  • Discussing with , he mentioned that Rubrics should be considered Grader's Comments rather than Question-Level Feedback, because the instructor must take action on the grading pages to enter scores/comments with rubrics. While I agree with John, changing which radio button they are associated with may cause problems for existing assessments with rubrics, which may not be easily fixed programmatically.

I also wanted to note that one of the requested changes in would be to group the feedback options into smaller groupings/under headings to make them easier to use. In this case, I think Rubrics would best go under the proposed section grouping of "Comments".

Shawn Foster November 2, 2020 at 1:57 PM

Adding the "TL" label for them to discuss what the option wording should be.

Details

Priority

Affects versions

Assignee

Reporter

Labels

Created October 28, 2020 at 10:04 AM
Updated June 25, 2021 at 10:46 AM