samigo: feature request:Partial credit for Multiple Choice, Multiple Correct questions
Description
Activity
Mark Golbeck August 22, 2024 at 5:32 PM
Since it's been over two years without any further information provided, we're closing this Jira issue for now. If more details become available in the future, we can reopen it. Thank you.
Tiffany Stull February 7, 2018 at 2:46 PMEdited
My understanding is that the problem with the existing Right Less Wrong option is that it is too complex! This new method suggested is more in accordance with other question types' scoring. You earn points for each correct answer selected. You earn points for each incorrect question NOT selected.
Here's another example of the proposed scoring method:
If a question with 3 possible answer options is worth 6 points, each answer option is worth 2 points.
The following are even numbers:
A. 1 (incorrect - you get 2 points if you do NOT select this answer)
B. 2 (correct - you get 2 points if you DO select this answer)
C. 4 (correct - you get 2 points if you DO select this answer)
Student Selects | Student Scores |
|---|---|
B and C only | 6 points (full credit for selecting both right answers and ignoring the wrong one) |
A and B | 2 points (+2 points for selecting B, but no credit for ignoring A or selecting C) |
A only | 0 points (you didn't select any correct answers, only the wrong one) |
Nothing selected | 0 points (the question wasn't answered - even though ignoring the wrong answer would technically give points, points should only be awarded for correctly ignored wrong answers if at least one other answer is selected) |
The second row in the table above is where this proposed scoring method differs from Right Less Wrong. Because Right Less Wrong assigns points only to correct answers, awards points for selecting correct answers, and removes points for selecting incorrect answers, the student in Row 2 above would get 0 points = +3 points earned for selecting the right answer, -3 points for selecting the wrong answer.
Laura Gekeler February 7, 2018 at 2:31 PM
I would like to see feature requests that reduce complexity, not increase it. Is it possible to see a mock up of how this would be implemented? Help Text? ~LauraG
Tiffany Stull February 7, 2018 at 8:52 AM
Yes, I'm advocating to *add* this *new* scoring type, to have a scoring method that makes the multiple choice, multiple selection question behave like other question types with multiple answers (fill in the blank and matching).
I'm not recommending to change the existing right less wrong scoring that instructors with whom I've spoken generally dislike. I understand some institutions prefer to penalize students for selecting incorrect answers.
Neal Caidin February 7, 2018 at 8:44 AM
Okay, I updated the description but maybe I updated it incorrectly. You responded to my previous comment as "that's right" which I took to mean I was understanding it right. But reading this again it seems like you are not advocating to change Right less Wrong, but simple to allow Partial Credit on this question type, in addition to the existing Right Less Wrong option. ?
This is a request for a new feature: Partial credit for the Multiple Choice/Multiple Selection question type.
In this new Partial Credit option, scoring for the question would function similar to that of _Fill in the Blank_ and _Matching_ questions. The *total point value* of the question is divided by the number of answer options, BOTH correct and incorrect.
Following the logic of the proposed scoring method, if at least one correct answer has been selected, a student will get partial credit for either selecting the correct answer or correctly ignoring wrong answers.
More details and an example:
The existing _Multiple Choice, Multiple Correct_ scoring option of *Right Less Wrong* is unfavorable to many instructors. In Right Less Wrong scoring, the total point value of the question is divided by the number of Correct answers. Points are subtracted from the score for either failing to select a correct answer OR selecting an incorrect answer, with minimum point value of 0 if this would technically render the resulting score negative.
An instructor at UVA proposes the following new scoring option for _Multiple Choice, Multiple Correct_ *Partial Credit* (apologies for the bulleted list - I couldn't make JIRA give me a numbered list with letters instead of numbers. "Correct minus Incorrect" is a renamed "Right Less Wrong" question - no one understood what "Right Less Wrong" meant):
A. Dog
B. Cat
C. House
D. Mug
E. Pig
F. Monkey
Based on comments below, I'm adding another example of the proposed scoring method to hopefully clarify:
If a question with 3 possible answer options is worth 6 points, each answer option is worth 2 points.
The following are even numbers:
A. 1 (incorrect - you get 2 points if you do NOT select this answer)
B. 2 (correct - you get 2 points if you DO select this answer)
C. 4 (correct - you get 2 points if you DO select this answer)
Student Selects
Student Scores
Why this Score?
B and C only
6 points
Full credit for selecting both right answers and ignoring the wrong one
A and B
2 points
+2 points for selecting B, but no points earned for ignoring A or selecting C.
A only
0 points
You didn't select any correct answers, only the wrong one.
Nothing selected
0 points
The question wasn't answered. Even though ignoring the wrong answer would technically award points, points should only be awarded for correctly ignored wrong answers if at least one other answer is selected.
The second row in the table above is where this proposed scoring method differs from Right Less Wrong. Because Right Less Wrong assigns points only to correct answers, awards points for selecting correct answers, and removes points for selecting incorrect answers, the student in Row 2 above would get 0 points = +3 points earned for selecting the right answer, -3 points for selecting the wrong answer.