For calculated question, "correct" answer feedback not accurate
Description
Attachments
- 11 Jun 2013, 02:40 PM
- 21 Sep 2012, 07:35 AM
- 21 Sep 2012, 07:35 AM
Activity
Hudson CI Server August 5, 2015 at 9:20 PM
SUCCESS: Integrated in sakai-10-java-1.7 #221 (See http://builds.sakaiproject.org:8080/job/sakai-10-java-1.7/221/)
https://sakaiproject.atlassian.net/browse/SAM-1816#icft=SAM-1816 merge PR 682 from git (enietzel@anisakai.com: rev 320398)
Angel Nueda Lozano July 6, 2015 at 5:10 AM
Tested in https://trunk-mysql.nightly.sakaiproject.org
It works as expected.
Angel Nueda Lozano June 15, 2015 at 6:09 AMEdited
Tested in http://sakai-trunk.atica.um.es
It works as expected.
Prior to editing points...
When a student answers correctly the question is marked as correct (green checkmark)
When a student fails his answer the question is marked as incorrect (red 'x')
The same after decreasing points
Note: Grading the question, in Questions view, if I grade manually decreasing the grade, both correct and incorrect answers are marked as correct.
I think this behavior is the same for all types of questions and it doesn't invalidate the result of this test.
Juan Rodríguez de Vera Mouliaá May 11, 2015 at 7:23 AMEdited
The behaviour for marking the answer correct or incorrect is pretty basic:
If the points awarded to the student are greater than zero, every answer in that question is marked as correct. Otherwise, the answer is not marked.
The behavior has been redefined to mark each answer according to the actual response introduced by the student
It is possible to verify in our Sakai 11 QA nightly:
http://sakai-trunk.atica.um.es/
If everything is OK, I will make the pull request
Nathan Francis June 11, 2013 at 2:40 PM
The bug appears to be with the display of the icon for correct (green check mark) and wrong answers (red 'x'). When viewing all student responses for a specific Calculated Question both are displayed (green checkmarks and red 'x's), but when viewing a specific students responses, correct responses are marked with the green check mark icon and wrong responses are not marked (i.e. no icon is displayed). When the points assigned to a student response is manually changed by the instructor, all responses are marked correct (with the green checkmark) even wrong responses. This is even true if the points awarded is decreased; still all responses for that student will be marked as correct (see screenshot montage).
Steps to Reproduce:
1. Create assessment with a question of type "Calculated Question" with multiple student responses in the one question. Set Feedback to allow students to see what the correct answers are.
2. Take the assessment as a student and do not answer all the parts correctly.
3. Look at the student view and instructors view.
4. Modify the points awarded to the student.
This appears to be a similar issue as one in "Fill In The Blank" questions in https://sakaiproject.atlassian.net/browse/SAM-1994#icft=SAM-1994
Our distribution of the Sakai CLE now includes the calculated question type (we pulled in this feature only, not the entire 2.9 Samigo).
We have an instructor reporting incorrect feedback for calculated questions--the student response is marked as correct (green check) when it's not. Note, the answer is not being scored as correct; the issue is only the "correct" (check) icon being displayed.
I haven't been able to replicate this issue, but the instructor has provided a screenshot. I have also provided a screenshot of the question setup.