Description
Environment
Test Plan
Attachments
- 08 Feb 2019, 09:56 AM
is duplicated by
relates to
Activity
Andrea Schmidt July 18, 2019 at 6:36 PM
Yes, this Jira passed. I just now was able to verify the numeric question type also passes since the fix for https://sakaiproject.atlassian.net/browse/SAK-42108#icft=SAK-42108 is now there.
https://experimental.nightly.sakaiproject.org, build: a5022f69
Tiffany Stull July 18, 2019 at 6:13 PM
Just to clarify: none of the issues that @Andrea Schmidt identified in testing this jira were introduced by the changes here.
They are fellow children of the parent SAK-40476, and are UI/accessibility issues that already existed in the original implementation of the feature.
Andrea Schmidt July 15, 2019 at 7:39 PMEdited
I followed the test plan (several different builds because the testing took so long) and there are a few issues:
Related to this Jira: SAK-42111, https://sakaiproject.atlassian.net/browse/SAK-42135#icft=SAK-42135
Numeric question couldn't be tested due to https://sakaiproject.atlassian.net/browse/SAK-42108#icft=SAK-42108
The random draw results in both cases were as expected, both in the instructor and student view.
The minimum point value equal to or lesser than the question point value works.
David Hutchins April 5, 2019 at 3:55 PM
PR opened.
Tiffany Stull February 6, 2019 at 9:20 AM
I am in the process of testing this locally at UVA. There have been no issues, but because samigo is such a complex tool, I like to give scoring a good workout whenever there are changes to it to make sure everything is working well.
Something went wrong on our end
If this keeps happening, share this information with your admin, who should contact support.
Hash VJ6BCU
Note: To make the initial testing steps below easier for QA, I have attached
that you can import into a site. As per SAK-40464: samigo: Export/Import ignores minimum point valuesOpen (another subtask of this jira's parent), you cannot directly import assessments with min values included from a zip/xml file.
Ensure *samigo.allowMinScore = true* is set on the server where you are testing.
Access the Tests & Quizzes tool in a site, and create or edit a quiz.
Create or edit each of the following question types in which the minimum point value option appears:
Short Answer/Essay
Matching
Multiple Choice
True/False
Fill in the Blank
Numeric Response
For each question:
Enter a value into the Answer Point Value box.
Try entering a negative number into the Minimum Point Value box, then either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm that the negative Min Value is not allowed.
Try entering a number greater than the the Answer Point Value, then either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm that the Min Value greater than total points is not allowed.
For True/False and Multiple Choice, also confirm that Min Value CANNOT be enabled at the same time as either of the following:
Negative marking/points deducted for incorrect answer
Partial Credit (on multiple choice, single selection)
Enter the same value as Answer Point Value into the Minimum Point Value box.
Either click out of the Min Value box or use the Tab key to navigate to the next box on the page, and confirm the Min Value EQUAL to total points remains.
Save the question.
Go to the Settings for the quiz, and edit as follows:
Make it Unlimited Submissions
Grading and Feedback > Feedback on Submission > include:
Student Response
Correct Response
Assessment Scores
Question and Part Scores
Log in as student and submit the quiz several times, and check feedback to confirm the points are correct, as follows:
Submit blank (should get 0 points)
Answer all questions incorrectly (should get full credit because min value is full points)
Answer all questions that would normally give partial credit for a partially-correct answer such that you would normally get less than full credit - for example, answer the matching question with one correct and one incorrect match (should get full credit because min value is full points).
Answer all questions correctly (should get full credit)
Log in as instructor and check the Published Copies > Scores.
View > All Submissions.
Go to Questions and access each question page. Make sure the points for the submissions are accurate per above.
Additional Steps for QA: Do some general testing of the scoring for other combinations of min/total points - i.e., confirm the following for ALL question types:
If there are no min points entered, questions are scored correctly/normally, based on correct and incorrect answers (make sure you do multiple submissions to test different combinations of correct/incorrect answers - e.g., multiple blanks on FITB, multiple choice partial credit, multiple choice with multiple correct multiple selection, and matching with different combinations of correct, incorrect, and partially blank answer selections)
If there are min points less than total points, but you can score more than the min points without getting full credit, you get the appropriate scores (see the matching example in this Help article for how to test.)
Correct functionality of negative marking a.k.a. points deducted for correct answer for true false and multiple choice, single correct.
Correct functionality of scoring for random draw test (both with and without points deducted for incorrect answer), i.e.:
Add several questions in a pool. These questions should have several different total point values (e.g., 5 for some questions, 10 for others) Some of the questions should also have minimum point values specified, at least one with min points = total points, and at least one with min points < total points. At least one question should have negative marking.
Generate a random draw quiz from the pool, with the point value different from all point values existing in the pool (e.g., 1), and no negative marking settings.
In the quiz settings, specify Unlimited Submissions, Feedback on Submission and display correct response, student response, question and part scores, assessment score.
Publish the quiz.
Edit the published quiz and make sure that the point values correspond to the random draw specifications (e.g., 1 point for each question and not 5 or 10, and editing each question reveals no min value or negative marking).
Republish the quiz.
Log in as student and submit the quiz several times, with different combinations of correct, incorrect, and blank answers.
Check Feedback for each submission and ensure the scores are correct.
Log in as instructor, go to Published Copies > Scores > View All Submissions > check each submission and make sure the scores are all correct.
Repeat steps 2-9, with the following differences:
At step 2, DO include negative marking at step 2.
At step 5, ensure each type of question that allows for negative marking (true false and multiple choice) includes the correct value.