Add Side Panel to Track Question Progress
Description
Attachments
is depended on by
Activity

Leonardo Canessa August 21, 2015 at 11:53 AMEdited
Only 10% (or 3 respondents) commented on potential negatives such as the interface becoming crowded if tests are very long, questions about how the side panel would look on a mobile device, and not wanting students to print the side panel to share with other students.
The side panel is disabled on mobile devices. To mitigate the long test issue, if the test is made with parts the panel should be possible to have the inactive parts be collapsed.
Only 20% (6 out of 30) of the survey participants stated that they did not like the circles, and/or indicated that they would prefer the use of check marks rather than filled circles to indicate completion.
A future improvement could be made which would allow administrators to change the circles to check marks.
However, there were mixed results regarding the fact that the panel only displays in non-linear tests. More than half (56%) did not see this as an issue for users, but 16% of respondents thought it might be a problem, and 26% were uncertain.
Just to note, the Table of Contents is hidden in linear tests as well. Though, I do see value in having it appear in linear tests as a progress indicator.
requests for the ability to hide the “mark for review” option,
This is an individual assessment option. If the option is disabled, it will not be shown in the panel.
Wilma Hodges August 18, 2015 at 4:28 PM
Since the July/August time frame ended up being a difficult one in which to schedule faculty and students for a live UX test, we gathered some user feedback via a short UX survey as an alternative to more structured testing.
I've summarized the results of the survey below. There is also a link to view the responses in more detail at the bottom of this message.
UX Feedback Survey - Question Progress Side Panel ()
Summary of Results
There were 31 survey submissions total. Instructional Technology/Support users comprised more than half (55%), but there were also some students (7%) and faculty (22%) responding.
90% of survey participants liked the new Samigo side panel feature. There were 27 positive comments which collectively described the new side panel as intuitive, convenient for navigation, a time-saver for long assessments, and good for providing feedback for students on their progress during the test. Only 10% (or 3 respondents) commented on potential negatives such as the interface becoming crowded if tests are very long, questions about how the side panel would look on a mobile device, and not wanting students to print the side panel to share with other students.
80% of survey participants (24 out of 30 answering this question) stated that they liked the use of the circles to indicate answer status. Many respondents commented that the circles reminded them of printed scantron or bubble sheet tests and they thought the filled-in circle for answered questions was intuitive in that respect. Only 20% (6 out of 30) of the survey participants stated that they did not like the circles, and/or indicated that they would prefer the use of check marks rather than filled circles to indicate completion.
Almost all of those responding (96%) thought this new feature would be helpful to users. In addition, the majority (84%) preferred the side panel to the Table of Contents for navigation within an assessment. However, there were mixed results regarding the fact that the panel only displays in non-linear tests. More than half (56%) did not see this as an issue for users, but 16% of respondents thought it might be a problem, and 26% were uncertain.
Finally, other comments and observations from participants included: questions about how this would look on a tablet or mobile device, positive remarks concerning the addition of the feature, requests for the ability to hide the “mark for review” option, and requests for the ability to display the side panel on linear tests (for tracking progress) but with some indication that students cannot jump forward or back. Additional UX testing with actual users in a more structured test environment was also suggested.
If you would like to view the survey results in more detail, please go to https://docs.google.com/a/longsight.com/forms/d/10b4WOyTx2ev6OHirFUCIQ5Ca1TeIApkFIidOB64orrk/viewanalytics

Leonardo Canessa July 7, 2015 at 3:15 PM
I posted to the group asking for assistance.
A focus group is being arranged with assistance from .

Steve Swinsburg June 29, 2015 at 5:57 PM
I commented on the original PR for this.
"The styling of the panel looks a bit odd, also those look like clickable radio buttons. Maybe need some UX input? Cool feature though."
Have you had UX input into this yet? The screenshots look the same. IIRC you posted on list saying you would get a UX review.

Roger Brown June 26, 2015 at 1:53 AM
Sorry about that - the link to the topic on Sakai User Group is https://groups.google.com/a/apereo.org/d/topic/sakai-user/b85UuA8R8-M/discussion
If the panel is is only for non linear tests then ain't we duplicating (albeit in a more accessible manner) the TOC functionality?
Add a panel available in assessments which shows test takers their current position in the test (i.e. what question they are on), which questions they have answered, which questions they have not answered, and which questions they have marked for review. Also, allows for navigation between questions.
As it stands this panel only displays for assessments which have one question per page. The panel will auto-hide for assessments which have multiple questions per page.
Work was started by and then finished by .
Here is a video which highlight's it's features: https://www.youtube.com/watch?v=pU91pnPhT6w