It's working fine on Sakai 2.8.1 binary

Thanks a lot for your valuable support/response.

I just checked the code. The error about more than 100 files is produced by code that I think is correct. This problem with UTF-8 is generating the wrong error message at a low level in the resources code. There's not much I can do about it.

You'll note that I am checking in a patch with this Jira. While the main problem was missing -Dfile.encoding=UTF-8, there is also an issue with the code. I started with prototype code from IMS. In fact the actual processing for assessments is being done by my own code. There are actually two different versions, for Samigo and Mneme. However I had left the original code running also, even though I actually don't use the results. It was generating an error. I've removed that code. That gets rid of an error. But you still need file.encoding set.

I have uploaded an assembly for this. It will install on top of a standard 2.8.1 binary. If you take a binary copy of 2.8.1, you can fetch
sakai.rutgers.edu/stats/lessonbuilder-1.4.x-2.8.1.zip and unzip it in the tomcat directory. If you have an existing lesson builder, you'll need to remove webapps/sakai-lessonbuildertool-tool (the directory – the war file will be replaced by unziping the ZIP file). Before doing the unzip, you should also remove tomcat/shared/lib/sakai-lessonbuilder*.

I have tested this on Windows. The difference between Unix and Windows doesn't seem to be an issue.

Your first test works fine. The problem is with assessment.xml. The XML parser says Invalid byte 1 of 1-byte UTF-8 sequence.

I note that there is a sequence e265. e2 the first byte of a two-byte sequence. The next byte must have the high order bit on. Depending upon how you read the dump, the next byte is 65 or 6e, either of which have the high-order bit.

I believe Xerces is correct that this is invalid UTF-8. Your other file is UTF-16, and seems to be OK.

I have a conjecture. To process UTF 8 correctly, Java must be started with the option -Dfile.encoding=UTF-8. For testing I have been using the demo ZIP file. It does not set that option. Is it possible that you're not doing it? In the demo, that has to go on both command lines in start-sakai.bat. In production configurations the options are typically in bin/catalina.bat unless you've created a setenv.bat.

Apparently lesson builder is not reporting the correct error. I'll take a look. The error message was in catalina.out. We'll see if I can find a way to get the right error message back.

that's cool.
I have tried free trial hosted by sakai commercial affiliates, but they did't have LessonBuilder tool. So I am installed sakai 2.8.1 in my local.
can you please provide me a link to download sakai 2.9 binary or demo. I did't get any.

Note: I am using below lesson builder
https://source.sakaiproject.org/svn/lessonbuilder/binaries/lessonbuilder-assembly-1.4-sakai2.8.1-tomcat-overlay.zip

This cartridge works fine in my system, including the Quiz.

Could you try it in one of the 2.9 QA systems?

I"m going to see if there is something in the implementation that might not work on a Windows-based Sakai.