Further Improve the Performance of the Email Archive and Message API
Description
Environment
Test Plan
Attachments
incorporates
is related to
relates to
Activity
Anthony Whyte December 15, 2009 at 11:51 AM
Old issue. Closing.
Charles R Severance October 3, 2008 at 2:46 PM
This is now fixed and ready for 2.6.
Charles R Severance October 3, 2008 at 2:45 PM
$ svn commit
Sending mailarchive-runconversion.sh
Deleting readme-conversion.txt
Sending upgradeschema-2.6-mysql.config
Sending upgradeschema-2.6-oracle.config
Transmitting file data ...
Committed revision 53121.
Update the MailArchive 2.6 conversion script.
As part of a 2.6 upgrade this script needs to be run on the database.
It adds a BODY and SUBJECT column and extracts these
out of the XML to improve searching, sorting, and
paging performance.
The conversion script is in the mialarchive directory and
it is called as follows:
./mailarchive-runconversion.sh upgradeschema-2.6-oracle.config
You must do this with CATALINA_HOME pointing to your Sakai
deployment - it looks through sakai.properties for conneciton
details and finds the DB drivers in your Tomcat as well.
The convrsion can be run more than once - it notices when a
message alreayd has been converted and skipps it. You
can even drop the columns and then re-run the conversion.
Please put this in 2.6 - it is a blocker.
Note - this is a required conversion as part of 2.6 - it needs to go
into the release notes somewhere.
Peter Knoop September 29, 2008 at 7:22 AM
[Bulk Comment] This Task (or Sub-Task) issue currently is Unresolved, but has a Fix Version of 2.6. The Code Freeze for Sakai 2.6 has now passed (29-Sep-2008, 8:00am Eastern US time).
If you are still working to resolve this issue for 2.6, then please post an email to sakai-dev to let everyone now that you need an exception for this JIra, explain what is left to do, and when you plan to have the work completed; please include that information here in the Jira as well.
Otherwise, if the resolution of this task has been postponed, please reset the Fix Version to 2.7 or Unknown, depending on what you're new expectations for completion are. If the issue is no longer relevant, please close the issue as Won't Fix or Incomplete with an explanation of why.
Thanks!
Peter Knoop August 25, 2008 at 9:59 AM
Moved from Branch to Task, now that the code is in trunk.
This will build on SAK-11544 and SAK-12837. The idea is to add an even better feature to the Message API and then modify the MailArchive tool to use this new API. The improvements will support flexible filtering, sorting, and paging all in a single query object. This will be done in a very similar manner to the GenericDAO search pattern that is currently in use by Aaron Z.
Once the API changes are made and the MailTool is modified to use the new APIs and the data is reorganized and the implementation makes all of the queries efficient, the MailArchive tool will use little or no Session state at all. This also means that the MailArchive tool will have REST-like URLs that capture navigation state instead of using Session state to handle navigation state.
Once this pattern is in place, it can be used to improve the performance and reduce the session state load of the Message API family of Sakai tools. If that work is undertaken, it will be in separate JIRAs.
This is targeted for 2.6 and will require a database conversion to split out data from the XML into columns. Since there is a conversion involved - there is no plan to back-port this (even to the 2-5-x branch) - it is targeted for 2.6.