Continuous Integration

Introduction

Test framework allows you to perform tests through Jenkis. Show this screencast to see Jenkis and Test Framework working together.

Configuration

The next lines describe an alternative to run test framework with jenkins. You need different jobs to achieve this.
First you need to configure maven and jdk inside Jenkis, go to Jenkins website to do this.

Source Job

Name: TestFramework
Svn: https://source.sakaiproject.org/contrib/qa/tags/YOURFAVOURITETAG
Steps:
# mvn install -Pinstall

Populate Environment

This Jobs create and remove the test environment. You could run this jobs outside Jenkins.

Name: CreateTest
Svn: None
Steps: (choose ../../TestFramework/workspace/pom.xml as pom file)
# mvn test site -Pruntest,generate,small

Name: RemoveTest
Svn: None
Steps: (choose ../../TestFramework/workspace/pom.xml as pom file)
# mvn test site -Pruntest,remove,small

Schedule this tests once a week to remove and recreate the environment data, and before Report
to collect performance data.

CleanBeforeTest Job

Name: CleanBeforeTest
Svn: None
Steps: (choose ../../TestFramework/workspace/pom.xml as pom file)
# mvn clean -Pcleanhistory

Run Tests Job

You could have as many as you want. All the reports will be grouped in Report Job.

Name: RunTests
Svn: None
Steps: (choose ../../TestFramework/workspace/pom.xml as pom file)
# mvn test site -Pruntest,small,low
# mvn test site -Pruntest,medium,low
# mvn test site -Pruntest,large,low
...

Generate Report Job

You could choose onlye site if you don't want to publish results beyond Jenkins.

Name: GenerateReport
Svn: None
Steps: (choose ../../TestFramework/workspace/pom.xml as pom file)
# mvn site site-deploy -Psite

Reset History Job (Optional)

This Job will be executed manually to completely delete history.

Name: ResetHistory
Svn: None
Steps: (choose ../../TestFramework/workspace/pom.xml as pom file)
# mvn clean -Presethistory

Run inside a loop

With Jenkins you could schedule Job execution.

CleanBeforeTest (@hourly)
  RunTests
  GenerateReport
TestFramework (SVN Poolling @hourly)

If you have multiple RunTest jobs it's difficult to launch report at the end of all of them, so this cycle could help us.

GenerateReport (@hourly)
  CleanBeforeTest
  RunTests
TestFramework (SVN Poolling @hourly)

Introduction

Test framework allows you to collect server data and gets graphical representation using linux scripts, but it is easier to
do with tools like VisualVM or JConsole. This scripts allows you to collect this data automatically.