Test A

1. Environment

  • Server: qa1-nl.sakaiproject.org (tech specs)
  • Sakai version: 2.7.0M2
  • SiteStats version: 2.1.0-b01
  • Sites:
    • 1) 50 sites with SiteStats
    • 2) 50 sites without SiteStats (won't process events)
  • Users: 50 users per site
  • The Grinder configuration:
    • 1 process, 50 threads, 50 runs
    • Thread distribution:
      • 50% threads: login, goto a site, download a file, logout (generate a resource event)
      • 25% threads: login, goto a site, logout (generate a site visit event)
      • 25% threads: login, goto a site, access news tool, logout (generate other tool event)


2. Results

2.1. Charts & Raw data
2.2. Summary

Test

Test Pass Rate

Concurrent Active Users

Mean Response Time

Resp. Time Std. Dev.

Mean Time to First Byte

# Events Generated in Sakai/sec

# Events Processed by SST/sec

Avg. Time to Process Event

Test (1) sites (SiteStats enabled)

1.0

40-50 (1)

1065.19 ms
(-4.5%)

1846.16 ms

1032.63 ms

12.639

268.48

3 ms

Test (2) sites (SiteStats disabled)

1.0

40-50 (1)

1113.15 ms

2477.04 ms

1078.85 ms

13.327

n.a.

0 ms

Notes

(1): This number doesn't reflect typical production numbers of concurrent users or active users - these are highly active users generating activity in milliseconds interval (in a real production system, this could be equivalent to more than 200 concurrent/active users).