Test A
1. Environment
- Server: qa1-nl.sakaiproject.org (tech specs)
- Sakai version: 2.7.0M2
- SiteStats version: 2.1.0-b01
- Sites:
- 1) 50 sites with SiteStats
- 2) 50 sites without SiteStats (won't process events)
- Users: 50 users per site
- The Grinder configuration:
- 1 process, 50 threads, 50 runs
- Thread distribution:
- 50% threads: login, goto a site, download a file, logout (generate a resource event)
- 25% threads: login, goto a site, logout (generate a site visit event)
- 25% threads: login, goto a site, access news tool, logout (generate other tool event)
2. Results
2.1. Charts & Raw data
- GrinderAnalyzer charts & tables: with SiteStats ON | with SiteStats OFF
- SiteStats metrics: with SiteStats ON | with SiteStats OFF
- Raw data: svn
2.2. Summary
Test |
Test Pass Rate |
Concurrent Active Users |
Mean Response Time |
Resp. Time Std. Dev. |
Mean Time to First Byte |
# Events Generated in Sakai/sec |
# Events Processed by SST/sec |
Avg. Time to Process Event |
---|---|---|---|---|---|---|---|---|
Test (1) sites (SiteStats enabled) |
1.0 |
40-50 (1) |
1065.19 ms |
1846.16 ms |
1032.63 ms |
12.639 |
268.48 |
3 ms |
Test (2) sites (SiteStats disabled) |
1.0 |
40-50 (1) |
1113.15 ms |
2477.04 ms |
1078.85 ms |
13.327 |
n.a. |
0 ms |
Notes
(1): This number doesn't reflect typical production numbers of concurrent users or active users - these are highly active users generating activity in milliseconds interval (in a real production system, this could be equivalent to more than 200 concurrent/active users).