Benchmarking
- Benchmarking - Table of Contents
- Test Environment/Test Method
- Test Environment
- Test Environment (Tuning)
- Test Method
- Test Results (Response Time)
- Response Time (Login)
- Response Time (Receive Message)
- Response Time (Reply)
- Test Results (Server Load)
- Web Server Load (CPU Utilization, Free Memory）
- Database Server Load (CPU Utilization, Free Memory）
- Mail Server Load (CPU Utilization, Free Memory）
- Test Results (Conclusion)
Denbun POP Version Benchmarking - Test Environment/Test Method
Test Environment
Database Server
| OS | Red Hat Enterprise Linux ES release 4 (Nahant Update 4) |
|---|---|
| CPU | Qty 2-Quad-Core Intel Xeon processor 2.4GHz or 2.6GHZ with 2x4MB shared Cache(8M total), 1066MHz FSB, B1 stepping(code-named Clovertown) |
| Memory | 8GB |
| Software | PostgreSQL-8.2.4 |
Web Server
| OS | Red Hat Enterprise Linux ES release 4 (Nahant Update 4) |
|---|---|
| CPU | Qty 2-Quad-Core Intel Xeon processor 2.66 - 2.83GHZ with 2x6MB shared Cache(12M total), 1333MHz FSB, B1 stepping(code-named Harpertown) |
| Memory | 8GB |
| Software | Apache,Denbun POP Version V1.0R1.0 |
Mail Server
| OS | Red Hat Enterprise Linux ES release 4 (Nahant Update 4) |
|---|---|
| CPU | Qty 2-Quad-Core Intel Xeon processor 2.66 - 2.83GHZ with 2x6MB shared Cache(12M total), 1333MHz FSB, B1 stepping(code-named Harpertown) |
| Memory | 8GB |
| Software | Postfix(SMTP), dovecot(POP) |
Test Environment (Tuning)
PostgreSQL configuration: Set max_connections to 500 instead of 100, set shared_buffers to 819M instead of 32M.
Test Method
Prepare 100 users for the test. Users who selected randomly perform the following scenario repeatedly for 5 minutes.
Measure process time (Using Jmeter), CPU utilization, Memory load (using vmstat)
Access to the servers in simultaneous number (5, 10, 20, 50, 70, 100, 150) of sessions.
* In case of 150 sessions, prepare 150 users.
* Prepare 100 messages per user (95 messages without attachments, Size: 10KB. 5 messages with attachment, Size: 885KB)
Scenario
- Login (Click Login button and wait until all the messages displayed in the screen)
- Receive Messages (Click Receive button and wait until Receive Dialog disappears)
- Reply (Click Reply button and wait until sending complete)
- Logout