[Zope] Re: Surprising load test results?

[Tres Seaver]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Federico Schwindt wrote:
> On 10/5/06, Tres Seaver
> <tseaver at palladion.com> wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> Pascal Peregrina wrote:
>>
>> > We made some basic load testing against different Zope2 versions and
>> found
>> > some unexpected results.
>> > Everything is summarized here :
>> > http://talk.lastminute.com/wiki/index.php/Loadtest
>> >
>> > We would appreciate any comment about it, and of course will answer any
>> > question you might have about our test.
>>
>> Can you tell us what the scale is on the graph?  Also, for the benefit
>> of those "playing along at home", I'm attaching a .zexp file of the test
>> tree, made according to your spec.
> 
>  The tests you've made are substantially different. If you look at
> the zip files, the number of concurrent requests were 100. I'll try to
> explain the parameters used in the tests tomorrow to clarify the
> situation.
> 
>  f.-
> _______________________________________________
> Zope maillist  -  Zope at zope.org
> http://mail.zope.org/mailman/listinfo/zope
> **   No cross posts or HTML encoding!  **
> (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce
> http://mail.zope.org/mailman/listinfo/zope-dev )
> 


OK, here is with 100 concurrent:

$ ab -c 100 -n 1000 http://localhost:8080/test/test2/test3/test.html
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.141 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation,
http://www.apache.org/

Benchmarking localhost (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Finished 1000 requests


Server Software:        Zope/(Zope
Server Hostname:        localhost
Server Port:            8080

Document Path:          /test/test2/test3/test.html
Document Length:        326 bytes

Concurrency Level:      100
Time taken for tests:   6.116692 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      540214 bytes
HTML transferred:       342626 bytes
Requests per second:    163.49 [#/sec] (mean)
Time per request:       611.669 [ms] (mean)
Time per request:       6.117 [ms] (mean, across all concurrent requests)
Transfer rate:          86.16 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   1.6      0       6
Processing:   174  586 209.2    584    6096
Waiting:      170  570 206.8    577    6086
Total:        180  587 209.3    584    6102

Percentage of the requests served within a certain time (ms)
  50%    584
  66%    594
  75%    619
  80%    656
  90%    695
  95%    826
  98%    833
  99%    864
 100%   6102 (longest request)


Note that the per-request average is still around 6 ms (Zope 2.7 here).
 Increasing the concurrency above 4 doesn't stress Zope CPU-wise,
because (by default) there are only 4 appserver "worker" threads
available to respond to requests.



Tres.
- --
===================================================================
Tres Seaver          +1 202-558-7113          tseaver at palladion.com
Palladion Software   "Excellence by Design"    http://palladion.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFJX7M+gerLs4ltQ4RAtxTAJ4waJhWazqiaAvJvkMoKvEXS7VCAwCglIiK
wxClKwFBUwIC9RmS/AIbujo=
=ORqb
-----END PGP SIGNATURE-----