[Zope] Zope Eating Memory for Breakfast

[Hung Jung Lu]

--- In zope@egroups.com, Tony McDonald <tony.mcdonald@n...>  wrote:
> >This is on Solaris 2.7 with Zope 2.1.4. I can provide any other info you
> >like, but I'm not sure what would be useful to know.
> >   PID USERNAME THR PRI NICE  SIZE   RES STATE   TIME    CPU COMMAND
> >  5866 zope       8  10    0 2262M 2034M cpu2  149:09 24.70% python

Wow wow wow, sometimes my Zope eats up to 160 MB of RAM memory,
and I thought that was bad. :)

There's gotta be a memory leak somewhere in Zope. And we'd
better figure out where it is. I have already seen several
messages complaining about Zope's memory usage.

-------------------------------------------------------------

OK, let us try to narrow down a bit.

(1) Version: I also use Zope 2.1.4. System is Linux.

(2) Webserver: ZServer with multiple threads.

(3) Products: I use SybaseDAv2 for database adapter. I also
use a bit of Gadfly (through SQLSession), this of course is
a temporary feature because eventually I want to get rid of
Gadfly.

(4) ZODB: I don't have anything that dynamically changes Zope's
ZODB, that is, I don't upload files into ZODB (Do you?), I
don't create more Zope users on the fly. In fact, I believe my
site can run from a CD-Rom, if necessary.

(5) Size of ZODB: my Data.fs is about 9 MB.

(6) Uptime pattern: the maximum time I have run Zope is less
than a week. Usually I restart it a few times a week.

(7) Memory growth pattern: my Zope starts out with 7 MB in each
of the 4 threads. It starts to climb up slowly, by the end of
the day it reaches 18 MB per thread. After 3 days it climbs up
to 38 MB. That's about 160 MB total. (No, I don't think the
threads are sharing memory, because the Linux "top" command
also tells me the percentage of memory usage.)

(8) Performance: I have severe problem with SQLSession and Gadfly,
and also some problem with SybaseDAv2. I think the performance
problem is related to the RAM memory consumption, because when
I clean up Gadfly (deleting non-used table records), the Gadfly
performance increased substantially.

(9) Database Management cache parameters: (from Zope's control panel)

    Total number of objects in the database 4285
    Total number of objects in all of the caches combined 1533
    Target size 400
    Target maximum time between accesses 60

    Flush Cache: Full Sweep and Minimize don't help to reduce the
    memory consumption.

------------------------------------------------------------

Please post back your site's info. And let us see if we can
narrow it down a bit. Anyone else that has memory problem
please also help us to narrow down the problem. Why do we
need to narrow it down? Because at this moment I am not sure
whether the memory leak comes from a product or from Zope,
and I am not sure whether it happens in Unix systems or in
Windows as well, and I am not sure whether threads have
problems, etc. Let's narrow down the problem first.

thanks,

Hung Jung

______________________________________________________
Get Your Private, Free Email at http://www.hotmail.com