[Zope] ZEO hogging too much memory

[Wankyu Choi]

Argh.. Toby Dickenson enlightened me on a grave mistake on my part. I was
reading the output of top all wrong.

The only problem now is what to do with that buggy kswapd kicking in when
resources are scarce.

Toby suggests rmap patches while ReiserFS guys suggests aa1. I'll give what
Toby suggests a try first. I'm a user of DirectoryStorage after all :-)

Thanks for your help.

Cheers,
Wankyu Choi
---------------------------------------------------------------
  Wankyu Choi
  CEO/President
  NeoQuest Communications, Inc.
  http://www.zoper.net
  http://www.neoboard.net
---------------------------------------------------------------   


-----Original Message-----
From: Oliver Bleutgen [mailto:myzope@gmx.net] 
Sent: Wednesday, April 16, 2003 10:23 PM
To: Wankyu Choi; zope@zope.org
Subject: Re: [Zope] ZEO hogging too much memory


Wankyu Choi wrote:
>>You wrote you use kernel 2.4.0, that's very brave I'd say. I know it's
>>easier said than done, but you better first install an newer linux 
>>kernel before looking at the zope stuff. You get at least the promise of 
>>a saner out-of-memory behavior.
> 
> 
> Stupid me... I was up 24 hours and out of my mind. I'm using kernel 
> 2.4.20, not 2.4.0. Sorry for the confusion.

No problem, but a pity cause this rules out a simple explanation.

>>Other things you can do are setting process limits, so that the 
>>ZEO/zope
>>servers cannot bring down the whole machine.
>>There's also a zope specific product from chrism, autolance (search 
>>zope.org) which makes zope monitoring and restarting itself, when some 
>>conditions (memory etc.) are met.
> 
> 
> Thanks for the pointer. Guess I'll also give djb's softlimit a try.
> 
> But I am still worried about lost memory. I need to reboot the system 
> again in an hour or so. 3G out of 4G is being used by no apparent 
> process now even when I stop the ZEO server.

Just another remark, linux doesn't release all memory an app uses, even 
if the app exited. Don't ask me about the hows and whys.
What does "free" tell you?


cheers,
oliver