[Zope-dev] LocalFS/Zope/Python leaking memory on large file uploads

[Dieter Maurer]

John Ziniti wrote at 2003-4-8 17:20 -0500:
 > I am using Zope 2.4.3, Python 2.1.2 and LocalFS (version?)
 > on both Linux and Solaris and I am trying to upload large files
 > (~50-150 MB).  Zope consumes memory to the point of
 > strangling the machine, and I am forced to restart it.  The Solaris
 > machine has 256 MB RAM/512 MB swap.  The Linux box has
 > 512MB/1GB.
 > 
 > I have read:
 > 
 > http://www.zope.org/Members/tseaver/Projects/HighlyAvailableZope/BleedingLikeAStuckPig
 > 
 > Does anyone have any additional advice on where to start looking
 > for/fixing the problem?  I will most likely spend most of tomorrow
 > trying to fix the problem, and will obviously contribute anything I
 > find back to the list/community; so any pointers/shortcuts/anecdotes
 > that might save me some time would be appreciated.

As you may know, all data modified in a transaction must be in
memory until the transaction commits.

Subtransaction may help in reducing the memory requirements.


Dieter