[Zodb-checkins] SVN: ZODB/branches/3.3/ Forward-port from ZODB 3.2.
tim.one at comcast.net
Fri Jan 7 16:21:13 EST 2005
Log message for revision 28769:
Forward-port from ZODB 3.2.
Collector 1503: excessive logging.
ClientStorage._wait_sync(): Don't log more than one "waiting for cache
verification to finish" message per 5 minutes.
--- ZODB/branches/3.3/NEWS.txt 2005-01-07 21:04:18 UTC (rev 28768)
+++ ZODB/branches/3.3/NEWS.txt 2005-01-07 21:21:13 UTC (rev 28769)
@@ -25,6 +25,15 @@
- Fixed a bug wherein an object removed from the client cache didn't
properly mark the file slice it occupied as being available for reuse.
+Collector 1503: excessive logging. It was possible for a ZEO client to
+log "waiting for cache verification to finish" messages at a very high
+rate, producing gigabytes of such messages in short order.
+``ClientStorage._wait_sync()`` was changed to log no more than one
+such message per 5 minutes.
@@ -59,7 +68,6 @@
undefined global while it was trying to raise ``CorruptedError``. It
raises ``CorruptedError``, as it always intended, in these cases now.
--- ZODB/branches/3.3/src/ZEO/ClientStorage.py 2005-01-07 21:04:18 UTC (rev 28768)
+++ ZODB/branches/3.3/src/ZEO/ClientStorage.py 2005-01-07 21:21:13 UTC (rev 28769)
@@ -353,21 +353,29 @@
def _wait_sync(self, deadline=None):
- # If there is no mainloop running, this code needs
- # to call poll() to cause asyncore to handle events.
- while 1:
- if self._ready.isSet():
- if deadline and time.time() > deadline:
+ # Log no more than one "waiting" message per LOG_THROTTLE seconds.
+ LOG_THROTTLE = 300 # 5 minutes
+ next_log_time = time.time()
+ while not self._ready.isSet():
+ now = time.time()
+ if deadline and now > deadline:
log2("Timed out waiting for connection", level=logging.WARNING)
- log2("Waiting for cache verification to finish")
+ if now >= next_log_time:
+ log2("Waiting for cache verification to finish")
+ next_log_time = now + LOG_THROTTLE
if self._connection is None:
# If the connection was closed while we were
# waiting for it to become ready, start over.
- return self._wait(deadline - time.time())
+ if deadline is None:
+ timeout = None
+ timeout = deadline - now
+ return self._wait(timeout)
+ # No mainloop ia running, so we need to call something fancy to
+ # handle asyncore events.
"""Storage API: finalize the storage, releasing external resources."""
More information about the Zodb-checkins