[ZWeb] Re: Zope.org general performance

[Andrew Sawyers]

Chris Withers wrote:

> Andrew Sawyers wrote:
> 
>>>> 1. Some search engine or other spider is ocassionally crawling some
>>>> non-cached and very CPU intensive pages.
>>
>>
>> I definately think this is happening and was going to check the logs 
>> in related to our load warnings.
> 
> 
> There are load warning? Where do these go?
They go to our SA's at the moment.  It's actually monitoring alerts, 
which include a variety of checks, including load.
> Where does Squid (if that's what does the master logging) keep its logs?
in /var/log/squid -- I think I'll get webalizer running on them.  Do we 
want them generally available to the world?
> 
>>> Hypthesis 3: it's the network.  Perhaps the load balancer or some 
>>> other box is dropping packets.  I don't think I saw a delay when I 
>>> accessed the site through an SSH tunnel (to reach a specific app 
>>> server).
>>
>>
>> Not this, we didn't put anything behind a loadbalancer.  There are two 
>> app servers behind a squid though; I have been doing a lot of squid 
>> fine tuning for another project and I can take a look at this and see 
>> if there are any areas I know will immediately improve the cahce 
>> performance.
> 
> 
> That would be very cool, thanks!
It's possible there was (is) a performance bottleneck at the cache under 
heavy traffic - I did do some tuning on squid this morning, it will take 
a little monitoring on my part to get it dialed in; but it's definately 
going to be better then it was.
> 
> 
>> Casey and I were working on a problem recently that requires intensive 
>> catalog queries to display pages, but often always only needed to 
>> display the X recent items.  Today is the first day I can monitor the 
>> performance results of this; but we expect it to be massive.  I would 
>> expect Zope org could benefit from this type of index also -- it's 
>> been released as OpenSource.
> 
> 
> Cool, I have a few projects that would also love this. Where can I find it?
> 
Good question; I'm not sure.  I'll ask him where he put it.
> And, from a Zope.org point of view, what version of Zope does it 
> require? :-S
I've used it with 2.6.x and 2.7.x
> 
> Chris
> 
Andrew

-- 
Zope Corporation
Software Engineer
(540) 361-1700