[Zope] Threading, dtml and performance?!
Chris McDonough
chrism@zope.com
Wed, 24 Oct 2001 12:54:57 -0400
Excellent, thanks for these results. I dont know that the Zope/Python
versions matter too much (because I wouldn't be able to interpret any
difference in any meaningful way anyway, this is just "back of the
napkin" kind of testing).
Are you running ZEO?
----- Original Message -----
From: "Paul Zwarts" <paz@oratrix.com>
To: <chrism@zope.com>
Cc: <zope@zope.org>
Sent: Wednesday, October 24, 2001 11:13 AM
Subject: RE: [Zope] Threading, dtml and performance?!
> Okay... So I removed reference to the bobbobase and the id. Instead
I
> just output text, but otherwise it runs well.
>
> I've never counted my objects till now, but it's a nice test to
really
> stress the server when you find out you have 1000+ objects being
pulled
> from the root.
>
> Results:
> The testpage took about 3.5 minutes to load. It by itself takes all
of
> the first processor relentlessly, leaving the second open.
>
> When a second request comes in, the second processor kicks in and it
> becomes more even 60%-30% across 1st and 2nd processor.
>
> The second page request takes about 8 seconds rather than a normal
call
> of 8/10th sec.
>
> I'm not sure if I can be more explicit with other usefull
information.
>
> One thing to mention though, I'm on Zope 233 with py152, since it
seems
> snappier than py2. Was this test supposed to be for py2 and Z242? If
so,
> I'll do a quick switcherooni and test again.
>
>
> L8r,
> Paul Zwarts
>
>
> -----Original Message-----
> From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of
Paul
> Zwarts
> Sent: Wednesday, October 24, 2001 4:54 PM
> To: chrism@zope.com
> Cc: zope@zope.org
> Subject: RE: [Zope] Threading, dtml and performance?!
>
> Ahaha... Keyword being method. Its one step closer to working now,
but I
> get authorization errors against bobbobase_mod_time. I tried as
> superuser and owner/manager roles with no avail. Am I missing
something?
>
> Paul Zwarts
>
> -----Original Message-----
> From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf Of
> Chris McDonough
> Sent: Wednesday, October 24, 2001 3:11 PM
> To: Paul Zwarts
> Cc: chrism@zope.com; 'Tony McDonald'; 'Oliver Erlewein';
zope@zope.org
> Subject: Re: [Zope] Threading, dtml and performance?!
>
> Maybe you created the method in a subfolder without many peer
objects?
> It should be created at the root.
>
> Paul Zwarts wrote:
> > Well, okay then. I get it. However, since it takes only 80% of 1
> second
> > to load the page, its difficult to access another page... LOL.
> >
> > I've tried the reverse now. Pulling a page that does heavy SQL
queries
> > and then refreshing the speeTest page a few times. Adding some
time
> > fields, the page only takes .1 second more than before.
> >
> > I also mention that I built my own mailing list app for our site,
and
> it
> > has run against 8000 emails, and still services me or other users
on
> the
> > site, even though the bulkmailer takes up to 30 minutes to run
fully.
> >
> > So I guess the result is the same. Solaris has something funny,
> whereas
> > Linux does not.
> >
> > But as per my first message, I don't think this test works
properly
> > because the second IN is never executed, so this dtml doesn't
actually
> > do anything to the server that would distract it or load it
down.....
> >
> > Paul Zwarts
> >
> > -----Original Message-----
> > From: Chris McDonough [mailto:chrism@digicool.com]
> > Sent: Wednesday, October 24, 2001 2:24 PM
> > To: Paul Zwarts
> > Cc: 'Chris McDonough'; 'Tony McDonald'; 'Oliver Erlewein';
> zope@zope.org
> > Subject: Re: [Zope] Threading, dtml and performance?!
> >
> > The output of the DTML method isn't important, but if you ran it
and
> it
> > took a while (> 5 seconds or so), but then at the same time it was
> > running, you visited a page in the mgmt interface and that
operation
> > took .83 seconds, that's the number that's important.. that lets
us
> know
> >
> > that MP Linux systems aren't "freezing" like Solaris systems.
> However,
> > if you ran this method, and you couldn't do anything on the system
> until
> >
> > it finished, there would be a problem.
> >
> > Paul Zwarts wrote:
> >
> >>Um... I can do this on a Dual P2-400 with 256mb ram, loading the
> >>
> > Redhat
> >
> >>flavour of the latest linux kernel....
> >>
> >>But, I don't quite understand the test. At least, what is the dtml
> >>doing? I tried it out and I get nothing on the page, except my
> >>header/footer stuff. The time reslut from the debug console
reveals
> >>
> > .83
> >
> >>seconds, but that is because my interface is quite heavy on SQL
and
> >>
> > CST.
> >
> >>Should I modify the code to something else? I suppose the first
in-tag
> >>is to just create a loop, so can I use _.range() instead?
> >>
> >>If the ZopeFind(this(), '', '', '',....) means its looking for '1'
as
> >>
> > an
> >
> >>object, it doesn't work either even if I add a method called '1'.
With
> >>some text in between, I see that the first <dtml-in> works only
and
> >>
> > the
> >
> >>ZopeFind returns bunk.
> >>
> >>I'm interested in this test, but I;m not techie enough to
understand
> >>
> > the
> >
> >>control here.
> >>
> >>
> >><dtml-call logic>
> >><dtml-var head>
> >><dtml-var standard_html_header>
> >>start<br>
> >>
> >> <dtml-in
> >>
> >>
> >
>
"[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,
1,
> >
> >>1,1]">
> >> a<br>
> >> <dtml-in "ZopeFind(this(), '', '', '', '', '' , '', '', '', 1)"
> >>sort=bobobase_modification_time reverse>
> >> b<br>
> >> <dtml-var bobobase_modification_time>, <dtml-var id><br>
> >>
> > </dtml-in>
> >
> >> </dtml-in>
> >>end<br>
> >><dtml-var standard_html_footer>
> >>
> >>
> >>
> >>Thanks for help,
> >>Paul Zwarts
> >>
> >>-----Original Message-----
> >>From: zope-admin@zope.org [mailto:zope-admin@zope.org] On Behalf
Of
> >>Chris McDonough
> >>Sent: Wednesday, October 24, 2001 12:48 AM
> >>To: Tony McDonald; Oliver Erlewein; zope@zope.org
> >>Subject: Re: [Zope] Threading, dtml and performance?!
> >>
> >>Can somebody with a multiprocessor Linux machine try this out?
> >>
> >>----- Original Message -----
> >>From: "Tony McDonald" <tony.mcdonald@ncl.ac.uk>
> >>To: "Chris McDonough" <chrism@zope.com>; "Oliver Erlewein"
> >><oerlewein@gmx.de>; <zope@zope.org>
> >>Sent: Tuesday, October 23, 2001 6:12 PM
> >>Subject: Re: [Zope] Threading, dtml and performance?!
> >>
> >>
> >>
> >>
> >>>On 23/10/01 4:21 pm, "Chris McDonough" <chrism@zope.com> wrote:
> >>>
> >>>
> >>>
> >>>>This "hogging" behavior doesn't show up on a Linux 2.4.2 kernel,
> >>>>
> >>>>
> >>Zope
> >>
> >>
> >>>>2.3.3 system we have here. I can browse the site normally while
> >>>>
> >>>>
> >>the
> >>
> >>
> >>>>DTML method runs.
> >>>>
> >>>>I don't have a Solaris machine to test this on; can anyone else
> >>>>confirm the behavior on Solaris?
> >>>>
> >>>>
> >>>>
> >>>Solaris 8, Zope 2.4.1 compiled from source.
> >>>Save the DTML as a method, 'view' it. Try and do something else
on
> >>>
> >>>
> >>the same
> >>
> >>
> >>>site .... No-go.
> >>>
> >>>Damn.
> >>>
> >>>Tone.
> >>>--
> >>>Dr Tony McDonald, Assistant Director, FMCC,
http://www.fmcc.org.uk/
> >>>The Medical School, Newcastle University Tel: +44 191 243 6140
> >>>A Zope list for UK HE/FE
> >>>
> >>>
> >>http://www.fmcc.org.uk/mailman/listinfo/zope
> >>
> >>
> >>>_______________________________________________
> >>>Zope maillist - Zope@zope.org
> >>>http://lists.zope.org/mailman/listinfo/zope
> >>>** No cross posts or HTML encoding! **
> >>>(Related lists -
> >>>http://lists.zope.org/mailman/listinfo/zope-announce
> >>>http://lists.zope.org/mailman/listinfo/zope-dev )
> >>>
> >>>
> >>>
> >>
> >>_______________________________________________
> >>Zope maillist - Zope@zope.org
> >>http://lists.zope.org/mailman/listinfo/zope
> >>** No cross posts or HTML encoding! **
> >>(Related lists -
> >> http://lists.zope.org/mailman/listinfo/zope-announce
> >> http://lists.zope.org/mailman/listinfo/zope-dev )
> >>
> >>
> >>
> >
> >
>
>
> --
> Chris McDonough Zope Corporation
> http://www.zope.org http://www.zope.com
> "Killing hundreds of birds with thousands of stones"
>
>
> _______________________________________________
> Zope maillist - Zope@zope.org
> http://lists.zope.org/mailman/listinfo/zope
> ** No cross posts or HTML encoding! **
> (Related lists -
> http://lists.zope.org/mailman/listinfo/zope-announce
> http://lists.zope.org/mailman/listinfo/zope-dev )
>
>
> _______________________________________________
> Zope maillist - Zope@zope.org
> http://lists.zope.org/mailman/listinfo/zope
> ** No cross posts or HTML encoding! **
> (Related lists -
> http://lists.zope.org/mailman/listinfo/zope-announce
> http://lists.zope.org/mailman/listinfo/zope-dev )
>
>