[Zope-CMF] Are there scaling issues with the Catalog?

alan runyan alan runyan" <runyaga@runyaga.com
Sat, 24 Aug 2002 10:58:32 -0500


have you tried to simulate this?  and are you 'indexing' 2k of data per
document? or just metadata associated with the document?
I remember ken indexing hundreds of thousands of news posts and doing
searches and being happy about his results.  But if
you go down this route you should probably do some due diligence.

you will need tons of ram.  use subtransactions on the initial loading.  I
would suggest ZEO and dshaw's Advance Site Setup howto.

cheers,
~runyaga
p.s. it appears that CMF is popular enough/low enough volume that people are
moving zope related questions onto the list.  maybe
TheJester's once flamed email about splitting zope@zope.org mailing list
into two is in order.

----- Original Message -----
From: "J C Lawrence" <claw@kanga.nu>
To: <zope-cmf@zope.org>
Sent: Saturday, August 24, 2002 4:22 AM
Subject: [Zope-CMF] Are there scaling issues with the Catalog?


>
> How well does the Catalog scale?
>
> I'm looking to inject/index ~200,000 documents of average size 2K to
> start out, with an average growth rate of around 1,500 new documents
> each month.
>
> --
> J C Lawrence
> ---------(*)                Satan, oscillate my metallic sonatas.
> claw@kanga.nu               He lived as a devil, eh?
> http://www.kanga.nu/~claw/  Evil is a name of a foeman, as I live.
>
>
> _______________________________________________
> Zope-CMF maillist  -  Zope-CMF@zope.org
> http://lists.zope.org/mailman/listinfo/zope-cmf
>
> See http://collector.zope.org/CMF for bug reports and feature requests
>