[Zope-dev] ZCatalog, import errors, and indexing errors

Michel Pelletier michel@digicool.com
Mon, 06 Mar 2000 13:47:23 -0800


This is a multi-part message in MIME format.
--------------061AE9919641E938D22941BD
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit

"R. David Murray" wrote:
> 
> 1) what is the practical limit on the number of entries in a folder,
>         and is there some way to get around this for instances where
>         you want to use the ZODB as a database for a large number
>         of records?


A few months ago I experimented with a BTreeObjectManager (and a
BTreeFolder).  I told The Other Mike Pelletier that I would give him the
code, and since you've brought this up I'll give it to you and the whole
list.  Attached is a small .tgz file that contains the Product which I
verified for about five minutes will at least import into a Zope 2.1.4
without any syntax errors.  That's the extent of my debugging.

Note that I KNOW that this is buggy is some way that was not immediatly
clear to me, I think it had to do with acquisition and authentication
(ouch!).  So, BEWARE.  In fact, it has already sorta broken the sandbox
I put it in to make this distribution.  USE AT YOUR OWN RISK.  DO NOT
USE THIS SOFTWARE IN A PRODUCTION SYSTEM.  THIS IS ALPHA.  THIS SOFTWARE
COULD DESTROY YOUR SOUL AND LIGHT YOUR HOUSE ON FIRE.  

-Michel
--------------061AE9919641E938D22941BD
Content-Type: application/x-compressed;
 name="BTreeObjectManager.tgz"
Content-Transfer-Encoding: base64
Content-Disposition: inline;
 filename="BTreeObjectManager.tgz"

H4sIAJH6wzgAA+1c348bSV53OBArS4gVEtKddKA65xbbK8fjmcxkdufGUTx2z0xzHttnt5NN
csHXdpc9Tdrdvu72TLwnUB5BvCHxBtIKdDzwhAQPPK6QkA6e4E+4RyQeQDwgnsLnW1Xtbnuc
ZMJms9zRtdlxu358f9e3vvWtajv2cGu2CM89d6vje9Z8FAZbR4bPeXv4u3wUnpmuOeH+VuaL
FLZb2d/bYxnG2P7+vvjc3t0Vn6pU0FK5U9nf39up7KJ1f3vvTobtfSGs1yzzIDR9xjJTe3TO
nVf1437wLgh6t8W5nv5F1bHnWNwvzxZviGO7Urmj9L1B/9u7O3s7kf5371TwvLNTqexnWOVL
4Xit/D/X/823WrI3Gf498macdeZDxx6xpj3ibsBZ4VGnWWT3IUPbc9l2uYJ+t65TJMi6N1v4
9uQ8ZIVRkTXsiR2aDqv73AwBLygzVnMcJnoEzOfQ1QW3ynKscW4HzFF0nJsBG3LushH3Q3ts
c4uhpj1DTc+b+yNeCKdFNbDLLTsIfXs4JyTMdC0GK2C2ywLRVdQMbdf0F2zs+dOgxC7t8Jx5
vvj05iGATD0LaEaCzhIzfc5m3J/aYQjMM9+7sC08hOdmiD8cYBzHu7TdCRt5rmUL5mgQAeLh
gaRru7xGWpCgaeRZnE1h1RBDaKKewJpD74KalBABA8X1QgilhA5CPhjhjRNoS4K9VaKAdOSY
9hReQJKys5GUhEwiUmbCufAviRoglVCog+WN5lPuhmaktS0oxEOLz6ZmyH3bdIJY9EJjaJTj
k6woFm+Xr9obGPrhnAewNaE5M4ytZMjZxL6AOYWemAgSrk2ELIDfdUHGzAsCe+jwspwqtjty
5haHolmu411yH2QNF6ItJ4cDdui5EplNIobTchzZzeJjc+6EZfbg3HYATPSANAFNGb2EcWF7
jhQJKPP5lHQghC2Bl9RIxVnCKOXwJI8YDcsqsxoL7IkrzNvFYPcCA0ny8SybzcNIAEoekSKB
io9hISE0gKkLTYe2Owf9Y6FEIZiRN53OXTtcSBhRn4A4mPjeZVnObfzzXM4uzQU1mEEw97mk
njqF50qRu2XhJEzrgqZ+QBYU2wMRtWo49IRPdJPYx9A9AAcQuA8FW2zse1Oa6+QTvLFkKfDG
4SVNcmH2sKaZYy5i04xt1xw9db1LqHDCCZGa2aLkBFNywoSxcSxBW/yCOxCP0P4V04ygjBVl
ygM8YnJBl345OCcaNPfC9j2X8EejCudhODvY2rq8vCx/Chxlz59sFcu5JXm6BAcS3DB2WxGx
Qy54UxIGhbFpu0s7MNFRqHfFuxbERFw6BaGQyGkrKFZxKUlXihvTX/AYQPl27PH3yqxlTglr
EHgj2wyjeS7QQjBXJ7TQF80azN85UR56Ehl3Lc8PxChwOfXCJbdrlrCq/3gBQJn5Nq0JPnl9
V/r/QKyDYuDV1UxycafMzsTiAQz+mpOFvZE/ER72EloIPGjET/r9Vxvdz5jNCZsp+PxWcaMY
vDFcEKax1K/PHW4GtA6QQiUI8mq2Tys2488w5110XpuCSur7kdRH5nL1hRGMsLoiErbIW0ox
w1BmACEqAz4zfZiZs4DJKZ2bIQJK4ao2kkcxS2OFGTGbkkSP0NEHyAi6nGoKrrI5Mkyog/i5
9PynS9LUWAnIMYfckZHO3F1SsyJKULPK9uU5AuJVckwfizqhdDG5JDNT+NykINQ6R3ZZInSO
R2ZHvPHYiQurJU8Nb+xJdy8nciBDA6UJ/GssV/jIGIxTvcd67WPjQa2rMTx3uu37ekNrsKOH
rKGf6EatyepdrWbo7VaP/eAHtR565fOs1mrg/4cCiPZJp6v1ehjU7jL9rNPU8QiA3VrL0LVe
iemterPf0FsnJXbUN1irbbCmfqYb6Ga0SyBCE3CuDmXtY3amdeun+Fo70pu68VBgPtaNFjCy
YyCssU6ta+j1frPWFWA6/W6n3dMYcdTQe/VmTT/TGtCI3gJqpt3XWgbrndaazQ0cEgdGT8Cp
t1tGVwfB7W6PHWkguXbU1CTOFkmnq9UNYi5+qkN0oLRZEgB6Ha2u4wsEpIG1WvdhieADbk/7
Xh8d0cgatbPaCTgtXBWSAJIUFJRT73e1M2IAkun1j3qGbvQNjZ202w1BfE/r3tfrWu87rNnu
kfwEkH5PKwGTURMEAAwEiC54Pur3dCFKvWVo3W6/Q2IostP2A8gJtNb6pFfIXMBptwTrUFi7
+5BIIJkItZTYg1MN9V2SspBcjUTSgwTrRqKbBNMFO10jwTNraSdN/URr1TVqbROkB3pPK0KL
eo866BL1gxrw9qVogB/9iDn5mDDlklAz049ZrXFfF6YpO8MyerqyJCWcXr9+qtQQTxVjZfnB
LAtsik9lEJ3wMlMT+4NNTpxWXNpm0Py1EXYjPJ5TZCRi2nPTGROsTTuv3oyPyHFgcCJIlI6T
AnnpFkTgP0JENwMCscGhNQ0UjhG1Sjbe7lY0m8vlZMaCeWIZwvdsdjC4kHvQwaCa/3aXX9j0
5QB7qo922Lfzj7e3D27tPMlm7emMYtMTxxtCCFnhbdvHPabqe/h0uB7yqWy6mjKJel5tWQIr
d3z4UD9crA1Zq5b9a6MRD4I66dJzyl2PQn3ZnZ5Xul7yoWVelOtY94GV4gzVM66JaTiGrnvz
mWhX3RJVsp+SQtR+apw1j6G1LMpUIB6YlpVIER3DwVejXoX8MFy21CwrX2ITCa9QLGaz2L6w
jUAKAXfG2JVY2BPaocOr+XwpyzaVERkjlwmHauWVnfoBqHtpny55uZ5RbWE7UTwQfWA0oBl7
KZdfsgR1yqZkWGlb7EPb+rCcFUN0uaTlk2TlRTybTxCRZ7SoY1MPcxRTJeChWBQx/UJ/zgWo
C9OZix0Ty0Mn/NngPJw6EpbJ8gQnQVJe0STBSVQUOQYz0jnit0VWRuByDQc/Y5nQixgVn96w
mlRCUVWWbatqW9EXqRDxV1SRqsoDcCANvUBK84ZybOgvDigq9KtKvI/ztT48G1aTeg0LxQDu
sJt/IvryZyM+C1V30oKkeJzU3sFSd6gvUM9owyvUJoRD3worOqZ+ZWxLB3H0XciTZgkmk8wG
ME3ipFg8WBnrm9jLQNyuOUdQ79ufcjLiwgYbyj/05kL6Yv+97C30uoarnN8wvrisg5DjWSH4
TupjKRFpXW9ZJA21Dw4QIUxBgkq+0GT+0kXUgNeICXgTIdHIaCAMsJqcMbELWcpPGWNSUDFL
2ELNfVeatcJAGQ/lktTQEpvPLOhgAIzz6naR3CGi1SBI+onCVf9fWnfwpaQLLyW89Jqbihed
Mv0pJR117K7Ep4EZPjQDeyRWf5AeeyzM/46PHZ49s02s3glasZ+GpznHM0LzqYeNBCJ0OeVF
9mw5LHI0q54DvswchIsZxCyAKkvPS684mEmmbR5UCz/K21b+IC+UAuXkaVT+gOVpQ+JO8r9X
KspBSvbeTEQU1diefpQXexrAoBWRTIXAmEJqqEzoDMA2jLpv88uVEQlj2Tigs6R+E6KYN1r6
NkPQxeK5pT2jj01A5Ooq218OpsdHc98OF5sgmCJG2Dyu71repjFU/3JsZGGbRo1Rf0zLl9Ce
6U94uFnsSpED0JbwMwGirwJNGBVZlFUSczAQE2hguzaeCwnbLGa/6pOSn89yzfO/gVLJmx/+
ZV57/lfZ29uOz//u7DO2s727s5Oe/72L8pY3Xen5X3r+l57/ped/6flfev6Xnv+l53/p+V96
/pee/6Xnf+n5X3r+967P/5IHcDKJVNp0GhfJzg6W5yIqkqSUBxyl/Wm85NOkFGHyOS2GGKpC
INRMPVonschgqZry0bnp2sFUBrfwkKJ17lKWNYSgTYr+xdlXjKRAisLqVDyQOTOKE6qvT8jL
zmps2ecTErlfpzxanC9N3t9OCmTZgQwm9MEigp1qMvFWfukJ30sO0dhrBxfjkTbwVvO2YGpL
tg6orjyxx4njPodPzNHiGnSVErCLGwVzhLVXCudlMmGr6etrgVkxqfLVqv+z6cs3uf+/yuT1
M4Gvyf/dvn27Euf/blP+DzXbaf7vXZS37HTT/F+a/0vzf2n+L83/pfm/NP+X5v/S/F+a/0vz
f2n+L83/pfm/d5z/GwwQzw0G1Vwup5ah6Jq9eBEgcW9/5ap+lDYMg4HPJ/xZ6co7AOWN9/zX
kopD0xrYVjWCUibGxWX4x79j3vq0dutR5dbHtwa///3S98vsSb5YnpJbZzcxk7ODqek/5X71
8ZPkddIV+IXV5NLy7qdkR130nEa0UKOhwqVgufXBV8pJkm4vKDyhxXu0vHoqLOecbqd7E+5y
bx6ou9/y4ielQfMBq3V0sR+xKFYewS7g1cUypty6zHX6ltwJEYDVHBKt7TAQ06IBQejR7U/s
QwA5usoe0HbEpQypsyiJ3cgyxbiqBhoNnsiiorGwOgRFC9pnYMWjgFXKxzJDU15bFxlPEdRH
wRnG1NU9fmEm9LC82MpYdLV11aKiK64R4ipT97ShfNNJVIvBBXUnkrK/A6zlo6e6lXjZwaRo
bWDNZ9VK4pL1TXqtYNlEQh/DJuW7Adz3RcpBZprFVWyL9lFokqgTUKLtrtqk2nTVF0RakNIz
chjlK3joZYRSAoLnIiQRZMfxP8DIq7vRdWPagTIQxCcwitG56au7wmILMBaBtm1tvEJ+BGPo
yj0o3S1teQT8EiFEIN0Mt/JJSHKeFWyryL5VZbe2rwFz9VZ63pD0fxDEtBPBiDjpRnTEA+yi
320G5Tz7AL2LSRJs63HlSbWaH+QP3hCh3MtfmA6+3qL995BPCL9QErQnzwtomgLvVcRikx+p
apVxtGIPTu5YWVbe/OFgiLAzv3ZxX0wD9KiKu+6q0zoo+XpH0pbFewNP+YIEfxXgNaSwQRrr
wsD3yDYhfYSHS+En5o945yQxeyR9CZqu0v7Ytp5gLq5NjRikxZ0EyAQoNLwE3AYokzXCVJqm
qrx7ceWdjevpiuo264nDFRzE7etG8ib6wxBFKilAUfsyFdfUes81ckHE6Or0k69RKHgb3664
IsryYOCNBwMhimveEF87aRHlq86r/6yUa57/qBO6/x2ON/j9r92d23uM7VR2d9Lf/3on5c30
v3ZCe00crz7/Y9tQ/Jr+b+/upud/76Sc6McffWy+n3k/81+ZzAv8l8l0Op3nz59//vnn+PI8
cy+T+Sxz7/nzzPN7mXsv0OMFHp+j4sWLF1818WlJy9ss3/rvX7xBnyX6Q3Pi3ntW5sZ73zz9
68/u3fjV90qdn8x++vc3bmTe++TfP/vzf/ijX7+Zc37yH2bjD3/ll77+zb/7F/PkF97/4Ld2
//HXfnx842vDf/rTb/znXzRufHTyx//2B38zaf3JrYd/2fj63/70n39Z+43fPPur2b/qP77z
tdM/++3+h5hame98ZSxf0/+vvsJftsLpK1zlenmN/79dqcTvf+3vVcj/Vyrp+1/vpBzSzzTc
zR6earUGPgzdaGp36c6ZVPbhlqzJHm6pHkftxkN2dFJvN9vdau7msSg51tRb38XXCsrHH+fY
ffV9T5QcIdhZAYuv2exh5262pqri3bc8ql9mmvpBdBVLHqb4E9OlK3kLb+5nL/kwme5Bu+NN
RCZq4nvzWVAG4R2FyRBnYf4Uu2zsmeXOOSAwNEy+Tp81FaqyeIP6UDu7KzKdnM3kdRbbDbk/
Nkf8cAttTL6YrAYHWWzZaUj8LrHsJd5pP+OYZJQJDWxLnuQovuks2xZn8TyrqszlFoy0I25P
8CA6mL5Cmnjff6zkiursKlWAlvjdgc0EyHe+1cv4AkvWFsc08iicUoPxgKVMj9vdM1arUwK+
mtt4HS/HzjTjtN2o5jrtnkFmYIgjibrWbPY6tbreOqnmdkR99y72h4dGg9Wa+gngNbVjA3ak
vhntTk506Bndduvkrm4dbqlHqt0yGtcbrrc6fYMZDzsaKrVP0KVVO8OzbeVYT3+Ep91KLgaJ
v903IA7Cjwg06NX2JY1SL2+DUPHK/GtoJeiYnxBwS0j38Ah11Ed2UfwkaCCsKyOyK/jrp1r9
u0ftTyIaVn56AjNCkN9HwzagUF+twXTofDSsJ3qu6O+wWTvSmnQ0dbXbS2ecGHM3ofirSvqi
TMlfGLkGT6Lja1lSvTZN1FcyI7k5lCpryKesUGOShV7/6Ew3lpQy8q85ASKWypaYcPRAs5U+
yYELfy4cf5ooSUta0pKWtKQlLWlJS1rSkpa0pCUtaUlLWtKSlrSkJS1pSUtafn7K/wDHFrJI
AHgAAA==
--------------061AE9919641E938D22941BD--