[Zope] The Principles of Designing a Heavy Load Site with Zope

iap@y2fun.com iap@y2fun.com
Sun, 3 Mar 2002 12:42:45 +0800


This is a multi-part message in MIME format.

------=_NextPart_000_0011_01C1C2B0.EB3905E0
Content-Type: text/plain;
	charset="big5"
Content-Transfer-Encoding: quoted-printable

Hi,
This issue has been discussed again and again,
I would like to clarify my idea and your comments will be very =
appreciated.
Suppose we want to provide a server which is:
1) Hosting 1,000,000 members' profile. Each member's disk quota is 5MB.
   Which means we need at least 5,000GB (5 TeraGB) disk space.
2) Assume the concurrent accessing to a URL is 1000 request/per second
3) Assume all the requests retrieve dynamic content.=20
4) We want to leverage the power of Zope which means all the pages =
should be=20
   rendered by zope.

The priciples I would like to verify are:
1) Some database (RDBMS) should be used instead of FileStorage for ZODB.
2) The ZEO should be used for constructing a cluster computing.
3) The Apache should be the front end instead of ZServer.
4) The PCGI should be the connection between Apache and Zope.
5) I shouldn't create static instance into the ZODB but query the=20
   external database.
6) The "Cache" of zope is useless since all the responses are dynamic =
rendered.

By the way, how much will this kind of system costs, regardless the =
hardware?

Iap, Singuan


------=_NextPart_000_0011_01C1C2B0.EB3905E0
Content-Type: text/html;
	charset="big5"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=3DContent-Type content=3D"text/html; charset=3Dbig5">
<META content=3D"MSHTML 5.50.4522.1800" name=3DGENERATOR>
<STYLE></STYLE>
</HEAD>
<BODY bgColor=3D#ffffff>
<DIV><FONT face=3DMingLiu size=3D2>Hi,</FONT></DIV>
<DIV><FONT face=3DMingLiu size=3D2>This issue&nbsp;has been =
discussed&nbsp;again and=20
again,</FONT></DIV>
<DIV><FONT face=3DMingLiu size=3D2>I would like to clarify my idea and =
your comments=20
will be very appreciated.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>Suppose we want to provide =
a server which=20
is:</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>1) Hosting 1,000,000 =
members' profile. Each member's=20
disk quota is 5MB.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>&nbsp;&nbsp; Which means =
we need at=20
least&nbsp;5,000GB (5 TeraGB) disk space.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>2) Assume the concurrent =
accessing to a URL is 1000=20
request/per second</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>3)&nbsp;Assume all the =
requests&nbsp;retrieve=20
dynamic&nbsp;content.&nbsp;</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>4) We want to leverage the =
power of Zope which means=20
all the&nbsp;pages should be </FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>&nbsp;&nbsp; rendered by =
zope.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>The priciples I would like =
to verify=20
are:</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>1)&nbsp;Some database =
(RDBMS)&nbsp;should be used=20
instead of FileStorage for ZODB.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>2) The ZEO should be used =
for constructing a cluster=20
computing.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>3) The Apache should =
be&nbsp;the front end instead of=20
ZServer.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>4) The PCGI should be the =
connection between Apache=20
and Zope.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>5) I shouldn't create =
static instance into the ZODB=20
but query the </FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>&nbsp;&nbsp; =
external&nbsp;database.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>6) The "Cache" of zope is =
useless since all the=20
responses&nbsp;are dynamic rendered.</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>By the way, how =
much&nbsp;will this kind=20
of&nbsp;system costs, regardless the hardware?</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 size=3D2>Iap, Singuan</FONT></DIV>
<DIV><FONT face=3D=B2=D3=A9=FA=C5=E9 =
size=3D2></FONT>&nbsp;</DIV></BODY></HTML>

------=_NextPart_000_0011_01C1C2B0.EB3905E0--