Re: 1 Million users.. I can't Scale!!

skip@pobox.com wrote:

> Damjan> Is there some python module that provides a multi process Queue?
>
> Skip> Not as cleanly encapsulated as Queue, but writing a class that
> Skip> does that shouldn't be all that difficult using a socket and the
> Skip> pickle module.
>
> Jeremy> What about bsddb? The example code below creates a multiprocess
> Jeremy> queue.
>
>I tend to think "multiple computers" when someone says "multi-process". I
>realize that's not always the case, but I think you need to consider that
>case (it's the only practical way for a multi-process application to scale
>beyond a few processors).
>
>Skip
>
>
Doh! I'll buy that. When I hear "multi-process", I tend to think of
folks overcoming the scaling issues that accompany the GIL. This, of
course, won't scale across computers without a networking interface.

- JMJ
Received on Thu Sep 29 19:17:41 2005