Re: 1 Million users.. I can't Scale!!
Available news archives: comp.lang.tcl - comp.lang.python - comp.security.firewalls - sci.crypt - comp.lang.php - comp.lang.javascript
Google
 
Web news.hping.org


comp.lang.python archive

Re: 1 Million users.. I can't Scale!!

From: Jeff Schwab <jeffrey.schwab@rcn.com>
Date: Thu Sep 29 2005 - 00:30:55 CEST

skip@pobox.com wrote:
> Damjan> Is there some python module that provides a multi process Queue?
>
> Skip> Not as cleanly encapsulated as Queue, but writing a class that
> Skip> does that shouldn't be all that difficult using a socket and the
> Skip> pickle module.
>
> Jeremy> What about bsddb? The example code below creates a multiprocess
> Jeremy> queue.
>
> I tend to think "multiple computers" when someone says "multi-process". I
> realize that's not always the case, but I think you need to consider that
> case (it's the only practical way for a multi-process application to scale
> beyond a few processors).

How many are more than "a few?"

I think processors with multiple cores per die are going to be far more
mainstream within the next few years, so I still don't think of multiple
computers for most of my multi-processing.
Received on Thu Sep 29 19:17:37 2005