MESSAGE
| DATE | 2007-11-16 |
| FROM | Ron Guerin
|
| SUBJECT | Re: [NYLXS - HANGOUT] Website Updates
|
Ruben Safir wrote:
> I'm trying to open the mboxes (there are about 4 or them) and put them into an
> array. They are nearly 350 megs each and with gig of ram
>
> (Memory: 1033332k/1047744k available (2077k kernel code, 13764k reserved,
> 782k data, 212k init, 130240k highmem)
>
> I thought I'd have no trouble just absorbing them into an array and then
> working through it. Unfortunately this is proving to be too hard and the
> script is running slow and bringing the box to a halt. The gimp handles
> 3M images with no problem and runs fiilters on this, so I'm actually
> perplexed by this.
Big difference between 3M and 350M. Why do you need to hold the entire
contents of each message in memory at all times? Read a message, insert
it in the database. Loop until end of input files.
- Ron
|
|
