Multi platform, high volume data recording

[Dirk Koopman]

Lyle - CosmicPerl.com wrote:
> David Cantrell wrote:
>> On Sun, Nov 11, 2007 at 02:25:03AM +0000, Lyle - CosmicPerl.com wrote:
>>
>>  
>>> What's worrying me at the moment is the emailing side of things. 
>>> There could potentially be a newsletter going out daily to a mailing 
>>> list of over 90,000.
>>>     
>>
>> *TWANG*
>>
>> That was my spammer-sense making me go all tingly.  I do hope you're not
>> up to anything I wouldn't approve of.
>>   
> 
> Christ no! Jesus, what do you think of me?? I don't wanna go to jail. My 
> client is big, they'll most likely build up a lot of subscribers.
> 
> I've got a double opt in list of over 14,000 myself that I can test 
> methods on. I don't like the idea of sending it all to the mail server 
> in one, as I've had problems with sendmail falling over in the past. I'd 
> split it into chunks, and send it over every few minutes.
> 
> 

Use exim.

One 90,000 subscriber messages per day would not be a problem (I am 
assuming that you send one email with 90,000 <rcpt-to>s [maybe batched 
up in 1000 address chunks, but that is premature optimisation ;-])

The big advantage of exim over the others is that it is better at 
determining and using the sites where it can do common MX caching and 
delivery (i.e. the likelihood of at least a 1000 of those 90,000 all 
going to hotmail/microsoft/whoever is the market leader in the sector 
you are targetting, @addresses). So it actually ends up that 90,000 
emails is nearer 9000 real SMTP conversations.

Dirk