[Gllug] [OT] Largest mailbox EVER!

Richard Jones rich at annexia.org
Mon Nov 17 16:31:47 UTC 2003


Back in the days when I worked for a small web-mail supplier, before
we fixed all the bugs in the quota system, we had some mailboxes which
would accumulate multiple millions of messages (mainly spam). This was
in maildir format, so you had a directory with millions of files in
it.

ext2 behaves *really* pessimally when you have a directory with
millions of files in it. Any process that touches the directory starts
consuming massive amounts of CPU in system state. The NFS daemon in
particular. You have a limited number of NFS daemons, and as each one
got "stuck" on one of the huge directories in question, it stopped
servicing other users. Gradually things ground to a halt.

In the end I had to write a script which read the unsorted directory
entry and deleted the files in unsorted order, in groups of 10,000.

Not nice. Though to be fair, Linux didn't crash ...

But I agree, 15 GB for a mailbox must be some sort of record. Perhaps
a record in foolishness, but a record nevertheless.

Rich.

-- 
Richard Jones. http://www.annexia.org/ http://freshmeat.net/users/rwmj
Merjis Ltd. http://www.merjis.com/ - improving website return on investment
MAKE+ is a sane replacement for GNU autoconf/automake. One script compiles,
RPMs, pkgs etc. Linux, BSD, Solaris. http://www.annexia.org/freeware/makeplus/

-- 
Gllug mailing list  -  Gllug at linux.co.uk
http://list.ftech.net/mailman/listinfo/gllug




More information about the GLLUG mailing list