[Gllug] lots of little files

[John Hearns]

On Sat, 2005-10-15 at 01:46 +0100, Minty wrote:
> I have a little script, the job of which is to create a lot of very
> small files (~1 million files, typically ~50-100bytes each).
Tuning? There's always more than one way to do it.
Use a database for a task like this.

> 
> without spending loadsa cash on shiny raid / sata / scsi disks,
> without reformatting the disk and loosing all the nice other stuff on there
> without re-installing a different kernel etc
> 
> is there anything sensible I can do to tweak the disk IO a bit?
Under 2.4 kernels I have looked at disk elevator tuning,
using the elvtune command. Not relevant to 2.6

Suggest maybe creating a new partition with a different filesystem.
Maybe try Reiser, which is supposed to be good with lots of little
files.


-- 
Gllug mailing list  -  Gllug at gllug.org.uk
http://lists.gllug.org.uk/mailman/listinfo/gllug