[Gllug] Lots of computing power required - is Amazon EC2 an answer?

James Courtier-Dutton james.dutton at gmail.com
Fri Jul 1 13:27:56 UTC 2011


On 30 June 2011 23:05, Adrian McMenamin <adrian at mcmen.demon.co.uk> wrote:
> I have struggled to find an algorithmic way out of this - but cannot see one.
>
> I have some code which is very parallelisable but requires huge computing
> resources - on a AMD 64 dual box I have here I reckon it will take about
> 20 days to run - but if I had access to about 600 CPUs it might take 20 -
> 30 minutes (it's run against a massive XML file - 800 MB or so - with
> different parameters)
>
> I am also doing this for a student project so have no big budget to spend
> - but would be willing to spend some money.
>
> Is Amazon EC2 a possible answer - it seems less than clear to me if this
> is about web serving or computing - so I thought I'd ask where people will
> know the answer straight away :)
>

Just put the data and source code on a web site somewhere.
I have access to huge compute resources.
I should be able to do a few days of that 20 day run using just idle
time CPU cycles.
I am sure other members of this list could do the same.
Between everyone, you should get your dataset completed sooner than 20
days, at no cost to yourself.
--
Gllug mailing list  -  Gllug at gllug.org.uk
http://lists.gllug.org.uk/mailman/listinfo/gllug




More information about the GLLUG mailing list