[Gllug] Web Spider recommendation

[neil c]

Hey all,

Can anyone recommend some Web Spidering software (yeah yeah - Google is 
pretty cool ;-)) Basically I want to catalog all valid sites on a given 
subnet. I can't do zone transfers and don't want to put something 
together (nmap piped output looks like a strong option) if there is 
already a round peg for my round query.

(a quick google turned up JSpider. Anyone used this?)

Good day to you all :-)
neil

-- 
Gllug mailing list  -  Gllug at gllug.org.uk
http://lists.gllug.org.uk/mailman/listinfo/gllug