[Phpwm] Problems with live Silverstripe website (httpd spawing proceses, high CPU)

David Goodwin david at codepoets.co.uk
Fri Aug 20 08:34:37 UTC 2010


> 
> 
> David, is that apache plugin likely to blacklist google when it tries
> to index a site? as that would be a clear downside.



My understanding is that Google is quite good at indexing a site... and
does a little, and then comes back, does a little more etc - rather than
trying to DOS your site.

And even if google were misbehaving, I think you can (if you need to)
specify a spider rate through the webmaster's site @ google.

David.




More information about the Phpwm mailing list