[Phpwm] Problems with live Silverstripe website (httpd spawing proceses, high CPU)
David Goodwin
david at codepoets.co.uk
Fri Aug 20 08:34:37 UTC 2010
>
>
> David, is that apache plugin likely to blacklist google when it tries
> to index a site? as that would be a clear downside.
My understanding is that Google is quite good at indexing a site... and
does a little, and then comes back, does a little more etc - rather than
trying to DOS your site.
And even if google were misbehaving, I think you can (if you need to)
specify a spider rate through the webmaster's site @ google.
David.
More information about the Phpwm
mailing list