Sal Collaziano
Tue 26th Jun '07, 10:31am
What can I do about this? I have a fairly powerful server and I see my CPU usage spike due to httpd connections from 1.00 to 30.00 in a matter of seconds. The only thing I can see doing this are these Yahoo! Slurp spiders. But I NEED these things. Don't I?
How does everybody else live with this? I DO want Yahoo to list all my pages... Is this temporary until everything gets indexed? I haven't had the greatest Yahoo! ranking in quite some time and now things are improving - likely because of these spiders...
What do I do?
Thanks in advance...
How does everybody else live with this? I DO want Yahoo to list all my pages... Is this temporary until everything gets indexed? I haven't had the greatest Yahoo! ranking in quite some time and now things are improving - likely because of these spiders...
What do I do?
Thanks in advance...