How to Deny Googlebot, Spider.Yandex.com and other bot and Spammers

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • wtrk68
    Member
    • Apr 2015
    • 75
    • 4.2.x

    How to Deny Googlebot, Spider.Yandex.com and other bot and Spammers

    Last 1 month there so many attack and request to my forum and this visitors use too much CPU and getting my forum down.

    I want to deny googlebot, spider.yandex.com and linguee.com bots.

    Please what kind of prevention I can use ?

    Thanks for your advance ?

    I tried to make with .htaccess but Im not sure its success or no..

    This is .htaccess code.

    Code:
    RewriteEngine On
    Options +FollowSymlinks
    Deny from 217.172.189.0/24
    Deny from 93.158.166.0/24
    Deny from 66.249.73.0/24
    Allow from all
    
    RewriteEngine On
    Options +FollowSymlinks
    RewriteCond %{HTTP_USER_AGENT} Baiduspider [NC]
    RewriteRule .* – [F,L]


    Note :
    217.122.189.0/24 Linguee.com
    93.158.166.0/24 spider.yandex.com
    66.249.73.0/24 spider.yandex.com

  • Wayne Luke
    vBulletin Technical Support Lead
    • Aug 2000
    • 73981

    #2
    That looks like it should do it. However, if you need help with .htaccess and banning these bots, you should discuss this with your hosting provider. They may have a more robust means to do this.
    Translations provided by Google.

    Wayne Luke
    The Rabid Badger - a vBulletin Cloud demonstration site.
    vBulletin 5 API

    Comment

    widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
    Working...