USER AGENT BOT called "crawl"

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • GoHighVoltage
    Senior Member
    • Dec 2010
    • 330
    • 4.2.x

    USER AGENT BOT called "crawl"

    I have a bot that uses a noticeable amount of resources on my sites and its a bot called "crawl". I cannot find any info on this user agent name. Anyone have any ideas? I am thinking to block it but I don't know who it is.

    Thanks!
  • Wayne Luke
    vBulletin Technical Support Lead
    • Aug 2000
    • 74132

    #2
    Who owns its IP Address? That will usually give a hint as to where it comes from. However, if it is participating in unsavory behavior then you should just control it with your server tools.
    Translations provided by Google.

    Wayne Luke
    The Rabid Badger - a vBulletin Cloud demonstration site.
    vBulletin 5 API

    Comment

    widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
    Working...