I have a bot that uses a noticeable amount of resources on my sites and its a bot called "crawl". I cannot find any info on this user agent name. Anyone have any ideas? I am thinking to block it but I don't know who it is.
Thanks!
Thanks!
Comment