Hello.
Its strange, I have a VPS and today writte to me that indicate this:
Yes, I have a legacy VPS I think that, its for change my actual legacy VPS to the new SSD VPS, but, its possible that I have this load cpu by bots?
Its possible solved this?
I disable the site for 2 or 3 hours, and the load of cpu are about 1.60 / 1.80
I think its much load when I have disabled my site.
I have a robots.txt:
Thanks in advance.
Its strange, I have a VPS and today writte to me that indicate this:
Code:
Unfortunately your VPS is consuming more than its fair share of CPU resources. Our Acceptable Use Policy defines CPU abuse as occurring when a VPS uses "25% or more of system CPU resources for longer then 90 seconds." Your VPS has been sporadically using significant CPU resources on the node: ==== 00:00:02 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 blocked 01:20:01 8 238 3.06 2.75 2.40 1 02:20:01 8 228 3.44 3.02 2.55 0 02:30:01 7 223 3.20 3.08 2.76 0 03:30:01 7 234 3.58 2.72 2.40 0 04:00:01 11 269 3.01 2.59 2.33 0 05:00:01 8 233 3.45 2.90 2.51 0 05:10:01 9 228 3.33 3.49 3.00 0 12:20:01 10 223 3.15 2.66 2.33 0 12:40:01 6 222 3.14 2.94 2.66 0 13:50:01 9 266 3.35 2.29 2.10 0 ==== It looks like you have some over-aggressive bot crawling, based on user agent counts from the logs of mydomain.com: ==== # grep '28\/Dec\/2018:1[45678]:..:..' /home/mydomain/access-logs/mydomain.com-ssl_log | rev | cut -d'"' -f2 | rev | sort | uniq -c | sort -n | awk '$1 > 100 {print}' | grep -i 'bot\|crawl\|scrape\|proxy' 110 magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net) 119 Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:49.0) Gecko/20100101 Firefox/49.0 (FlipboardProxy/1.2; +http://flipboard.com/browserproxy) 129 Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php) 202 Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) 553 Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/50.0 767 Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/) 771 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) 1056 Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 2310 Mozilla/5.0 (compatible; musobot/1.0; [email protected]; +http://www.muso.com) 4442 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 5042 Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html) 7785 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/) 167660 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) ==== We recommend reviewing your configurations for bot crawling and adjust for much less aggressive trawling. If you're on a legacy VPS plan, I recommend considering one of our new SSD-backed MVPS plans. The new plans have stricter core limits which should help normalize CPU usage, making unintentional CPU abuse less likely. You can find pricing details here, and please don't hesitate to contact xxx if you have any questions about upgrading: xxx Please understand that we are attempting to bring this to your attention so that it can be corrected. We appreciate your continued patronage with KnownHost. We will need to hear back from you in regards to the issue(s) described in this Abuse ticket within 24 hours. *** IMPORTANT: Our Abuse representatives are available during daytime hours in the EST/EDT timezone. For immediate technical assistance, or for general inquiries outside business hours, please open a ticket with our Support department at xxxxxxxx
Its possible solved this?
I disable the site for 2 or 3 hours, and the load of cpu are about 1.60 / 1.80
I think its much load when I have disabled my site.
I have a robots.txt:
Code:
User-agent: Mediapartners-Google Disallow: User-agent: https://webproxy.vpnbook.com/ Disallow: User-agent: Baiduspider Disallow: / User-agent: * Disallow: *.js Disallow: /cable/ Disallow: /test/ Disallow: /images/ Disallow: /foro/mybackup/ Disallow: /foro/madp/ Disallow: /foro/admincp/ Disallow: /foro/attachments/ Disallow: /foro/clientscript/ Disallow: /foro/cpstyles/ Disallow: /foro/customavatars/ Disallow: /foro/customgroupicons/ Disallow: /foro/customprofilepics/ Disallow: /foro/downloads/ Disallow: /foro/images/ Disallow: /foro/install/ Disallow: /foro/modcp/ Disallow: /foro/ajax.php Disallow: /foro/attachment.php Disallow: /foro/calendar.php Disallow: /foro/cron.php Disallow: /foro/editpost.php Disallow: /foro/global.php Disallow: /foro/image.php Disallow: /foro/inlinemod.php Disallow: /foro/joinrequests.php Disallow: /foro/login.php Disallow: /foro/member.php Disallow: /foro/memberlist.php Disallow: /foro/misc.php Disallow: /foro/moderator.php Disallow: /foro/newattachment.php Disallow: /foro/newreply.php Disallow: /foro/newthread.php Disallow: /foro/online.php Disallow: /foro/postings.php Disallow: /foro/report.php Disallow: /foro/reputation.php Disallow: /foro/search.php Disallow: /foro/sendmessage.php Disallow: /foro/showgroups.php
Comment