Banned by my hosting because multiple 404 errors per sec

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • duditas
    New Member
    • Jul 2006
    • 25
    • 3.6.x

    [Forum] Banned by my hosting because multiple 404 errors per sec

    Hello, I'll try to explain myself as well as I can, my english is awfull. What happened with spanish support?


    The firewall of my hosting is blocking me once and again because multiple 404 errors per sec



    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/mobiquo/tapatalkdetect.js, referer:http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/twitter, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/twitter, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/mobiquo/tapatalkdetect.js, referer:http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/twitter, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/showthread.php?t=44935
    [Wed Jun 04 23:53:23 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/twitter, referer: http://www.happydjs.com/showthread.php?t=44935
    [Wed Jun 04 23:53:19 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/forumdisplay.php?f=4
    [Wed Jun 04 23:53:19 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/mobiquo/tapatalkdetect.js, referer:http://www.xxxx.com/forumdisplay.php?f=4
    [Wed Jun 04 23:53:19 2014] [error] [client xx.216.xxx.152] File does not exist: /home/XXXX/public_html/404.shtml, referer: http://www.xxxx.com/forumdisplay.php?f=4


    When a database error occurs, I receive an email; not in that case, so it's not a database error, is it?

    I have never had a 404.shtml archive. Obviously these urls exist.

    Everithing I do in my forum, creates an error at "error log" window of my cpane. Editing, deleting, posting, loging... everything causes error 404


    My hoster says it's not his issue, everything in the server is ok, but my users are been banned by his firewall everyday.

    Disk Space Usage 666.21 MB / 1,000 MB
    MySQL Disk Space 141.49 MB
    Apache version 2.2.26
    PHP version 5.3.27
    MySQL version 5.1.73-cll
    Architecture x86_64
    Operating system linux

    I have change friendly urls. I only can choose between Standard URLs and Basic Friendly URLs. I have tried with both and I had the same problem.


    I have my forum updated to version 4.2.2 Patch Level 1. My theme is default. My addons are disabled, even Tapatalk.

    I really need help, please
  • Zachery
    Former vBulletin Support
    • Jul 2002
    • 59097

    #2
    Looks like you have a tapatalk addon installed, but not their files.

    I don't see how 404 files are causing your server to crash...

    Comment

    • duditas
      New Member
      • Jul 2006
      • 25
      • 3.6.x

      #3
      No Zachery, all Tapatalk's files are installed. It was working fine untill I disabled it.
      mobiquo/tapatalkdetect.js, is not in Tapatalk's rar anymore. I have searching in Google and I've found the solution. I've deleted one line of obsolete code from my template code, and that's all.



      Is the hosting firewall who banned me because it receives lots of 404 error warnings from my IP. They told me that more than 30/300 sec, in my case, last time.


      This is what happens when I browse through my forum right now

      [Thu Jun 05 06:23:53 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: http://www.***.com/forumdisplay.php?f=116
      [Thu Jun 05 06:23:53 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/twitter, referer: http://www.***.com/forumdisplay.php?f=116
      [Thu Jun 05 06:23:53 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: http://www.***.com/forumdisplay.php?f=116
      [Thu Jun 05 06:23:53 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/twitter, referer: http://www.***.com/forumdisplay.php?f=116
      [Thu Jun 05 06:23:49 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: http://www.***.com/forumdisplay.php?f=36
      [Thu Jun 05 06:23:49 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/twitter, referer: http://www.***.com/forumdisplay.php?f=36
      [Thu Jun 05 06:23:49 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: http://www.***.com/forumdisplay.php?f=36
      [Thu Jun 05 06:23:49 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/twitter, referer: http://www.***.com/forumdisplay.php?f=36
      [Thu Jun 05 06:23:46 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: http://www.***.com/forumdisplay.php?f=44
      [Thu Jun 05 06:23:46 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/twitter, referer: http://www.***.com/forumdisplay.php?f=44
      [Thu Jun 05 06:23:46 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: http://www.***.com/forumdisplay.php?f=44

      * I hide my url because I don't want to do spam



      Everything I do, even log in, sends a 404 error to the server, although I log in without any problem, but firewall detect all of this as "attacks"


      The hoster has put my ip address in a white list, to let me work, but he warn me to find out what causes these errors, in order to let other people work and stop losing users.

      Comment

      • BirdOPrey5
        Senior Member
        • Jul 2008
        • 9613
        • 5.6.3

        #4
        Did you by chance install any mods lately? One that generates 404 errors foe search engines?

        Comment

        • duditas
          New Member
          • Jul 2006
          • 25
          • 3.6.x

          #5
          No, I didn't. Tapatalk was the last and the only one this year. My forum was hacked and I disabled most mods, Joe.

          I can't understand why suddenly the server is asking for an 404.shtml file. I never had one.

          Do you think, If I put in my ftp an empty 404.shtml and ask my hoster to create a redirection to it, the problem will disappear?

          Comment

          • donald1234
            Senior Member
            • Oct 2011
            • 1953
            • 4.1.x

            #6
            These are files that used to be on your server but no longer exist 404 just means not found. Bots that have accessed those files when they existed are still trying to access them and getting 404 not found errors. You could create twitter directory (/home/XXXX/public_html/twitter) and put an empty .html file inside, that way the bots would see an empty file and you won't get an error, you would need an empty /home/XXXX/public_html/mobiquo/tapatalkdetect.js file too or just re-install tapatalk.

            Comment

            • BirdOPrey5
              Senior Member
              • Jul 2008
              • 9613
              • 5.6.3

              #7
              You should just be able to creat a file called 404.shtml and upload it to your website root directory...

              An error like this-
              Code:
              [Thu Jun 05 06:23:53 2014] [error] [client XXX] File does not exist: /home/XXX/public_html/404.shtml, referer: [URL]http://www.***.com/forumdisplay.php?f=116[/URL]
              Means someone clicked on some link on that page and it took them to a 404 page but the 404 page itself was missing.

              When I go to your site I can replicate this by clicking on the Archive link in your footer. It appears you have deleted your /archive/ directory but not removed the link from your footer so if anyone clicks on it (or any spider tries to crawl it) the double-error is generated.

              You can remove the archive link by going to Admin CP -> Settings -> Options -> Search Engine Friendly Archive -> and set Enabled to No.

              I bet that will stop many of the errors.

              You should still create a 404.shtml error page however.

              Comment

              • duditas
                New Member
                • Jul 2006
                • 25
                • 3.6.x

                #8
                A few months ago, my forum was hacked many, many times and a programer that I knew helped me changing the name of various files/folders.
                I didn't delete /archive/ directory, maybe it was him who did it. I have removed the archive link, anyway.

                I have created an archive 404.shtml and a /twitter/ directory (it was a pluging I used to have, but not any more).


                But something strange has happened today. See this : [Thu Jun 05 19:45:21 2014] [error] [client XXX.XXX.XXX] File does not exist: /home/helppy/public_html/ran, referer: http://xxxx.com/ran/index.htm


                I have not created any /ran/ directory!! It was not there yesterday!!

                Inside it there are a folder called "index_files" and two archives: doc.php and index.htm. Inside the folder there are some files more (see the image attached)


                I'm afraid I have been hacked again, maybe that's why I'm having so much trouble. What do you think? =(
                Attached Files

                Comment

                • duditas
                  New Member
                  • Jul 2006
                  • 25
                  • 3.6.x

                  #9
                  It's absurd, I solve some errors and others appear

                  [Thu Jun 05 20:36:41 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:36:12 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:35:44 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:34:48 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:34:19 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:32:14 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/ran
                  [Thu Jun 05 20:30:05 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:29:37 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/threads
                  [Thu Jun 05 20:29:28 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/403.shtml
                  [Thu Jun 05 20:29:28 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/403.shtml
                  [Thu Jun 05 20:29:28 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/403.shtml
                  [Thu Jun 05 20:29:27 2014] [error] [client XXXXX] File does not exist: /home/*****/public_html/403.shtml


                  I have never had a /threads/ directory

                  And see what happens when I enter to a specific post
                  [Thu Jun 05 20:42:47 2014] [error] [client XXXXXX] File does not exist: /home/*****/public_html/images/aria, referer: http://www.xxxx.com/showthread.php?3...-AH-AlemHouser

                  /images/aria? Oò

                  The firewall never will stop banning. This is frustrating =(

                  Comment

                  • Wayne Luke
                    vBulletin Technical Support Lead
                    • Aug 2000
                    • 74167

                    #10
                    Turn off Mod_Rewrite under Settings -> Options -> Friendly URLs. You can only use that if you upload the corresponding .htaccess to perform the rewrites needed.
                    Translations provided by Google.

                    Wayne Luke
                    The Rabid Badger - a vBulletin Cloud demonstration site.
                    vBulletin 5 API

                    Comment

                    • duditas
                      New Member
                      • Jul 2006
                      • 25
                      • 3.6.x

                      #11
                      I'm not using Mod_Rewrite, Wayne, I'm using Basic Friendly URLs. I never had problems with it.

                      Basic Friendly URLs are better for indexing, aren't they? I'll put Standard URLs again, just in case. Thank you

                      Comment

                      • Wayne Luke
                        vBulletin Technical Support Lead
                        • Aug 2000
                        • 74167

                        #12
                        The only way "threads" would be in a url coming to your site would be with using mod_rewrite. Might just want to look up how to redirect 404 errors to your site homepage using 301 redirects via .htaccess and clean your logs nightly until the 404s go away. They'll eventually be gone.
                        Translations provided by Google.

                        Wayne Luke
                        The Rabid Badger - a vBulletin Cloud demonstration site.
                        vBulletin 5 API

                        Comment

                        • BirdOPrey5
                          Senior Member
                          • Jul 2008
                          • 9613
                          • 5.6.3

                          #13
                          Do you have an .htaccess file? if so, what are the contents? Anything in there mention a /threads/ directory or anything else?

                          None of the files in the ./ran/ directory image you provided have anything to do with vBulletin. Do you have other software installed elsewhere? like Wordpress?

                          Comment

                          • duditas
                            New Member
                            • Jul 2006
                            • 25
                            • 3.6.x

                            #14
                            Originally posted by Joe D.
                            Do you have an .htaccess file? if so, what are the contents? Anything in there mention a /threads/ directory or anything else?

                            None of the files in the ./ran/ directory image you provided have anything to do with vBulletin. Do you have other software installed elsewhere? like Wordpress?

                            I don't know a word of programing. This is the only htaccess file that I have and I don't have any idea of who put it there. Maybe the programmer who helped me when I was hacked or maybe the hosting owner.

                            RewriteEngine on
                            <Files home/h***/public_html/includes/config.php>
                            order allow,deny
                            deny from all
                            </Files>

                            RewriteCond %{HTTP_REFERER} !^http://happydjs.com/.*$ [NC]
                            RewriteCond %{HTTP_REFERER} !^http://happydjs.com$ [NC]
                            RewriteCond %{HTTP_REFERER} !^http://www.happydjs.com/.*$ [NC]
                            RewriteCond %{HTTP_REFERER} !^http://www.happydjs.com$ [NC]
                            RewriteRule .*\.(jpg|jpeg|gif|png|bmp)$ - [F,NC]

                            RewriteCond %{HTTP_HOST} ^happydjs\.com$ [OR]
                            RewriteCond %{HTTP_HOST} ^www\.happydjs\.com$
                            RewriteRule ^404\.shtml\/?(.*)$ "http\:\/\/www\.happydjs\.com\/$1" [R=301,L]

                            *Sorry for let the url, I think so you can see better if there is an error



                            /ran/ directory is not mine either. My hoster says that my pc must have some troyan and maybe a hacker has put it there.
                            But I don't have any troyan and my ftp's password is not easy to write.
                            It's very strange. I deleted it yesterday and today there it is again!

                            By the way, no, I don't have other software installed. When I was hacked I deleted everything in my ftp and I uploaded a clean vBulletin with a just a couple of addons. Maybe that's why I'm having so many troubles with 404 errors



                            Here it is my error log right now

                            [Fri Jun 06 14:48:26 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/threads, referer: http://www.XXXX.com/threads/43280-VA...The-Remix-2011
                            [Fri Jun 06 14:45:14 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/properties/index.htm
                            [Fri Jun 06 14:41:36 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/threads
                            [Fri Jun 06 14:39:04 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/vb/activitystream/googledoc
                            [Fri Jun 06 14:34:14 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/properties/index.htm
                            [Fri Jun 06 14:23:32 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/properties/index.htm
                            [Fri Jun 06 14:21:46 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/members
                            [Fri Jun 06 14:21:08 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/threads
                            [Fri Jun 06 14:16:48 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/redirector.php
                            [Fri Jun 06 14:13:19 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/properties/index.htm
                            [Fri Jun 06 14:09:49 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/threads
                            [Fri Jun 06 14:09:29 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/Validate
                            [Fri Jun 06 14:07:44 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/components
                            [Fri Jun 06 14:07:44 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/components
                            [Fri Jun 06 14:07:43 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/components
                            [Fri Jun 06 14:06:27 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/threads
                            [Fri Jun 06 14:02:11 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/properties/index.htm
                            [Fri Jun 06 13:52:25 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/images/cms/properties/index.htm
                            [Fri Jun 06 13:46:21 2014] [error] [client XXXXXXX] File does not exist: /home/XXX/public_html/threads


                            I never had Wordpress. I have never used mod_rewrite, because nobody wants to tell me what should I write in ,htaccess file.


                            I have created a /cms/properties/ directory and put an index.htm inside, I hope this error ends too


                            Thanks to God and to you errors seems to be less frequent. I hope this is enough to stop bannings


                            Now I am going to fight with /run/ file



                            Thank you all

                            Comment

                            • BirdOPrey5
                              Senior Member
                              • Jul 2008
                              • 9613
                              • 5.6.3

                              #15
                              Understand you are always going to get errors in your logs like this. The more popular your site is the more you will get- there is no way to force people to only access pages that really exist. From your latest logs there seems to be several minutes between errors- they aren't happening "constantly," That really shouldn't be that big a deal- it shouldn't be causing any problems.

                              Comment

                              widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
                              Working...