Google dance and lots 'o spiders!

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Joe
    Senior Member
    • May 2000
    • 2435

    Google dance and lots 'o spiders!

    Looks like googe is dancing. I hope i get my deep crawl indexed, but dont see any signs of it just yet...

    I also noticed i have had deep crawl spiders from teoma, looksmart, and inktomi on my forum for the last 72+ hrs. My logs show they have picked up some 40,000 pages combined, woohoo!

    Has anyone else noticed that alot of spiders are deep crawling as of late? This is my first deep crawl in over a year... Its about time they came back!
    Bike Forums.net
  • EchoHype
    Member
    • Feb 2002
    • 70

    #2
    Yep, same here.

    I had google yesterday, looksmart today.

    And they keep coming back, heh

    Comment

    • Joe
      Senior Member
      • May 2000
      • 2435

      #3
      I should post more often. I just checked my whos online, and see that the AV spider is there... drone6.sv.av.com
      Bike Forums.net

      Comment

      • jmd
        Senior Member
        • Jan 2002
        • 666

        #4
        Me to

        Had all of the above at my forum, and now google is doing its deep crawl.

        Not sure if it will have any great results in membership(people that post and not the people that register and never come back for some strange reason lol)

        I may be changing the format, if it dosen't pick up. Already have the new URL
        PLEASE VISIT US HERE. THANKS IN ADVANCE

        Comment

        • Joe
          Senior Member
          • May 2000
          • 2435

          #5
          Google ususaly does a deepcrawl days after the dance. I removed sessionhash for spiders last night., I hope google can pick up ALL my threads... sure would be nice
          Bike Forums.net

          Comment

          • dpkm
            Member
            • Dec 2002
            • 55
            • 3.6.x

            #6
            Thought I should mention that Google is successfully crawling the vbulletin3 Archive on vbulletin.com. Some people had some concerns that Google wouldn't successfully crawl the archives.

            Comment

            • draytonwoods
              New Member
              • Feb 2002
              • 5

              #7
              some have reported that this session crawl is reported with spammers and the porn problem... just a note... I have the same at my boards and it seems kinda strange.. I tuned resolve ips off for now and banned he ips.. just for safety sakes.

              mark.

              Comment

              • filburt1
                Senior Member
                • Feb 2002
                • 6606

                #8
                Googlebot swarmed my sites yesterday and today. It does that every month or two with this intensity.
                --filburt1, vBulletin.org/vBulletinTemplates.com moderator
                Web Design Forums.net: vB Board of the Month
                vBulletin Mail System (vBMS): webmail for your forum users

                Comment

                • nuno
                  Senior Member
                  • Apr 2001
                  • 4346
                  • 3.8.x

                  #9
                  Originally posted by dpkm
                  Thought I should mention that Google is successfully crawling the vbulletin3 Archive on vbulletin.com. Some people had some concerns that Google wouldn't successfully crawl the archives.
                  You sure?
                  I only get 3 archive links.


                  You're my Prince of Peace
                  And I will live my life for You

                  Comment

                  • ManagerJosh
                    Senior Member
                    • Jun 2002
                    • 9922

                    #10
                    I agree with Nuno.....it seems a bit...small on the side..
                    ManagerJosh, Owner of 4 XenForo Licenses, 1 vBulletin Legacy License, 1 Internet Brands Suite License
                    Director, WorldSims.org | Gaming Hosting Administrator, SimGames.net, Urban Online Entertainment

                    Comment

                    • CeleronXT
                      Senior Member
                      • Mar 2002
                      • 3217

                      #11
                      Heh, google must be dancing.. My admin control panel for my hosting has a page rank of 9/10.
                      "63,000 bugs in the code, 63,000 bugs, you get 1 whacked with a service pack, now there's 63,005 bugs in the code."
                      "Before you critisize someone, walk a mile in their shoes. That way, when you critisize them, you're a mile away and you have their shoes."
                      Utopia Software - Current Software: Utopia News Pro (news management system)

                      Comment

                      • phenom
                        Senior Member
                        • Feb 2003
                        • 354

                        #12
                        how are you obtaining this information? What logs are you talking about?

                        Comment

                        • phenom
                          Senior Member
                          • Feb 2003
                          • 354

                          #13
                          anybody got any love for me on this one? ^

                          Comment

                          • Joe
                            Senior Member
                            • May 2000
                            • 2435

                            #14
                            I use "Analog", or sometimes, i'll download the raw scripts via ftp, and do a search for "googlebot". I'm sure there are more ways to do so, I only looked after seeing some 20+ bots on my whosonline for the last week

                            Freshbot from google hit my forums last night, i hope they deepcrawl SOON. I want to get all my new dynamic content there. i finaly removed sessionhash, cant wait for next update!!
                            Bike Forums.net

                            Comment

                            widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
                            Working...