15 Googlebots are on my site

[Thomas P]

Hi,

just had a look to Whois Online on my forums and I saw 23 Users, pretty much for forums.

But ~15 out of them were googlebots :eek:

Never thought that bots come in such a numerous bunch :rolleyes:

Well, after all it's pretty cool that they index the forums and my archive :)
cu,
-Tom

[Thomas P]

Screenshot

[heretic]

yeah, I've had that on occasion.. too bad it messes up the "most users online"

[DirectPixel]

Forums need word association threads, lol. It gets good rankings on search engines.;):p

[Odil]

Just curious, how do you get your board to show the names instead of the ips like where it says it's a googlebot?

Odil



Originally posted by Thomas P
Screenshot

[CondorZ]

Originally posted by Odil
Just curious, how do you get your board to show the names instead of the ips like where it says it's a googlebot?

Odil





Look in the options menu in your admin CP; Resolve IPs>Yes.

[Odil]

Originally posted by CondorZ


Look in the options menu in your admin CP; Resolve IPs>Yes.

I knew that, was just seeing who else knew LOL

Thanks!

Odil

[Thomas P]

@heretic: yes, you're right...

Weird, they're still there botting my site *tsss
-Tom

[s.molinari]

Is it really called "botting" or isn't it called "crawling"?

Scott

[Chen]

Originally posted by s.molinari
Is it really called "botting" or isn't it called "crawling"?
"crawling" is the correct term. The machine itself is called a "crawler". (see the hostname of them in the screen shot?)

[Thomas P]

surfing, crawling, botting... bugging - whatever, I wasn't meaning to be technical correct ;)
Hmmm, they are still there. Ill see what happen, then might try this:
http://www.google.com/bot.html#howoften
cu,
-Tom

[bigmattyh]

I had 5 bots from some site crawling my forums for 3-4 days. I looked up the IPs, and they were all under the umbrella of plagiarism.org. Why they needed five bots all at once to spider my forums for more than an hour or so is beyond me.

[mjames]

I think this happened to me once. My max users online got pushed way up to like ~120+ due to crawlers. I finally got around to resetting it last week. :D

[Gary King]

Originally posted by bigmattyh
I had 5 bots from some site crawling my forums for 3-4 days. I looked up the IPs, and they were all under the umbrella of plagiarism.org. Why they needed five bots all at once to spider my forums for more than an hour or so is beyond me.

:eek:

tsk tsk LOL I wonder what you're hiding?? :p

[bigmattyh]

Originally posted by Blak n Wite
tsk tsk LOL I wonder what you're hiding?? :p It sure ain't Chaucer. Or anyone of literary merit. Most of the discussions on my forums are about which forms of undead can beat others and other such stimulating and life-enriching conversation.

[Thomas P]

I don't think this is the result of this run, but most of our pages incl. our archives and the rest of the forums :) were indexed by Google:
http://www.google.de/search?hl=de&ie=UTF-8&oe=UTF-8&q=hallo+site%3Amcseboard.de&meta=
Just a sample, these are very good news for us :cool:
AllTheWeb list many pages since quite a time:
http://www.alltheweb.com/search?cat=web&cs=utf-8&l=any&q=url.host%3Amcseboard.de
cu,
-Tom

[Raz Meister]

42 google bots on our forums right now :eek:

[Scott MacVicar]

I always called it spidering, your being spidered by a search engine :)

World Wide Web - Spider

/me rambles madly on

[Thomas P]

Yeah, the googlebots were again there yesterday :)

Pretty cool in combination with shabang's Archive hack (e.g. http://www.mcseboard.de/archiv/28/2002/07/4)

[webmasterforum]

lucky i read this thread, i was wondering how my board with only 31 members had managed to rack up 15 visitors online at the same time.

[bromyaur]

Ive had googlebot(crawl7) on my board for weeks now. I think he is trapped in a corner lol

[Floris]

Originally posted by Odil


I knew that, was just seeing who else knew LOL

Thanks!

Odil Uhm, that was dumb :confused:

[Chen]

Originally posted by xiphoid
Uhm, that was dumb :confused:
I think it's called a joke...

[Floris]

Originally posted by FireFly

I think it's called a joke... I totally see no use in posting a question, and let someone make an effort to awnser it then say 'i already knew that, just wanted to see if you knew'. Comon.. if that is a joke, ok.. its a dumb joke.

OH
If someone thinks I am offensive - hey . just a joke.

[Chen]

Originally posted by xiphoid
I totally see no use in posting a question, and let someone make an effort to awnser it then say 'i already knew that, just wanted to see if you knew'. Comon.. if that is a joke, ok.. its a dumb joke.

OH
If someone thinks I am offensive - hey . just a joke.
You don't get it, do you...
He asked a question, got his answer, say Thanks like a good boy, and added a joke on the side.

[Gary King]

Originally posted by FireFly

You don't get it, do you...
He asked a question, got his answer, say Thanks like a good boy, and added a joke on the side.

Err ok then :confused:

[Floris]

Originally posted by FireFly

You don't get it, do you...
He asked a question, got his answer, say Thanks like a good boy, and added a joke on the side. Hey, what is 1+1 ?

[heretic]

seven

[Floris]

uhm, on-topic again.

I also have a lot of crawlers and spiders and other bugs :) I don't mind it, but when they come in masses, it is annoying. One or two is fine, but 15 connections from 1 site, triggers my alarms. I have even set a few to the ban list, and added the rest to a redirect to display a page with gathered (most used) words from the frontpage/categories.

[Thomas P]

Originally posted by xiphoid
I don't mind it, but when they come in masses, it is annoying. One or two is fine, but 15 connections from 1 site, triggers my alarms.

Yes, you're perfectly right. Currently 31 googlebots are on our site, that's definetely a bit too much.

There's a germany saying: "Die Geister die ich rief"... :rolleyes:

[Gary King]

Originally posted by Thomas P


Yes, you're perfectly right. Currently 31 googlebots are on our site, that's definetely a bit too much.

There's a germany saying: "Die Geister die ich rief"... :rolleyes:

LoL :p

[Joe Gronlund]

Originally posted by Thomas P
Hi,

just had a look to Whois Online on my forums and I saw 23 Users, pretty much for forums.

But ~15 out of them were googlebots :eek:

yaa its funny when ya see them doing moderating duties :D :D

[Chen]

Originally posted by Thomas P
Yes, you're perfectly right. Currently 31 googlebots are on our site, that's definetely a bit too much.
You can always stop them.
http://www.google.com/bot.html#robotsinfo

[DirectPixel]

Originally posted by FireFly

You can always stop them.
http://www.google.com/bot.html#robotsinfo Everybody wants to be indexed. The problem is that dozens of spiders spend days at your site.

[nemesis01]

Be afraid when the day comes that they are so clever they can register and post.:D:p

[Chen]

Originally posted by eiSecure
Everybody wants to be indexed. The problem is that dozens of spiders spend days at your site.
You can't eat the cake and leave it whole.

[DirectPixel]

That was a reply in response to the post where it was mentioned that you can stop Google from indexing your site.:rolleyes:

[Gary King]

Originally posted by eiSecure
That was a reply in response to the post where it was mentioned that you can stop Google from indexing your site.:rolleyes:

You should quote the post next time :rolleyes: