View Full Version : Google spidering three copies?
BradleyB
Fri 18th Jul '03, 11:08pm
I am researching VBulletin's ability to be spidered by google. When I performed a test, I generated the following results from Google:
http://www.google.com/search?q=Please+HELP...vb3+didn%27t+work,+now+I+ha ve+to+revert+back&hl=en&lr=&ie=UTF-8&oe=UTF-8&filter=0
Am I seeing google index one thread three different ways? Any help on this would be greatly appreciated.
nuno
Sat 19th Jul '03, 1:00am
I am researching VBulletin's ability to be spidered by google. When I performed a test, I generated the following results from Google:
http://www.google.com/search?q=Please+HELP...vb3+didn%27t+work,+now+I+ha ve+to+revert+back&hl=en&lr=&ie=UTF-8&oe=UTF-8&filter=0
Am I seeing google index one thread three different ways? Any help on this would be greatly appreciated.
There you go:
http://www.google.com/search?hl=en&ie=UTF-8&oe=UTF-8&q=site%3Avbulletin.com+index.php%2Ft-
Joe
Sat 19th Jul '03, 1:21am
I dont think there is any way to stop it, you cant block a varible from robots.txt ie, spider forumdisplay.php?f=39 ubut not forumdisplay.php?do=markread&f=39 or forumdisplay.php?forumid=39
Currently, there is no way to do this with the templates, but i am sure it is posible to do so with a code hack.
Personaly, I am going to block robots from EVERYTHING other then the archive then make the archive as indexable as posible. Getting banned from google for duplicate content would really make my day ;)
dpkm
Fri 25th Jul '03, 10:36pm
Yeah, no kidding. I just checked a unique phrase from my board. 6 copies of it in the index. Crap crap crap. And like the example above, not a single one of them from the archive.
vBulletin® v3.8.0 Beta 4, Copyright ©2000-2008, Jelsoft Enterprises Ltd.