PDA

View Full Version : Google spidering three copies?


BradleyB
Fri 18th Jul '03, 11:08pm
I am researching VBulletin's ability to be spidered by google. When I performed a test, I generated the following results from Google:

http://www.google.com/search?q=Please+HELP...vb3+didn%27t+work,+now+I+ha ve+to+revert+back&hl=en&lr=&ie=UTF-8&oe=UTF-8&filter=0

Am I seeing google index one thread three different ways? Any help on this would be greatly appreciated.

nuno
Sat 19th Jul '03, 1:00am
I am researching VBulletin's ability to be spidered by google. When I performed a test, I generated the following results from Google:

http://www.google.com/search?q=Please+HELP...vb3+didn%27t+work,+now+I+ha ve+to+revert+back&hl=en&lr=&ie=UTF-8&oe=UTF-8&filter=0

Am I seeing google index one thread three different ways? Any help on this would be greatly appreciated.

There you go:
http://www.google.com/search?hl=en&ie=UTF-8&oe=UTF-8&q=site%3Avbulletin.com+index.php%2Ft-

Joe
Sat 19th Jul '03, 1:21am
I dont think there is any way to stop it, you cant block a varible from robots.txt ie, spider forumdisplay.php?f=39 ubut not forumdisplay.php?do=markread&f=39 or forumdisplay.php?forumid=39

Currently, there is no way to do this with the templates, but i am sure it is posible to do so with a code hack.

Personaly, I am going to block robots from EVERYTHING other then the archive then make the archive as indexable as posible. Getting banned from google for duplicate content would really make my day ;)

dpkm
Fri 25th Jul '03, 10:36pm
Yeah, no kidding. I just checked a unique phrase from my board. 6 copies of it in the index. Crap crap crap. And like the example above, not a single one of them from the archive.