Potential Google Fix for vB's dupe woes???

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • kevinmanphp
    Senior Member
    • Jul 2005
    • 389

    Potential Google Fix for vB's dupe woes???

    Well... now that the googlebot accepts wildcards in robots.txt... I have put together some disallows that will hopefully solve all of vB's duplicate content penalizations (I HAVE TONS). One or two dupes are no big deal.. but if google gets all the links on your forums like mine... you can get up to 8+ dupes and that is NO GOOD - all go to sup index.

    Someone please check this robots.txt entry and let me know if this is safe to use. I am not too hip on the robots exclusions syntax and would appreciate a friendly "looks good to me" for my lines below.

    NOTE: I WANT to have showthread.php indexed... just without the params listed below:

    Code:
    User-agent: Googlebot
    Disallow: /*goto=
    Disallow: /*mode=
    Disallow: /*showthread.php?p=
    Disallow: /*&pp=
    Disallow: /*showthread.php?p=
    Disallow: /*postcount=
    Disallow: /*daysprune=
    Disallow: /*&sort=
    Any flaws with this? Thanks!
  • Gomjaba
    Senior Member
    • Jan 2005
    • 970
    • 3.5.x

    #2
    You could also ask on vbseo.com ...
    I'm not under the alkafluence of inkahol like some thinkle peep I am!

    Comment

    • kevinmanphp
      Senior Member
      • Jul 2005
      • 389

      #3
      They would probably just recommend getting their software to re-write the URLs. I would just like someone to give me a quick confirmation that my robots write up is correct and that I wouldnt be accidentally telling the SE's to delete everything from my vB. Thanks!

      Comment

      • Chroder
        Senior Member
        • Dec 2002
        • 1449

        #4
        Don't the URL's perm redirect to actual showthread.php?t=# pages? (Except p= I guess)

        Comment

        • kevinmanphp
          Senior Member
          • Jul 2005
          • 389

          #5
          Originally posted by Chroder
          Don't the URL's perm redirect to actual showthread.php?t=# pages? (Except p= I guess)
          Nope... god I would love it if they did.

          Comment

          widgetinstance 262 (Related Topics) skipped due to lack of content & hide_module_if_empty option.
          Working...