No: 'noindex' detected in 'robots' meta tag

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • LockedOnLaw
    Senior Member
    • Apr 2010
    • 2311
    • 6.X

    #16
    Originally posted by Blackhorse

    It will be indexed but i think all secret forums such as admin forums still will not appear publicly as i am making it secret in admincp itself

    right?
    What I was getting at is that bad bots do not obey robots.txt files. Only good bots obey robots.txt files. So, if you open the door for them ...

    Everything Wayne Luke has said is correct in terms of the default software.

    Comment

    • Blackhorse
      Senior Member
      • Jul 2018
      • 298
      • 5.3.x

      #17
      Originally posted by Wayne Luke
      Removing the conditions will most likely not change anything in your output. There are only two pages listed in the Route table with noindex set to true. These are the register and subscription pages.

      Only one page has nofollow set to true. That is the register page.

      There is no interface for you to turn this on/off for any other page at this time. Like I said, I don't know how this is getting added to your pages. When I visit your site, I do not see noindex nofollow meta tag in the page source code anywhere. nofollow is used on links to send private messages to users (not sure why you allow guests to send private messages but...)
      Hello Wayne,

      Thank you so much. I don't allow guests to send private message.

      I will wait and see the results after i have corrected the xml url submission

      Comment

      • Blackhorse
        Senior Member
        • Jul 2018
        • 298
        • 5.3.x

        #18
        Originally posted by In Omnibus

        What I was getting at is that bad bots do not obey robots.txt files. Only good bots obey robots.txt files. So, if you open the door for them ...

        Everything Wayne Luke has said is correct in terms of the default software.
        Thank you Omnibus

        Comment

        • Blackhorse
          Senior Member
          • Jul 2018
          • 298
          • 5.3.x

          #19
          One Last thing please,

          Could you please review if this robots is right?

          User-agent: *
          Disallow: /admin/

          User-agent: AdsBot-Google
          Allow: /

          User-agent: Googlebot-Image
          Allow: /

          User-agent: Mediapartners-Google
          Allow: /

          User-agent: Adsbot-Google
          Allow: /

          User-agent: Googlebot-Image
          Allow: /

          User-agent: Googlebot-Mobile
          Allow: /

          sitemap: https://www.XXX.org/core/store_sitem...emap_index.xml

          sitemap: https://www.XXX.org/core/store_sitem..._starter_1.xml

          sitemap: https://www.XXX.org/core/store_sitem...map_page_2.xml

          sitemap: https://www.XXX.org/core/store_sitem...map_node_0.xml




          Do I need to locate the php link or tared files of sitemap in robots instead of the xml?

          Thanx

          Comment

          Related Topics

          Collapse

          Working...