All spiders are crawling member URL's like this:
Is there a way to only let them crawl /member? Not quite sure what to put in my robots.txt.
Code:
/member/200-brent?200-Brent=&tab=visitor_messaging&page=150
Comment