Search

Using Robots.txt To Prevent Search Indexing

0 views

Sometimes there are parts of your website you don't want accessed by the search engines - for any number of reasons, like sensitive private data, articles that require subscriptions - whatever.

Using Robots.txt To Prevent Search Indexingabout robots.txt at length, it often good to remember the newbies (hi, newbies!). So it was good timing that this This stops Google from indexing this file. META tags are particularly useful if you have permission to edit the individual files but not the site-wide robots.txt. They also allow you to specify complex access-control policies on a page-by-page basis. If you understand that, you're far, far ahead of

Suggest a Correction

Found an error or have a suggestion? Let us know and we'll review it.

Share this article

Comments (0)

Please sign in to leave a comment.

No comments yet. Be the first to comment!