Block Search Engines from Indexing Your Website

Share this article :

Open the robots.txt file and add / change as per followings rules.

Block your entire website

User-agent: *
Disallow: /

Block directory (with everything inside)

User-agent: *
Disallow: /itsiti/images/

Block a page

User-agent: *
Disallow: /itsiti_index.html

Block a specific file

User-agent: *
Disallow: /*.jpeg$

If you want to enable the blocking for certain user agents, you can put the user agent name instead of * (* is applies to all user agents). You can find the list of user agents from this website,

Related posts

Add to Bookmark Site Javascript
UL: HTML Unordered List
cPanel:The security token is missing from your request
Find & Edit .htaccess in cPanel
© 2017 ITsiti. All Rights Reserved
Powered by KEEM