Block Search Engines from Indexing Your Website

Share this article :

Open the robots.txt file and add / change as per followings rules.

Block your entire website

User-agent: *
Disallow: /

Block directory (with everything inside)

User-agent: *
Disallow: /itsiti/images/

Block a page

User-agent: *
Disallow: /itsiti_index.html

Block a specific file

User-agent: *
Disallow: /*.jpeg$

If you want to enable the blocking for certain user agents, you can put the user agent name instead of * (* is applies to all user agents). You can find the list of user agents from this website,

Related posts

HTML Formatting Attribute
Browse Website & Forum without Registration
Enable Gzip Compression via .htaccess
Create Email Account using Your Own Domain
© 2017 ITsiti. All Rights Reserved
Powered by KEEM