Block Search Engines from Indexing Your Website



Share this article :

Open the robots.txt file and add / change as per followings rules.

Block your entire website

User-agent: *
Disallow: /

Block directory (with everything inside)

User-agent: *
Disallow: /itsiti/images/

Block a page

User-agent: *
Disallow: /itsiti_index.html

Block a specific file

User-agent: *
Disallow: /*.jpeg$

If you want to enable the blocking for certain user agents, you can put the user agent name instead of * (* is applies to all user agents). You can find the list of user agents from this website, Robotstxt.org.

Related posts

HTML Graphical Elements Attribute
Turn Off Disqus Discovery
Enable Gzip Compression via .htaccess
Online Check Computer Hardware / Software Requirements for PC Games
© 2017 ITsiti. All Rights Reserved
Powered by KEEM