Block Search Engines from Indexing Your Website

Share this article :

Open the robots.txt file and add / change as per followings rules.

Block your entire website

User-agent: *
Disallow: /

Block directory (with everything inside)

User-agent: *
Disallow: /itsiti/images/

Block a page

User-agent: *
Disallow: /itsiti_index.html

Block a specific file

User-agent: *
Disallow: /*.jpeg$

If you want to enable the blocking for certain user agents, you can put the user agent name instead of * (* is applies to all user agents). You can find the list of user agents from this website,

Related posts

Addon Domain in CPanel
This site may harm your computer
Remove Background Image Online with Clipping Magic
Create Email Account using Your Own Domain
© 2017 ITsiti. All Rights Reserved
Powered by KEEM