On this day I placed my domain on Google and it fetched my Web Site and my System .
I would like my System to be hidden from Google and from any other search engine.
- Would you like to do this?
- How to get indexing already done by Google ?
How not to allow indexing by search engines?
16
asked by anonymous 20.02.2015 / 15:20
2 answers
18
Just put a file called robots.txt (it has good documentation on this site ) in the folder you does not want it to be indexed.
Some search engines interpret what is written inside to find out how they should follow your request.
The search engine is not required to ignore but usually they do. Of course if nobody should be able to access you have to take other steps limiting access to authenticated users.
As you can see, you can declare which URLs can be accessed or not. You can differentiate depending on the type of client ( user-agent ) that is accessing the site .
To ban across the site :
User-agent: *
Disallow: /
Some time after placing this file the mechanisms that respect this file will no longer show the content on your pages. However she may have been archived and as far as I know without court order can not be withdrawn.
20.02.2015 / 15:22
7
You can use a robots.txt file in the root of your web directory with the following content:
User-agent: *
Disallow: /
Remembering that robots.txt is just a tip so the crawler will not index that page. The major search engines respect what is stated in the file, but that does not mean that the content will be invisible or inaccessible.
Through Google Webmasters you can remove your site from Google's search results .
20.02.2015 / 15:28