Questions tagged as 'robots'

Tagged questions
1
answer

WEB Systems What is the best way to escape the Search Engine and make it invisible

When it comes to WEB systems What would be the safest and most used way for it to become invisible to search engines? I know there are "Goals" but I believe there must be more reliable ways     
asked by 15.10.2016 / 21:20
1
answer

Prevent indexing of page clippings

If you cut a page by separating head , nav , etc ... And pull everything with include on index.php , will Google index those cut pages? I want to separate some parts by creating head.php and nav.php , the...
asked by 15.03.2017 / 12:41
2
answers

Indexing of sites in half possible?

While browsing the internet reading articles and more articles, I came across some that are only displayed in half, or just the beginning, here is an example . In this case, only the subscriber has free access. My question is? Is the site...
asked by 08.11.2017 / 03:05
1
answer

Robots.txt with spaces

I created a robots.txt and mapped it on my host to be found in the root, however I realized that I came up with spaces before the bar, many spaces. And since the deploy process is very bureaucratic, I would like to know if even with the space...
asked by 08.08.2017 / 16:33
1
answer

How to use a Robots.txt on Github pages

I have a repository in GitHub and it has a site that is visible through github pages, but I want the search engines to only show the home page of the site. If it was a normal site I could add a robots.txt in the root folder, but github does not...
asked by 21.07.2018 / 17:06
1
answer

Hide Input Email

Personal the input value of my form that I need to hide for users is: e-mail . It will be an alternate email entry for bot identification I need to make this entry of e-mail hidden for real users and visible only for bots. Som...
asked by 05.09.2018 / 16:52
1
answer

How to create a robot to test the traffic on my site in localhost?

I have a mysite.com site that is running in a local LEMP environment (Linux, Nginx, MariaDB, PHP7). The site is now ready and I have a well loaded database with lots of fake data. Before sending to AWS-EC2, I want to test some accessibility p...
asked by 08.09.2016 / 01:39
1
answer

Noindex Nofollow of equal sites

I have two equal sites, same content, design, everything (One is the homologation of the other of production). They are in different domains, the only thing that changes, is that in Robots that one is indexed index follow , and the other i...
asked by 07.12.2017 / 12:24
0
answers

What is the meaning of using robots file in pages in Github?

According to this Stack Overflow response you can use robots.txt to prevent search engines from indexing pages that webmaster does not want.    How is this possible?            via a Custom Domain or custom domain.    Howeve...
asked by 11.11.2017 / 17:32
1
answer

Archive Keyboard Entries in Python

I am building a code to hold any command made by the keyboard, they will be published in a ROS structure topic to control a mobile robot. I'm not very familiar with Python, the most I've achieved regarding data storage was the code below ... For...
asked by 09.08.2018 / 01:56