I always wonder, AngularJS is a framework that is constantly being used.
But I have a question about how it works for crawlers (example googlebot).
Do they even run the javascript and interpret the code to get the information and show the site developed on the platform?
With the angular HTML theoretically does not have information "yet", it is first necessary to trigger the controllers and such.
The question is: How does semantics / indexing work with Angular?
According to this post , Google's crawler renders pages that have Javascript and browse the listed states.
Interesting parts of the post (free translation):
[...] we decided to try to interpret pages by running JavaScript. It's hard to do this on a grand scale, but we decided it was worth it. [...] In recent months, our indexing system has been serving a large number of web pages the way a regular user would see them with JavaScript enabled.
If features such as JavaScript or CSS in separate files are blocked (say with %code% ) so that Googlebot can not retrieve them, our indexing system will not be able to see your site as a regular user.
We recommend allowing Googlebot to retrieve your JavaScript and CSS so that your content can be better indexed.
Recommendations for Ajax / JS can be found at this link .
If you want to serve Angular application content for crawlers that do not support the same kind of functionality, you need to pre-render the content. Services such as Prerender.io are intended for this.
Crawlers (example googlebot) use pure text reading, meaning they first validate meta tags, then comments, then they remove all encoding and then read the whole text without code. Reason: Increase processing speed and reduce errors by having fields that hide, or have nodes (nodules) that are removed during execution. Crawlers do not run any kind of technology (Browser), they only read the file. The Angular does not stop being a Javascript like any other, for that reason its elements are ignored. Only items relevant to SEO (Optimization) are brought into question in their indexing.
Part of my explanation you find in this Google article Understanding Web Pages Better
To better understand the process of viewing plain text, make a requestion of the page in question by CURL, Lynx which are technologies commonly used by Crawlers.
For better indexing we recommend creating robots.txt and XML sitemaps .
One tip I can give you is, take the course they offer, it's quick and easy, you'll better understand how semantics work:
According to MDN using the %code% tag with attribute %code% %code% , allows search engines to know the date the document was created, and then displays this information in the Rich Snippet of the searches.
Is it possible to indicate the update date for it?
You can build your %code% by using the %code% tag to tell %code% that you want your content to be re-indexed, hourly, every day, or weekly for example.
Here you can see the complete and recommended protocol for you to build your %code% , notice that you can determine how regularly your content is reindexed: link
The frequency with which the page changes. This value provides general information for search engines and may not match the frequency of page indexing. Valid values are:
The "always" value should be used to describe documents that always change when accessed. The value "never" should be used to describe the archived URLs.
Note that the value of this tag is considered a %code% and not a command.
Although you can not be totally sure that Google will consider this tag to reindex its contents %code% or %code% for example
"If the site pages are properly linked, the normal Web crawlers can detect most of your site. ", but" The use of the sitemap does not guarantee that all items in it will be crawled and indexed because Google processes are based complex algorithms to program the tracking. However, the sitemap benefits the site in most cases, and you will never be penalized for using it. "
Source: link
Otherwise, you will not be able to completely stop %code% , in a case of urgency you can manually request the reindexing of a URL. For example if you make a security update on the contacts page you can ask Google to do a reindexing of your page. Here you can learn more about this: link
To manually add a URL (search tb "Fetch as Google") : link
To index by Search Console:
YoucanstillrequesttoreindextheentiresitethroughtheSerchConsole!
