By Edwin Toonen
Before a search engine can rank a page or a post, it needs to index it. A crawler must discover a piece of content before it can evaluate if it is a valuable addition to its index. One of the ways crawlers discover pages, is by crawling XML sitemaps. After a page has been indexed, a search engine can rank the piece of content if it fits the users search query best. Yoast SEO makes it easy for you to determine what should be indexable.
Show x in search results?
Determining what has to be indexed by crawlers and what not tends …read more