Search engine crawlers may look at a number of different factors when crawling a site. Not every page kan zijn indexed by search engines. The distance ofwel pages from the root directory of a site may also be a factor in whether or not pages get crawled.[42]A fair share of links to the ahrefs.com website come from people mentioning our products and