Every website is like a live organism, and all live organisms are permanently changing. They grow, become older and disappear at some point of time. Keeping this metaphor in mind, let's move to the technical part.
These are the reasons of page number changes that are not related to Serpstat audit or any other auditing tool:
- the number of the pages on your website changed (increased or decreased) since the last crawl;
- your website had some technical issues during the crawling;
- your website is not ready for increased load;
- you use a kind of anti-DDoS protection mechanism that prohibits crawling;
- some pages do not have incoming links from the other pages of your website, so there is no way for the crawler to get there;
- there are some non-existent pages that are not yet dropped from the search results of search engines.
What you can do here is try one of these:
1. If you want exactly the same pages to be crawled every time, run the audit in “Page list” or “Sitemap” mode in Audit settings > Credits and speed > Scanning type. This will give you the maximum control over what should be crawled and what should not. But be sure to check that the pages in the list or in the sitemap stay the same.
2. If you want exactly the same number of crawled pages independent of what pages are crawled, set the number of pages to crawl in Audit settings > Credits and speed > Pages to scan.
3. Disable “Automatic speed control” and set the audit speed to the minimum in Audit settings > Credits and speed > Scanning speed. This will reduce the load and might help to get rid of 50X errors.
4. Explore the result of the site: search operator to understand what pages are indexed by the search engine.
Book a free 30-minute demo to test drive all Serpstat features.