To find out the number of pages currently

[sumaiyakhatun27]

Indexed and their dynamics, let's look at the green graph "Page without errors". Right now, things are pretty even here, as there hasn't been any new content published in a while. But if you're adding posts/pages regularly, the graph should show steady growth. A sharp increase or decrease in the number of crawled pages could signal problems. For example, you could have added a directive to robots.


txt that blocks a lot of the pages you need. Or, conversely, you removed australia email list one of the directives and unleashed a whole army of duplicates. Read also How to use robots.txt file It is very important to periodically check the site for indexing errors, as they can be serious. For example, just recently, when I looked into the console, I saw this error: It turned out that one of the blog pages, posted 2 years ago, was never indexed because of the Disallow: /go directive specified in robots.


txt. It was added to block duplicates, but it was written incorrectly - as a result, it blocked all addresses that began with "go" after a slash. One of these URLs was in the sitemap, and its blocking in robots.txt caused an error. If I had been more attentive and serious about indexing errors, the page would have been in search and bringing traffic long ago.