Google has launched a new version of its crawl stats report in Google Search Console. The more detailed information aims to help webmasters better understand how their sites are crawled and provides useful data for identifying and tackling any issues.
In its blog post, Google highlighted the following new features:
- Total number of requests grouped by response code, crawled file type, crawl purpose, and Googlebot type.
- Detailed information on host status
- URL examples to show where in your site requests occurred
- Comprehensive summary for properties with multiple hosts and support for domain properties
The new over-time chart displays total crawl requests over a period of time, total download size and average response time, enabling you to track changes in crawling patterns.
Crawl requests can be broken down by:
- response
- file type of the fetched URL
- purpose of the crawl request (Discovery or Refresh)
- Googlebot agent
Host status shows whether Google encountered any availability issues when trying to crawl your site over the past 90 days.
If you have domain properties with multiple hosts, you can check the host status for each of the top hosts in the report summary view.
The updated crawl stats report is a useful addition for webmasters, providing detailed and actionable information for debugging any crawl issues.
For a detailed overview of the crawl report see Google's support page here.
