📘 This article describes the reports available in SiteCrawler, part of Botify's Analytics Suite, available with all Botify plans.
Overview
After completing a Botify crawl, your consolidated SEO performance and website analysis data are available in SiteCrawler. The performance metrics that measure your organic search success are imported from your server log data, integrated Google Search Console data, and third-party analytics data. The website analysis data provides a snapshot of your site's characteristics from Botify's crawler, giving insight into the performance metrics. Both metric types in SiteCrawler reports help you identify issues that already affect or may soon affect your site's performance.
SiteCrawler reports group metrics into the following categories:
Accessibility: These metrics, which evaluate the ease of search engine access to your site's pages, are available in the Distribution, Performance, HTTP codes, Inlinks, Outlinks, and Sitemaps sections.
Content: The metrics highlighting what search engine bots discern from your site pages are available in the Content section.
SEO Performance: The metrics providing insight into what your site pages achieve are available in the Visits and Search Engines sections.
Each SiteCrawler report provides the following:
Main indicators (usually aggregated metrics displayed at the top of the report).
Several charts with detailed indicators or combinations of indicators. For instance, the distribution of HTTP codes by depth in the HTTP Codes section.
Insights with additional indicator values or interesting indicator combinations. For instance, the number of pages with a single incoming link in the Inlinks section. You can use these reports to track important metrics throughout multiple analyses.
About Crawl and Visit Timeframes
When reviewing SiteCrawler reports, it is important to understand the timeframe for user visits and search engine crawl activity differs from the snapshot taken during a Botify crawl. The analysis revolves around the pages captured in Botify's snapshot and the activity around those pages during the past 30 days (Google crawls, organic visits, impressions, etc.). This analysis is compared to search engines' perception of your site, as reported in your web server log files. Since search engine updates lag behind Botify's pace, a 30-day timeframe is used, which is usually sufficient to represent how search engines perceive your website. Similarly, visit and impression performance metrics are typically assessed monthly, so a 30-day timeframe is also used when extracting organic traffic, keywords, and rankings.
SiteCrawler report dates are when the crawl began. While the process generally takes a few hours, it may be quicker for smaller sites or longer for larger ones. Report analyses only become available after a crawl's completion.
SiteCrawler Reports
The following reports are included in SiteCrawler: