📘 This article explains how to start working in SiteCrawler, part of Botify's Analytics Suite, available with all Botify plans.
Overview
To begin working in SiteCrawler, learn how to:
Data Retention
Crawl data is available in SiteCrawler for a limited period defined by your Botify plan. The number of crawls available is displayed when you expand the period selector:
Contact your SEO Success Manager with questions about your plan.
Navigating SiteCrawler
Access SiteCrawler by navigating to Analytics > SiteCrawler.
SiteCrawler is organized into the following sections:
Current URLs: Charts and views specific to URLs for the selected period.
New URLs: Charts and views specific to URLs found in the most recent crawl but not in the preceding crawl in the selected compared period. You can compare any two crawls; by default, Botify will compare against the crawl immediately preceding the selected crawl.
Disappeared URLs: Charts and views specific to URLs not found in the most recent crawl but in the preceding crawl in the selected compared period.
URL Explorer: Global view of all URLs in the selected crawls, to which you can apply several filters to create your preferred reports.
Analysis Info: An overview of SEO findings and the crawl settings for the selected crawl analysis and time-based charts showing the progression of the crawl.
SiteCrawler Fields
The following fields are available in SiteCrawler reports. Customize your reports using these fields to filter your crawl data or use them as columns in your URL Explorer reports.
The crawl data fields are grouped into the following categories:
Crawlability: Technical SEO metrics that define your content’s findability and accessibility by search engine bots.
Content: Content SEO metrics that define your page content quality and uniqueness.
SiteCrawler also includes the following fields to allow you to compile reports from various sources:
Log data: Your log data from LogAnalyzer is in the URLs section and the Main Crawl Metrics and Crawls and Visits (Logs) subsections of Crawlability.
Ranking data: Your ranking data from Google Search Console and analytics data from your integrated third-party analytics are in the Rankings section.
See also: