📘 This article explains the data periods available across Botify reports.
Overview
Some Botify reports are based on when Botify crawled your site, others are time-based according to the report's integrated data sources. The crawls and periods available in your reports are based on your Botify plan and the data source type. This article explains the periods available with each data source by report type.
Data Source Availability
Crawl: The availability of your Botify crawl data depends on your project's crawl frequency, which is based on your project settings and your Botify plan (e.g., daily, weekly).
Logs: Daily log data is available in Botify when your web server log data is integrated with your Botify project.
Google Search Console: Google Search Console (GSC) data is retrieved daily when integrated with your Botify project, with a two- to three-day retrieval delay. Upon GSC integration, 16 months of historical data is imported. Historical data is not imported with the Bulk Data Export integration.
Core Web Vitals: Core Web Vitals (CWV) data is retrieved daily when integrated with your Botify project, with a two- to three-day retrieval delay. Historical data is not imported upon CWV integration.
Visits and Conversion: The availability of visit and conversion data depends on the analytics provider but is usually the previous 30 days from the crawl end date.
Semrush: Semrush competitive data integrated with RealKeywords is a snapshot updated daily to include new data from the elapsed day.
Report Defaults
The following are the default crawl or periods in each report type. Your selections are saved when you change the defaults and navigate across reports within a Botify capability (e.g., SiteCrawler), except in CustomReports, where the selected crawl or period is saved with each report.
Report Type | Data Sources | Default Crawl or Time Period |
| Last crawl vs. previous crawl. The closest available periods for logs, GSC, and analytics data are matched to the selected crawl dates. | |
Web server logs | Last 28 days. | |
| Last crawl vs. previous crawl. | |
| Last 28 Days minus 2-3 days of retrieval from GSC vs. previous 28 days. Crawl data is from the most recent crawl before the end of the compared period. | |
| Interval based on a rolling average of your CWV field data over the previous 28 days. | |
Botify crawls | Last crawl vs. previous crawl. | |
| Last AlertPanel crawl vs. previous AlertPanel crawl. | |
| Last 28 days. | |
| Last 28 days. | |
| Last 28 Days minus 2-3 days of retrieval from GSC. Crawl data is from the most recent crawl before the end of the compared period.
Note: When you add a trend chart from RealKeywords to a custom report, it inherits the period and crawl dates of the custom report. |
A banner is displayed in reports to indicate when crawl data is crossed with other data sources. Hover over the banner for additional details:
Finding Data Availability
The available crawls and periods are shown in the period selector at the top of Botify reports. Expand the selection to find which data is available in the report.
For reports that cross multiple data sources (e.g., CustomReports), click the Data source availability link for a grid of all data available in the report:
💡 Except for custom reports, selected periods are not saved with Botify reports on subsequent sessions or when you navigate out of a Botify capability. Explorer Bookmarks enable you to save your preferred filter and column configurations to apply to other reports, but the period is not saved. Since the selected period is included in the page URL, you can copy and save the full URL to easily return to the report with the selected period.