📘 This article describes the SpeedWorkers Inventory Monitoring page, which provides insights into the pages in the SpeedWorkers page inventory. SpeedWorkers is part of Botify's Activation Suite, available as an option with a Botify Pro or Enterprise plan.
Overview
The SpeedWorkers Inventory Monitoring page shows how many pages are in the SpeedWorkers inventory and the cache status of the pages. A breakdown of each cache behavior, inventory source, priority, and rendering configuration is provided to help you identify where changes need to be made. The Inventory settings and Cache Behavior settings. determine the pages in the SpeedWorkers inventory.
To access the Inventory Monitoring page, navigate to Activation > SpeedWorkers > Inventory Monitoring. The Inventory Monitoring page has two tabs: Indexed URLs and Cache Refreshes.
Indexed URLs
The Indexed URLs tab provides an overview of the entire inventory from your inventory sources and is organized into the following cards:
Click on any visualization on this tab to view more detail in the SpeedWorkers URL Explorer.
Total Inventory Overview
The Total Inventory Overview displays the inventory state for the days in the current period, as selected at the top of the page. Hover over each bar and see the number of pages that are indexed, outdated (i.e., stale), expired, or not indexed for that day.
Inventory Dimensions Over Time
The Inventory Dimensions Over Time card provides a view of page inventory for the current period according to cache behavior, priority, or inventory source dimension as defined in the Cache Behaviors settings. Click a label at the top to update the visualization for each dimension, and expand the dropdown menu at the right to display another page status.
When using the Inventory Sources dimension, URLs are counted across all sources in which they exist. For example, if 1k URLs exist in both link discovery and bot discovery, there will be 2k URLs when using inventory sources as a dimension.
Current State of the Inventory
The Current State of the Inventory card shows a more granular view of the Total Inventory Overview and provides the option to choose the primary and secondary dimensions to sort the data.
Current State of the Inventory Metrics
The following metrics are used on the Inventory Monitoring Indexed URLs tab:
Overview: The indexed, outdated (i.e., stale), expired, or not indexed pages in an easy-to-view bar for the particular cache behavior, priority, inventory source, or rendering configuration.
No. of Pages: The number of pages SpeedWorkers identified based on the selected dimension.
Indexed Pages: The number of pages SpeedWorkers has in the inventory based on the selected dimension.
Outdated Pages: The number of stale pages that SpeedWorkers is serving. A stale page is the state of a cached page at the end of the refresh period, as defined in cache behaviors. Stale pages are not as current as cached pages, but SpeedWorkers can continue to serve stale pages to bots, preferred over expired pages, which can no longer be served.
Expired Pages: The number of pages in the page inventory but no longer being served to search bots because they have expired.
Not Indexed Pages: The pages from inventory sources that have been fetched but not yet added to the page inventory.
Cache Refreshes
The Inventory Monitoring Cache Refresh tab provides insight into all the pages fetched from your servers and why some pages could not be added to SpeedWorkers page inventory. The Cache Refreshes tab is organized into the following cards:
Overview
The Overview card shows the following metrics for the current period, as defined at the top of the page:
Total Pages Cached in Period: The number of pages added to the SpeedWorkers inventory.
Unique Desktop Pages: The number of unique pages in the SpeedWorkers inventory designed for desktop.
Unique Mobile Pages: The number of unique pages in the SpeedWorkers inventory designed for mobile.
Unique Responsive Pages: The number of unique pages in the SpeedWorkers inventory that adapt to the screen size (desktop/mobile).
Total Cache Fails: The number of pages that SpeedWorkers attempted to but did not successfully add to the page inventory.
Total Fetched Pages By Date
The Total Fetched Pages By Date card shows the number of pages fetched by SpeedWorkers during the current period according to whether pages were cached.
Click on the pie chart sections to see the specific URLs that are cached or not cached.
To see the pages that were cached or not cached on a particular date, click a bar.
For insights on the Not Cached category, refer to the Reasons Why Pages Weren't Cached card.
Total Fetched Pages By Behavior
The Total Fetched Pages By Behavior card shows the number of pages fetched by SpeedWorkers during the current period grouped by the behaviors defined in the Cache Behavior Settings.
Reasons Why Pages Weren't Cached
The Reasons Why Pages Weren't Cached card displays the total number of pages not cached by SpeedWorkers during the current period, categorized by reason type. Refer to Understanding "Not Cached" Reasons in SpeedWorkers for descriptions of each reason.
All HTTP Status Codes From Origin Server, By Date
The All HTTP Status Codes From Origin Server, By Date card displays the number of pages fetched during the current period according to the HTTP status code returned.
Click the pie chart sections to see the URLs associated with each HTTP code.
Click on the bar for a particular date to see the pages and HTTP codes.
Expand the dropdown menu on the right to filter the display by type of HTTP code.
