📘 This article describes optimizing the SpeedWorkers page inventory by serving static 4xx pages according to your defined rules. SpeedWorkers is part of Botify's Activation Suite, available as an option with a Botify Pro or Enterprise plan.
Overview
When you know certain URLs no longer exist, you can deliver a static 4xx page instead of having SpeedWorkers try to fetch the pages. When you define a 4xx Not Found rule, SpeedWorkers does not need to fetch and render the page, which preserves your cache spend.
Defining a 4xx Not Found Rule
Create an inventory optimization rule in the SpeedWorkers settings as described in the Optimizing Page Inventory article.
To define a 4xx Not Found rule:
In the Title field, provide a descriptive title to help identify the list and, optionally, a description.
In the Scope section, define URL-based rules (e.g., URL ends with /resources) to identify all pages where you want to serve static 4xx pages.
Click the Add a Condition link to identify an additional URL-based rule. By default, additional rules will be an "And" condition (i.e., both rules must be met). To identify an "Or" condition (i.e., one or the other rule must be met), click the "And" link between the conditions to change it to "Or".
In the "Define your served content" section, identify the HTTP code and the HTML to be served when the pages within scope are requested:
HTTP code:
404 - The resource is not at this location.
410 - The resource is not present anymore, but it existed previously. Read how 410 pages can be removed from the search engine index more quickly.
HTML served: A basic "404 Not Found" message is provided by default. Optionally edit this to identify the HTML to be served.
Click Create.
See also: