📘 This article explains how PageWorkers optimizations are executed in Botify subscriptions with SpeedWorkers. PageWorkers is part of Botify's Activation Suite, available as an option with all Botify plans.
Overview
PageWorkers and SpeedWorkers enable customers to activate the insights they gather in Botify in different, yet complementary roles. When used together, SpeedWorkers and PageWorkers become even more powerful. PageWorkers applies on-page content and link modifications for bots and users. SpeedWorkers ensures that strategic pages are fully rendered and accessible to bots, including third-party content, such as review platforms, which is especially useful for pages built on client-side rendering frameworks like React. SpeedWorkers can also optimize crawl budget by preventing spider traps and unnecessary SEO parameters from consuming it, leaving more capacity for Google to focus on strategic pages.
🚀 SpeedWorkers ensures that all pages it serves have the PageWorkers optimizations integrated, so bots do not need to execute JavaScript. This means:
Bots that do not execute JS, such as AI bots, can see optimizations they would not have seen without SpeedWorkers.
Bots that do execute JS, like Google, see PageWorkers optimizations earlier and more often than they would without SpeedWorkers.
PageWorkers execution with SpeedWorkers
When SpeedWorkers serves a page optimized by PageWorkers:
The bot requests the page.
Your CDN receives the request and forwards it to SpeedWorkers if it identifies the bot as one SpeedWorkers should serve.
SpeedWorkers checks whether the requested page is in its cache:
If cached, it runs PageWorkers on the page, then sends the rendered page with all optimizations to the bot. This means that SpeedWorkers will always serve the page with the most up-to-date optimizations, regardless of how old the cache is.
If not cached, it redirects the bot to your server to serve the unrendered page with the PageWorkers snippet installed.
If the bot executes JavaScript, then it runs PageWorkers and the optimization is deployed.
If the bot does not execute JavaScript, then it does not run PageWorkers, and the optimization is not deployed.
About optimization updates in SpeedWorkers
Updating a PageWorkers optimization does not require a page refresh in SpeedWorkers. When a page is served by SpeedWorkers, PageWorkers optimizations are always served fresh and do not depend on when the pages were cached. PageWorkers optimizations generally take between 30 seconds and five minutes before they can be served by SpeedWorkers.
See also: