Skip to main content

Core Web Vitals in Botify

Updated over a year ago

📘 This article explains how Botify measures and analyzes your site’s Core Web Vital performance through various dimensions and metrics.

Overview

The Core Web Vitals (CWV) metrics evaluate page load time, responsiveness, and visual stability as part of Google’s page experience ranking. The Core Web Vitals are Largest Contentful Paint, First Input Delay, and Cumulative Layout Shift. CWV metrics are available in the following locations in Botify:

Prerequisite

The following are required to access your CWV field data in Botify:

  1. Integrate your Google Search Console data with your project to help identify your most clicked pages.

  2. Follow the steps in this article to integrate your CWV data.

Field metrics are only available on your most visited URLs, and Botify queries the Google API to request CWV metrics based on your most clicked pages.

Monitoring Web Vitals in SiteCrawler

After submitting your Chrome UX Report (CrUX) API key into Botify’s project settings, the CWV metrics will be available in the “Web Vitals - Field Data” section within the Rankings category in Botify filters and columns. The following metrics are included:

cwv_filters.png

The Interaction to Next Paint (INP) metrics replaced the First Input Delay (FID) metrics on 12 March 2024, but FID metrics remain available as filters for historical purposes. FID metrics are not included in ActionBoard guidance pages or the EngagementAnalytics dashboard.

Core Web Vitals Metrics

  • Normalized URL: The URL used in the CrUX to aggregate all user experiences for this page with all parameter values. For example, https://example.com/page.php?parameter=abc would be normalized into: https://example.com/page.php by Google’s CrUX API.

  • Device: The device used to access the URL (e.g., mobile, desktop, tablet), as reported in the CrUX. To understand the overall mobile experience on this page, combine the Device field with other Web Vitals - Field Data fields.

  • CrUX API (CWV) Report Available: Whether field data from the CrUX is available for a given URL and device type.

  • UX: Score: A representation of the overall CWV scores reported in the Chrome User Experience Report (CrUX). The value in this field is "Good" when all CWV scores are "Good". If one score is anything else (e.g., "Needs Improvement", "Poor"), then the UX: Score inherits the worst score.

In addition to the values from the CrUX, the scores and density are reported for each of the Core Web Vitals:

  • Largest Contentful Paint (LCP): The CWV metric that measures loading performance.

  • Interaction to Next Paint (INP): The CWV metric that measures the speed of a page's overall responsiveness to user interactions.

  • Cumulative Layout Shift (CLS): The CWV metric that measures the stability of a page.

  • First Contentful Paint (FCP): The CWV metric that reports when the browser first rendered any text, image (including background images), non-white canvas, or SVG.

Botify retrieves the aggregate values, the lowest, and the highest aggregate scores for each CWV metric, as described below.

cwv_aggminmax.png

Agg

The aggregate value represents the 75th percentile of page loads collected during a rolling period of the previous 28 days. Here is a detailed explanation from Google on why they use the 75th percentile value of all visits to a page to classify the overall performance of that page or site.

Example: The Homepage in this example reports an LCP: Agg of 5.2s on Desktop and 5.8s on mobile. This means 75% of user experiences have an LCP slower or equal to 5.2s and 5.8s on desktop and mobile, respectively.

whats_available_for_each_metric_-_1.png

Min

The lowest aggregate score for the selected dimension based on the previous 28 days of available data. Min demonstrates the best-performing score for CWV.

When looking at a URL without filtering by device, the Min will display the device type with the lowest aggregate score. If your data is segmented by another dimension, for example, by Pagetype, the Min score for a specific Pagetype will report the URL within that Pagetype with the lowest Min score. This can reveal how well the best page within that segment is performing.

Example: The Homepage in this example reports an LCP: Min of 5.3s. Since the LCP: Min score in this example is based on the individual URL dimension, the Min score is calculated based on the device with the lowest LCP: Min available, which is Desktop in this example.

Max

whats_available_for_each_metric_-_2.png

The highest aggregate score for the selected dimension, based on the previous 28 days of available data. Max demonstrates the worst-performing score for CWV.

When looking at a URL without filtering by device, the Max will display the device type with the highest aggregate score. If your data is segmented by another dimension, for example, by Pagetype, the Max score for a specific Pagetype will report the URL within that Pagetype with the highest Max score. This can reveal how well the worst page within that segment is performing.

Example: The Homepage in this example reports an LCP: Max of 5.8s. Since this data is focused on an individual URL, the Max score is calculated based on the device with the highest LCP: Max available, which is Mobile in this example.

LCP_Max.png

CWV Score Thresholds

The CWV score is based on thresholds established by Google for each Core Web Vital metric, based on a page’s aggregate value, as follows:

CWV

Good

Need Improvement

Poor

LCP

<=2.5s

2.6s-4s

>4s

INP

<=200ms

201ms-500ms

>500ms

CLS

<=0.1s

0.2s<=0.25s

>0.25s

Example: In the following example, the LCP score is "Need Improvement" for all devices because they range from 2.8 to 3.9 seconds. The URL with the "Good" score falls well below the 2.5-second threshold.

cwv_lcpexample.png

CWV Density

The density for each CWV is the ratio of user experiences with "Good", "Need Improvement", or "Poor" LCP scores.

Example: In the following example:

  • The LCP ratio of 88.43% is "Good" because 88.43% of all user experiences on the page/device received a "Good" LCP score.

  • The LCP ratio of 7.96% is "Need Improvement" because 7.96% of all user experiences on the page/device received a "Need Improvement" score.

  • The LCP ratio of 3.59% is "Poor" because 3.59% of all user experiences on the page/device received a "Poor" score.

Core Web Vital metrics are only available on pages with enough traffic because Botify only ingests data from real users visiting your site (i.e., field data), not lab data.

CWV in RealKeywords

CWV data is also available in RealKeywords.

  • Applying a CWV filter on a trended chart applies the CWV filter for each day in the period.

  • Add a "Date" dimension with a CWV field in the Keywords Explorer to see details by day. Botify will apply the CWV filter or metric for each day of the period.

  • Applying a CWV filter or adding a CWV metric on a non-trended chart, table, or Keywords Explorer report uses the last CWV value available in the period.

Tracking CWV Performance with Custom Reports

You can create custom reports to track your site’s CWV performance on a trended basis. Monitor the KPIs and dimensions that matter to your company and easily send the data to key stakeholders at your preferred cadence.

CWV Metrics by Dimension

A key advantage of analyzing your Core Web Vitals in Botify is the ability to cross-reference these metrics with other available dimensions and segment your data in many ways, as in the following examples:

Report by Pagetype

Use the Segments Editor to create your custom-defined categories based on the URL path of a page. Pair these segments with CWV metrics to analyze and compare the page experience for specific areas of your site.

  1. Navigate to SiteCrawler > URL Explorer.

  2. Filter by Pagetype with the “Or” statement to select multiple pagetypes and compare performance across different website sections.

    cwv_pagetypeex1.png

  3. Click Manage Columns to add a column for Pagetype and other desired CWV columns.

    cwv_pagetypeex.png

Report by Device Type

CWV metrics can vary drastically depending on the type of device with which a user visits your site. Since a device’s viewport dimensions and processing power can shift the performance of a page, it is beneficial to monitor the same page across multiple device types.

  1. Navigate to SiteCrawler > URL Explorer.

  2. Filter by the Device dimension equal to "desktop". Add an “And” statement to ensure a report is available.

    cwv_deviceex1.png

  3. Click Manage Columns to select your desired CWVs to include in the report. This example shows the CLS score of available URLs broken out by Pagetype.

    cwv_deviceex2.png

Report by an HTML Extract Value

You can use HTML Extracts to isolate specific components and features of your site to understand better the impact these components may have on your CWV performance. This example demonstrates the HTML Extraction tool to check if a third-party vendor’s carousel exists on a page. You can then apply the extracted value to compare CLS performance across the pages and determine if there is a noticeable shift in CLS between the pages with and without the carousel.

  1. Inspect the CSS selectors of the HTML element you want to review for performance impacts. Copy and paste the appropriate CSS selector.

    image.png

  2. With your element selected, navigate to your project Settings and add the extraction as a new HTML Extraction rule. Copy and paste your CSS selector into the text field. Select the “Check if exists” option for the Operation, providing a boolean value revealing whether that specific HTML Extraction is on a given page.​

    image__1_.png

  3. After the next crawl, you can use the new HTML Extraction metric to compare CWV performance for pages with and without the specific HTML element.

    image__2_.png

FAQs

On What Time Period Are CWV Metrics Based?

CWV metrics are based on a rolling aggregate period of 28 days. The 28-day period ends three days before the finish date of the associated crawl. This three-day buffer period is necessary to ensure that all the 28-day rolling period data is fully processed and ingested into your crawl accurately.

For example, if your next is scheduled to run and be completed on May 10. Botify will collect your CWV metrics based on the 28 days between April 10 and May 7. On May 17th, your weekly crawl will collect CWV metrics based on the period between April 17 and May 14.

Why are there More URLs in GSC’s Page Experience Report than Botify?

There may be discrepancies between Botify's report and Google Search Console because Botify displays CWV metrics by URL, and Google Search Console displays metrics by URL group. This means low-traffic URLs may not have individual CWV data available in the CrUX API, but that same URL may be highlighted in a URL group within GSC.

Are Resources Available to Help Improve Core Web Vitals?

With field data in Botify, you can monitor your CWV performance over time and validate that you have reached your goal of improving the experience for real users. However, you must work with your development teams on lab data for actionable insights. Here are some tools you can use:

  • Lighthouse audits, with diagnostics and opportunities, by running a PageSpeed Insights test on pages you want to improve.

  • WebPageTest audits, via WebPageTest website, show waterfall and other performance insights on pages you want to improve.


See also:

Did this answer your question?