Skip to main content

SiteCrawler HTTP Codes Report

Updated over a year ago

πŸ“˜ This article describes the HTTP Codes report in SiteCrawler, part of Botify's Analytics Suite, available with all Botify plans.

Overview

The HTTP Codes reports detail the different HTTP response codes that the Botify crawler found as it crawled your website. Use this set of reports to identify HTTP errors (i.e., 4XX, 5XX) and redirect URLs (i.e., 3XX).

sc_http_overview.jpg

HTTP Codes Report KPIs

The following KPI totals for the current crawl are displayed at the top of the HTTP Code report. Click a KPI to display the corresponding URLs in a URL Explorer report:

sc_http_kpis.jpg
  • 2xx URLs: The number of pages that returned content successfully during Botify's crawl.

  • 3xx URLs: The number of pages that were redirected during Botify's crawl.

  • 4xx URLs: The number of pages that returned client errors during Botify's crawl.

  • 5xx URLs: The number of pages that returned server errors during Botify's crawl.

HTTP Codes Report Visualizations

The report's "Top Charts" section includes the following visualizations. Visit the Segments section of the HTTP Codes report to see many of these visualizations focused on the page categories you have defined in your project segmentation:

HTTP Status Codes Distribution

This chart shows the distribution of HTTP status codes returned during Botify's crawl, visualizing how many pages were delivered successfully, redirected, or returned errors. If you filter this chart by particular HTTP status code type, "Good HTTP Codes" refers to 2xx codes and "Bad HTTP Codes" includes any error or redirect.

sc_http_dis.jpg

Insights

This table displays HTTP code insights based on the evolution across the compared crawls. The # URLs column displays the number of URLs matching the metric in the current Botify crawl, and the Change column displays the percentage of increase or decrease from the compared crawl. Click a metric to display the list of corresponding URLs in a URL Explorer report. Click the alert icon to define an alert for future changes in the corresponding metric.

About Redirects

The Insights chart reveals when you have multiple redirects in place (i.e., redirect chain) and if any of these are in a redirect loop, which prevents any content from being displayed. You can drill into these insights to find the URLs in the redirect chains so you can update links to their final destination.

sc_http_insights.jpg

URLs by Depth and HTTP Status Code

This chart shows the distribution of your pages by HTTP status code and the number of clicks away from where the crawl started (typically the site's home page) using the shortest available path. The 0 on the chart's X axis defines the crawl start page. This chart is an important tool to help you identify pages that return errors on highly visible pages (i.e., those closest to the home page).

sc_http_depthandstatus.jpg

If you have defined segments in your project, visit the HTTP Codes Report Segments section. The URLs by Dimension and HTTP Status Code chart shows the HTTP codes returned by specific site sections. In the following example of a retailer's site, you can quickly identify the Accessories product pages that returned 4xx errors by clicking the chart segment to display a URL Explorer report with the URLs that returned 4xx HTTP codes during Botify's crawl.

sc_http_segments.jpg

See also:

Did this answer your question?