📘 This article provides an overview of the Main URL details report available via SiteCrawler's URL Explorer. SiteCrawler is part of Botify's Analytics Suite, available with all Botify plans.
This report summarizes warnings and all data collected about the URL during Botify's crawl. Details are contained in the remaining tabs.
Main Report Sections
This report includes the following sections:
Warnings
The Warnings section only displays when issues were encountered during the selected crawl. The number and type of warning are identified, and a link to examples in the detailed report is included.
Main Data
The Main Data section includes the following metrics:
Date Crawled: The date and time when Botify's crawl began.
Is Indexable: Whether the page was eligible to be indexed by a search engine at the time of Botify's crawl.
Segments: The name of the segment to which the page belongs (e.g., pagetype and content).
Zone: The page's protocol and region combination.
Internal Pagerank: A Botify-calculated metric that considers how your website's Pagerank is distributed within your website. It is a function of the number of internal follow links pointing to a page (i.e., inlinks) and the calculated Pagerank of the pages where the links come from.
Internal Pagerank Position: The page's ranking among all analyzed URLs, based on the Raw Internal Pagerank. A page with an Internal Pagerank position of 1 is the page on your site with the highest Raw Internal Pagerank.
HTML Load Time: The delay between when the Botify crawler requested the URL and when the page HTML code was fully downloaded. The ideal load time is 500 ms or less.
Content Byte Size: The size of the URL's body as represented in number of bytes.
HTTP Status Code: The HTTP status code returned by the server for this page in the selected crawl.
Depth: The number of clicks required to navigate to the page from the crawl start page (typically the site's home page). The site's home page depth is 0.
Redirects to URL: The next immediate destination URL to which the page is redirected.
Incoming Redirections: The number of URLs redirecting to the current page.
Canonical Points to Self: Whether the URL points to itself within the canonical tag.
Has Incoming or Outgoing Hreflangs: Whether the page has any hreflang tags pointing to it from other pages or contains hreflang tags pointing to other pages.
Has at Least an Incoming Rel Prev Link: Whether at least one page points to this page via a rel="prev" link attribute for pagination.
Has at Least an Incoming Rel Next Link: Whether at least one page points to this page via a rel="next" link attribute for pagination.
Content
No. of Titles: The number of page title tags found in the page source code during the selected crawl.
Title: The content of the first HTML Title tag found in the page during the selected crawl.
No. of Meta Descriptions: The number of meta description tags found in the page source code during the selected crawl.
Description: The first meta description found in the page source code during the selected crawl.
No. of H1: The number of H1 HTML tags found in the page source code during the selected crawl.
H1: The content of the first H1 HTML tag found in the page during the selected crawl.
No. of H2: The number of H2 HTML tags found in the page source code during the selected crawl.
H2: The content of the first H2 HTML tag found in the page during the selected crawl.
Has Noindex Meta Tag: Whether the URL has a noindex meta tag.
Has Nofollow Meta Tag: Whether the URL has a nofollow meta tag.
No. of Words (Content): The count of core words on the page, excluding those in the template.
No. of Words (Template): The number of words considered as part of the page “template” (which is ignored for most content quality analysis).
👉 Get detailed reports of your sitewide content performance in SiteCrawler's Content report.
Incoming Hreflang Tags
Receives x-default From Incoming Hreflang: Whether the URL received the x-default hreflang attribute value from an incoming hreflang tag.
Number of Valid Incoming Hreflangs: The number of valid incoming hreflang tags pointing to the current page.
Number of Invalid Incoming Hreflangs: The number of invalid incoming hreflang tags pointing to the current page.
Outgoing Hreflang Tags
Sends x-default: Whether the current page points to a default version via an hreflang tag.
Number of Valid Outgoing Hreflangs: The number of valid hreflang tags on the current page that link to other language versions of the page.
Number of Invalid Outgoing Hreflangs: The number of invalid hreflang tags on the current page that link to other language versions of the page.
👉 Get detailed reports of your sitewide hreflang tags in SiteCrawler's Performance report.
Inlinks
Total No. of Inlinks: The total number of follow and nofollow links to the current page from other pages within the same domain.
Unique: The number of unique links pointing to the current page from other pages within the same domain.
Total No. of Follow Inlinks: The total number of follow links to the current page from other pages within the same domain.
No. of Unique Follow Inlinks: The number of unique follow links to the current page from other pages within the same domain.
Total No. of Nofollow Inlinks: The total number of nofollow links to the current page from other pages within the same domain.
No. of Unique Nofollow Inlinks: The number of unique nofollow links to the current page from other pages within the same domain.
Top 5 Text Anchors of Inlinks
This section shows the five most frequently used link text anchors on pages pointing to the current page and the number of occurrences of each link.
👉 Get detailed reports of your sitewide inlinks in SiteCrawler's Inlinks report.
Internal Outlinks
Total No. of Outlinks to Internal Pages: The total number of follow and nofollow links from the current page to other pages within the same domain.
Unique: The number of unique links pointing from the current page to other pages within the same domain.
Total No. of Follow Outlinks to Internal Pages: The total number of follow links from the current page to other pages within the same domain.
No. of Unique Follow Outlinks to Internal Pages: The number of unique follow links from the current page to other pages within the same domain.
Total No. of Nofollow Outlinks to Internal Pages: The total number of nofollow links from the current page to other pages within the same domain.
No. of Unique Nofollow Outlinks to Internal Pages: The number of unique nofollow links from the current page to other pages within the same domain.
Total No. of Outlinks to Non-Indexable URLs: The total number of follow and nofollow links from the current page to non-indexable pages.
To Non-Indexable URLs Unique: The number of unique links pointing from the current page to non-indexable pages.
To 3xx URLs: The total number of links from the current page to pages that returned a 3xx HTTP status code in the selected crawl.
To 4xx URLs: The total number of links from the current page to pages that returned a 4xx HTTP status code in the selected crawl.
To 5xx URLs: The total number of links from the current page to pages that returned a 5xx HTTP status code in the selected crawl.
External Outlinks
Total No. of Outlinks to External Pages: The total number of follow and nofollow links from the current page to other pages in another domain.
No. of Unique Outlinks to External Pages: The number of unique links pointing from the current page to pages in another domain.
No. of External Follow Outlinks: The total number of follow links from the current page to pages in another domain.
No. of Unique Follow Outlinks to External Pages: The number of unique follow links from the current page to pages in another domain.
No. of External Nofollow Outlinks: The total number of nofollow links from the current page to pages in another domain.
No. of Unique Nofollow Outlinks to External Pages: The number of unique nofollow links from the current page to pages in another domain.
👉 Get detailed reports of your sitewide outlinks in SiteCrawler's Outlinks report.