📘 Field descriptions for URL structural properties and page classification segments.

Overview

These fields describe the structural components of each URL and how each page is classified in your Botify project. URL structure fields appear across all Botify datasets and are used to filter, group, and identify pages in any analysis.

URL Structure

Available in: SiteCrawler · RealKeywords · Log Analyzer
For API users: Available in the Crawl and Logs BQL collections.

Field name	API identifier	Kind	Type	Description
Full URL	`url`	dimension	string	The full page URL, including the protocol (e.g., https://www.botify.com).
URL Path	`path`	dimension	string	The portion of the URL following the top-level domain. For example, in https://www.botify.com/solutions, /solutions is the URL path.
Host	`host`	dimension	string	The site's domain name.
Protocol	`protocol`	dimension	string	The transfer protocol for the URL (e.g., HTTP, HTTPS).
Extension	`extension`	dimension	string	The file type extension in the URL (e.g., .html, .php). Blank for URLs with no extension.
Depth	`depth`	dimension	integer	The minimum number of clicks required to reach this page from the homepage through internal links.
URL Query String	`query_string`	dimension	string	The full query parameter string of the URL, including all key-value pairs. In most cases, this is everything after the ? in a URL.
URL Query String Keys	`query_string_keys`	dimension	string	The query parameter keys in the URL without their paired values.

Pagetype

Available in: SiteCrawler · RealKeywords
For API users: Available in the Crawl BQL collection.

Field name	API identifier	Kind	Type	Description
Pagetype	`segments.pagetype.value`	dimension	string	The pagetype label assigned to the URL based on segmentation rules in your Botify project (e.g., "product", "category", "blog"). Configured in project settings under Segments.

URL Classification

These boolean fields classify each URL into one of four page purpose categories, based on your project's segmentation configuration.

Field name	API identifier	Kind	Type	Description
URL is Landing (user-defined)	`segments.is_landing`	dimension	boolean	Whether the URL is a landing page — a page intended to receive organic search traffic (e.g., product pages, category pages).
URL is Discovery (user-defined)	`segments.is_discovery`	dimension	boolean	Whether the URL helps search engines find new landing pages (e.g., paginated pages, facet navigation).
URL is Warning (user-defined)	`segments.is_warning`	dimension	boolean	Whether the URL should not be crawled by search engines because it wastes crawl budget (e.g., legacy URL structures, session IDs).
URL is Useless (user-defined)	`segments.is_useless`	dimension	boolean	Whether the URL has low SEO value and does not fit into landing, discovery, or warning categories (e.g., legal pages, support pages).
URL is Static	`segments.static`	dimension	boolean	Whether the URL is a static resource such as a PDF, image, or script file (e.g., .pdf, .jpg, .js).

Custom Segment Dimensions

These fields return the segment label assigned to each URL for a given segment type, as defined by your project's segmentation rules.

Field name	API identifier	Kind	Type	Description
Segments: Content	`segments.content.value`	dimension	string	The content segment label for the URL, as defined in your segmentation rules.
Segments: Host	`segments.host.value`	dimension	string	The host or domain segment label for the URL, as defined in your segmentation rules.
Segments: AMP	`segments.amp.value`	dimension	string	The AMP variant segment label for the URL, as defined in your segmentation rules.

URL Scheme and Segmentation Fields