📘 This article explains how to find duplicate H1, Title, and meta description tags in the pages crawled by Botify to help you identify if they can be optimized.
Overview
Botify lets you view duplicate H1, Title, and meta description tag information in different ways, each best suited for different use cases. You may be aware of some duplicates and want to determine if there are other unsuspected ones, or you may want to evaluate the extent of content duplication on your website.
Creating a Duplicate Tag Report
To find all pages with a duplicate H1, Title, or meta description tag, navigate to the "HTML Tags Performance for Indexable URLs" chart in SiteCrawler's Content HTML Tags report:
Click on an orange section of the graph to view a URL Explorer report of indexable pages with duplicate tags crawled by Botify. This example shows the Title section.
The report also shows the number of other indexable URLs in the same zone they share this title with, including duplicates managed by canonical tags. This metric enables you to focus on duplicates that may not have been identified yet by eliminating common causes of duplicates.
A zone is the combination of protocol (HTTP/HTTP) + domain + language, if available:
URLs available via both HTTP and HTTPS are obvious duplicates.
If you have country subdomains or your website exists under the website.com domain and also under www.website.com with the same URL structure, these are duplicates.
Pages for different regions with language tags (e.g., EN-US, EN-GB) are known duplicates.
To include duplicate information for all URLs, not just those among other indexable URLs in the same zone, remove the "Is Indexable = Yes" filter and change the condition in the second filter to "No. of Duplicate Title (Among All URLs) > 0".
Add the following column to include the number of duplicates among all URLs to compare with the number of duplicates among indexable URLs: "No. of Duplicate Metatags: Title (Among All URLs)".
Reporting Only Duplicate Titles
The full list of URLs with a duplicate title tag is useful if you want to work on these pages. But if you just want a view of the duplicate title tags, you do not need to see all URLs for each title. To show only one line per duplicate set in the report, add the following filter: "1st Duplicate Title Tag Found (Among indexable URLs in Same Zone): Yes".
And change the "Titles" column to "Title":
The report now includes only one line per duplicate title with the first URL found.
To view only a sample of URLs for each title (up to 10), add the following column: "Sample of URLs with the Same Metatags: Title (Among Other Indexable URLs in the Same Zone)":
The report will look like the following example (with the Title column removed for a more compact view):
You can export this report to get the list of all pages with duplicate Title tags.