đ This article provides answers to frequently asked questions about SmartIndex, part of Botify's Activation Suite, available with a Botify Pro or Enterprise plan.
How are pages added to SmartIndex?
How are pages added to SmartIndex?
Pages are sent to SmartIndex at the end of SiteCrawlerâs main crawl and AlertPanelâs daily crawl.
If the page is new, itâs added to SmartIndex as the first version. If it exists, itâs added to SmartIndex as a new version with updated metadata.
SmartIndex continuously scans for new and updated pages, which are those with any change in the first main object of structured data.
Pages remain in SmartIndex indefinitely with their full version history. SmartIndex ignores a page that has not been crawled for 60 days and treats it as a new version if itâs crawled later.
The decision rules you define in SmartIndex determine which pages get pushed to each destination.
My site doesnât have any structured data; can I still use SmartIndex?
My site doesnât have any structured data; can I still use SmartIndex?
Yes, although you will need to push pages via HTML extracts using custom decision rules or force-push after a defined period since SmartIndex otherwise cannot determine when pages have been updated
Why should I implement schema markup in my segmentation if I don't have schema on my site?
Why should I implement schema markup in my segmentation if I don't have schema on my site?
It allows SmartIndex to identify the purpose of each page and automatically create sections within SmartIndex. These sections are used as a group of pages on which you apply rules to push to destinations.
Whatâs the difference between Push to Bing and Inform IndexNow?
Whatâs the difference between Push to Bing and Inform IndexNow?
IndexNow is a ping that notifies search engines when a URL and its content have changed, allowing them to reflect this change in their search results quickly. This is a request to help search engines prioritize these pages, but it does not guarantee that the pages will be indexed.
Push to Bing is a call directly to Bing through the API to push the content and HTML directly to Bing Search, which includes AI engines that rely on Bingâs index.
Do I have to use Push to Bing, Inform IndexNow, and Generate Sitemaps, or can I use just one?
Do I have to use Push to Bing, Inform IndexNow, and Generate Sitemaps, or can I use just one?
No, you can use just one or two destinations in SmartIndex; you do not need to use all three.
â
Is there a limit to the number of URLs I can submit to Push to Bing?
Is there a limit to the number of URLs I can submit to Push to Bing?
There is no limit with Botifyâs Enterprise plan. For a Pro plan, Bing imposes a 10,000 URL limitation daily and a monthly limitation unique to your Bing account. To mitigate reaching your monthly limit too quickly, we dynamically recalculate your daily allowance to spread usage more evenly throughout the month.
Is there a limit on the number of URLs I can submit to IndexNow?
Is there a limit on the number of URLs I can submit to IndexNow?
No, there is no limitation.
How can I check if search engines have indexed my URLs?
How can I check if search engines have indexed my URLs?
This is currently unavailable, but we are evaluating reporting solutions.
How can I control what is pushed to Bing to avoid pushing low-quality content into the index?
How can I control what is pushed to Bing to avoid pushing low-quality content into the index?
Weâll push indexable pages under segments you flagged as âdetailsâ or âlistingâ in the segmentation. There are built-in rules that cannot be modified (e.g., HTTP status code 200 and non-zero size), and a few customization options (e.g., push redirects, non-indexable pages, etc.). You can also choose to force a push after a defined number of days. The default behavior is to push pages when we detect a change (primarily based on structured data), but you can configure specific extracts to serve as a change detection mechanism.
What is the sitemaps format?
What is the sitemaps format?
.xml.gz
What is the benefit of Botify hosting over self-hosting sitemaps?
What is the benefit of Botify hosting over self-hosting sitemaps?
The benefit is that we maintain the host environment. After the initial host configuration in SmartIndex, no further interaction is required.
Can I define the number of URLs per sitemap?
Can I define the number of URLs per sitemap?
No. Sitemaps will contain up to 50,000 URLs, and new sitemaps will be automatically generated for each additional 50,000. You can choose to automatically split sitemaps based on SmartIndex sections, language, region, or custom HTML extract.
How can I push my sitemaps if I have my own sitemap generator?
How can I push my sitemaps if I have my own sitemap generator?
There is no way to push sitemaps without using SmartIndex.