SmartIndex can help ensure your content is indexed and found by search engines and users. You can easily generate optimized sitemaps, let search engines know when to crawl your site, and push content straight to Bing to help your website content be found wherever consumers are searching.

SmartIndex includes the following capabilities; each of these is a destination in SmartIndex:

Generate optimized sitemaps to help direct search engines to your most valuable content. Maintain an accurate list of these pages based on Botify’s most up-to-date, daily crawl data. Configure Generate Sitemaps

Help get all your strategic pages indexed and regularly refreshed by search engines using IndexNow, a protocol that enables websites to notify search engines when content is created or updated. By submitting your updated content, search engines can prioritize crawling your latest content and speed up content discovery. Inform IndexNow automatically requests all participating IndexNow search engines to crawl a page after SiteCrawler and AlertPanel crawls. Botify uses structured data elements to identify if a page has changed and requires submission, and you can also push content based on defined rules. As of the publication of this article, the following search engines support the IndexNow protocol:

Botify’s partnership with Bing can ensure your brand is being found by pushing your important content straight to Bing. Get your full HTML page content indexed by Bing immediately and guarantee your brand’s visibility across Bing and other answer engines. Configure Push to Bing

Send your new and updated content directly to Qwant's index to guarantee your brand's visibility in the premier French search engine.

SmartIndex uses extract rules to check if the URLs crawled by SiteCrawler and AlertPanel exist in SmartIndex:

This process builds an internal index within SmartIndex that is continuously enriched by Botify crawls. While URLs remain in the index indefinitely, they will not be sent to destinations if they have not been crawled for 60 consecutive days; they are considered “muted”. If a muted URL is crawled later, its metadata will be updated in the index, making it eligible to be sent to destinations again.

New and updated URLs are immediately sent to SmartIndex destinations based on your project segmentation and the conditions you define. Because SmartIndex continuously enriches its index from Botify crawls, you do not have to wait for the next Botify crawl before changes are detected.

The following are required for SmartIndex:

Read next: