Botify

📘 This lists the bots, or web crawlers, supported in Botify.

Activity for the following bots is available in LogAnalyzer reports when included in your log files. The activity for the bots indexing content for search engines is also included in SiteCrawler reports. Activity from other bots is excluded in SiteCrawler since these bots only access and crawl web pages to gather information or perform analysis and, therefore, do not impact your SEO. Including the crawl activity for these non-indexing bots would skew your analyses with data that does not affect your site evaluation.

If you <a href="https://support.botify.com/en/articles/9108606-filtering-log-data">filter your log data</a>, update your filters to include these bot user agents.

Botify can only authenticate bots that share their IP addresses. The following supported bots do not share their IP addresses. While crawls from these bots will appear in Botify when <a href="https://support.botify.com/en/articles/9108606-filtering-log-data">included in your log data</a>, we cannot validate crawls from them:

- Bytespider
- CCBot
- ClaudeBot
- Claude-Web

___________________________________________________________

- <b>June 12, 2026</b>: Added OAI-AdsBot
- <b>April 20, 2026</b>: Added Claude-User, Claude-SearchBot, Google-Agent

<a href="https://support.botify.com/en/articles/9108712-supported-bots-in-speedworkers">Supported Bots in SpeedWorkers</a>

<a href="https://support.botify.com/en/articles/9108606-filtering-log-data">Filtering Log Data</a>

- <a href="https://support.botify.com/en/articles/9108712-supported-bots-in-speedworkers">Supported Bots in SpeedWorkers</a>
- <a href="https://support.botify.com/en/articles/9108606-filtering-log-data">Filtering Log Data</a>

Supported Bots

Find answers and get help from Intercom Support and Community Experts

Conversations you've started through the messenger will appear here.

No conversations created by you

Try using different keywords or checking for typos.

No conversations found

Title

This site employs cookies and other technologies that we and our third party vendors use to monitor and record personal information about you and your interactions with the site (including content viewed, cursor movements, screen recordings, and chat contents) for the purposes described in our Cookie Policy. By continuing to visit our site, you agree to our {websiteTermsLink}, {privacyPolicyLink} and {cookiePolicyLink}.

This site uses cookies and similar technologies ("cookies") as strictly necessary for site operation. We and our partners also would like to set additional cookies to enable site performance analytics, functionality, advertising and social media features. See our {cookiePolicyLink} for details. You can change your cookie preferences in our Cookie Settings.

We use cookies to make our site work and also for analytics and advertising purposes. You can enable or disable optional cookies as desired. See our {cookiePolicyLink} for more details.

Advertising cookies are set by our advertising partners to collect information about your use of the site, our communications, and other online services over time and with different browsers and devices. They use this information to show you ads online that they think will interest you and measure the ads' performance. Social media cookies are set by social media platforms to enable you to share content on those platforms, and are capable of tracking information about your activity across other online services for use as described in their privacy policies.

These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.

These cookies are necessary for the website to function and cannot be switched off in our systems.

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site.

You have the right to opt out of the sale of your personal information. See our {cookiePolicyLink} for more details about how we use your data.

Your Privacy Choices

We use cookies to enhance your experience. You can customize your cookie preferences below. See our {cookiePolicyLink} for more details.

Cookie Settings

Empty Help Center

Uh oh. That page doesn’t exist.

Home

Search results

Disappointed

Neutral

Smiley

Thinking...

Searching through sources...

Analyzing...

Tickets submitted through the messenger or by a support agent in your conversation will appear here.

No tickets created by you

No tickets found

Track the progress of all tickets and conversations related to your company.

Customer Portal.

Track the progress of all tickets related to your company.

Tickets portal.

{assigneeName} needs more information from you

Tickets

No access to tickets portal

Search

Skip the search. Describe what you’re trying to do and get a grounded answer.

Browse articles and guides in this topic.

Create your workspace and invite the people you work with.

Set up your account

Build your first workflow and watch it run end to end.

Ship something

Connect the tools your team already uses to bring data in.

Connect your stack

A quick lap of the product so you know where everything lives.

{appName} in 60 seconds

This prototype demo is aware that you are reading “{title}”. It can point you back to the current article, but a production article-aware Fin contract is still follow-up work.

Prototype article-aware answer

Because you already asked about invitations, this prototype demo can add the follow-up: use the role selector before sending each invite to limit access to the teammate responsibilities.

Prototype role-limiting follow-up

This prototype demo suggests starting with your workspace profile, inviting the team members who need access, and then connecting the integrations you use.

Prototype getting-started answer

In this prototype demo, integrations are configured from workspace settings. Choose the integration, connect the account, and review the enabled permissions.

Prototype integrations answer

In this prototype demo, invite teammates from workspace settings, then choose the access each teammate needs before sending the invitation.

Prototype invite-team answer

This prototype demo does not have a scripted answer for that question yet. Try asking how to invite your team or open a source article. No production Fin API was called.

Prototype answer unavailable

I’ve got this page open. Ask me anything about it and I’ll answer from the docs.

Source/Owner	Bot Name	In SiteCrawler?
Google	AdsBot Desktop	✔️
	AdsBot Mobile	✔️
	Google Agent	✔️
	Googlebot Desktop	✔️
	Googlebot Images	✔️
	Google InspectionTool	❌
	Google Video	✔️
	Google Other	❌
	Google AdSense Desktop	✔️
	Google AdSense Mobile	✔️
	Googlebot Smartphone	✔️
	Google Storebot	✔️
	Google Video	✔️
Bing	Bingbot	✔️
OpenAI	GPTBot	❌
	ChatGPT-User	❌
	OAI-AdsBot	✔️
	OAI-SearchBot	✔️
AI Bots	AmazonBot	✔️
Anthropic	Anthropic-ai	❌
ByteDance/TikTok	Bytespider	✔️
Common Crawl	CCBot	✔️
Anthropic	ClaudeBot	✔️
Anthropic	Claude-SearchBot	✔️
Anthropic	Claude-User	✔️
Anthropic	Claude-Web	❌
Meta	FacebookBot	❌
Meta	Meta-ExternalAgent	✔️
Mistral	MistralAI-User	❌
Perplexity AI	PerplexityBot	✔️
	Perplexity-User	✔️
You.com	YouBot	✔️
Apple	Applebot	✔️
Yandex	Yandex Antivirus	✔️
	Yandex Blogs	✔️
	Yandex Catalog	✔️
	Yandex Direct	✔️
	Yandex Favicons	✔️
	Yandex ImageResizer	✔️
	Yandex Images	✔️
	Yandex Market	✔️
	Yandex Media	✔️
	Yandex Metrika	✔️
	Yandex News	✔️
	Yandex Pagechecker	✔️
	Yandex Search	✔️
	Yandex Video	✔️
	Yandex Webmaster	✔️
	Yandex Zakladki	✔️
Naver	Naver Search	✔️
Baidu	Baidu Bookmark	✔️
	Baidu Business (Ads)	✔️
	Baidu Image	✔️
	Baidu Mobile	✔️
	Baidu News	✔️
	Baidu Search	✔️
	Baidu Union	✔️
	Baidu Video	✔️

Supported Bots

Overview

Bot list

About bot authentication

Change log