đ This article contains the most frequently asked questions about the AI Visibility dashboard, part of Botify's Analytics Suite, available as an option with all Botify plans.
General
What is AI Visibility?
What is AI Visibility?
AI visibility measures how often your brand and content are mentioned in AI-powered search results across platforms such as ChatGPT, Google AI Mode, and Perplexity. It helps you understand your visibility in the evolving AI search landscape and compare it to competitors.
How is this different from traditional SEO metrics?
How is this different from traditional SEO metrics?
Traditional SEO focuses on rankings on standard search engine results pages (SERPs) and on measuring clicks, impressions, and rankings. AI Visibility measures the visibility of AI-generated answers, enabling users to find information without clicking through to websites, and requires new metrics such as brand mentions and citation frequency.
Which AI platforms are included?
Which AI platforms are included?
The initial release includes ChatGPT, Google AI Mode, and Perplexity, which collectively account for the majority of the AI search market share. Additional platforms may be added in future releases based on market adoption and customer feedback.
Can Botify Assist access the data in the Visibility Report?
Can Botify Assist access the data in the Visibility Report?
Not currently, but possibly in the future.
Data
How does Botify collect this data?
How does Botify collect this data?
We use vetted third-party web scraping partners to collect response data in ChatGPT and Google AI modes. This approach yields more accurate results than API-only solutions because it captures the full context, including system prompts and user memory that affect responses. For Perplexity, we currently use only the Perplexity API.
How frequently is the data updated?
How frequently is the data updated?
Data is updated weekly, which should be sufficient for meaningful trend analysis.
Do we see any differences between the scraped content and API content?
Do we see any differences between the scraped content and API content?
For ChatGPT, there are differences between the scraped and API content. We use vetted third-party scraped content for ChatGPT and Google AI Mode because itâs more accurate: it captures the full context, including system prompts and user memory, which influence responses.
Will AI Visibility be available by API?
Will AI Visibility be available by API?
This is not currently planned, though we may revisit this in the future.
What data do we use in GenAI tools?
What data do we use in GenAI tools?
We use LLM knowledge to:
Determine brand terms
Find whether a prompt is branded or not
Find whether an answer is visible or not
Associate prompts with topics
Analyze answer sentiment
Find all the brands (i.e., competitors) mentioned in a given answer
Your confidential data is not used to train LLMs nor shared with other customers.
Why is Google AI Mode unavailable in most countries?
Why is Google AI Mode unavailable in most countries?
Scrapers cannot operate while logged in, as it would be too easy for Google to detect/block them. Google AI Mode is only available in the US, UK, and India when logged out. We are unable to run Google AI Mode campaigns in other countries because of this limitation.
Is there a way to visualize the query fanout process?
Is there a way to visualize the query fanout process?
No, not currently.
How accurate is the data in AI visibility?
How accurate is the data in AI visibility?
AI platforms do not provide first-party data; therefore, AI visibility is the best proxy available. Building prompts using your GSC data improves the relevance of the AI visibility results. See âDo we see any differences between the scraped content and API content?â
What are strategic pages?
What are strategic pages?
Strategic pages, as shown in the AI Discovery report, are those that generate 500 or more GSC impressions. You should focus on having these pages retrieved by LLMs.
What is considered âretrievalâ?
What is considered âretrievalâ?
Retrieval is when the ChatGPT-User bot visits a site during a user query.
Are AI Overviews tracked in the dashboard?
Are AI Overviews tracked in the dashboard?
Not currently, but it may be available in a future release. Currently, the data includes ChatGPT, Perplexity, and Google AI Mode (not AIO).
What does the AI Discovery page show?
What does the AI Discovery page show?
The data on the AI Discovery page shows a comparison of LLM activity vs. pages with impressions on Google SERPs from GSC. Strategic pages (i.e., those receiving 500+ impressions in GSC) should also see a high volume of activity from LLMs. When drill-down becomes available in these charts, you should first investigate the strategic pages that LLMs are not retrieving, followed by pages that received between 100 and 500 impressions.
How is visibility calculated?
How is visibility calculated?
The percentage of answers mentioning your brand aggregated across LLMs (e.g., when the brand is visible in a single ChatGPT prompt but not Perplexity, visibility = 50%).
What is the source of âNumber of user visitsâ in the AI Discovery report?
What is the source of âNumber of user visitsâ in the AI Discovery report?
The number of visits comes from your integrated logs, identified by referral data and ?utm_source=chatgpt.com entries (only available for ChatGPT).
In the âGSC vs ChatGPT analysisâ chart, how is the overlap determined?
In the âGSC vs ChatGPT analysisâ chart, how is the overlap determined?
By exact URL
How is sentiment measured?
How is sentiment measured?
An LLM performs sentiment analysis.
Is there a way to export AI visibility data to summarize weekly AI performance for stakeholders outside Botify?
Is there a way to export AI visibility data to summarize weekly AI performance for stakeholders outside Botify?
Not currently, but planned for a release in the near future.
Are there LLM checks to cleanse the data?
Are there LLM checks to cleanse the data?
Yes, we ask an LLM to check prompt relevancy. We are adding a moderation step for PAA questions after we saw ChatGPT flags that have caused workflow failures.
Can we ensure that ChatGPT, Perplexity, and Google AI Mode do not capture or store prompts for future model training?
Can we ensure that ChatGPT, Perplexity, and Google AI Mode do not capture or store prompts for future model training?
They should not capture or store prompts for future model training, as we are using licensed models under our license terms. Botify cannot warrant actions of third parties we do not control, but those entities are contractually required not to use the data. Refer to our Terms of Use for Botify GenAI Features for more information.
Prompts/answers
Whatâs considered an âanswerâ?
Whatâs considered an âanswerâ?
An answer is the combination of a prompt, a platform, date, and country, since a prompt can be run multiple times across each. The âAnswersâ page displays the list of prompts in the first column. For each run, we retrieve the overall response from ChatGPT, Perplexity, and Google AI Mode, which may vary. This means there may be duplicate prompts, but when considered with the platform and country, each is unique. You can click on a row for more details and see the platformâs full response.
When will prompts be run after adding a new campaign?
When will prompts be run after adding a new campaign?
Prompts are typically run within a few hours of campaign creation and after the first campaign edit in a week. Refer to Managing Campaign Updates for more information.
How can I tell when the next prompts are scheduled?
How can I tell when the next prompts are scheduled?
Prompts are scheduled to be run weekly on the day they were created. The next scheduled date is shown at the top of the Campaigns page. Refer to Managing Campaign Updates for more information on data updates.
What are the criteria for the top GSC Keyword prompt list?
What are the criteria for the top GSC Keyword prompt list?
We use the top keywords to generate prompts with People Also Ask questions; we do not get prompts directly from the keywords. We use the most recent GSC keywords for every new campaign and update them every three months to ensure the campaign remains accurate.
Is the 'People Also Ask' logic relevant, given that prompts are highly specific and customized to each user?
Is the 'People Also Ask' logic relevant, given that prompts are highly specific and customized to each user?
Since we do not have first-party data from AI search engines, we need to find effective directional prompts. "People also ask" shows popular queries from Google search, which are different from what you would ask ChatGPT, but still a good indicator of your visibility (i.e., the "directional" part).
How much of the previous prompts will be used in subsequent periods?
How much of the previous prompts will be used in subsequent periods?
It depends on how much the top keywords are changing over time:
If they are not changing, then you can expect the prompts to remain static.
If there is a significant change, then expect a significant change in the prompts.
How does topic generation/mapping work?
How does topic generation/mapping work?
We use an LLM to generate topics from the prompts when each campaign batch runs. We generate three topics per prompt. Some campaigns may have more topics than others if there is little similarity across prompts. Broader topics not explicitly mentioned may be used if the prompts strongly imply a general subject (e.g., âbest budget laptopsâ â electronics).
What are the numbered brackets in the answer detail (full response)?
What are the numbered brackets in the answer detail (full response)?
These numbers are the links we retrieve from the response body to cited domains. We do not retrieve the links used as sources in the AI response.
Competitors
How does the competitive analysis work?
How does the competitive analysis work?
The competitive analysis shows how your brand compares to competitors across AI platforms. You can:
Select specific known competitors to track (up to five).
Discover those that appear in responses but were not on your radar (i.e., from citations/links in responses).
View Share of Voice as a percentage across all analyzed prompts.
See which topics/categories you're winning or losing against competitors.
Track mention frequency over time.
What informs the competitors in the database? Can I add competitors to the database?
What informs the competitors in the database? Can I add competitors to the database?
An LLM analyzes the answers to detect brands. You can select your main competitors for SoV computation.
Are misspellings of my brand name treated as a single brand or individually?
Are misspellings of my brand name treated as a single brand or individually?
They are treated as a single brand to ensure an accurate AI Visibility report. Note that misspellings of competitor brand names are not currently consolidated.
Citations & mentions
What is the difference between mentions and citations?
What is the difference between mentions and citations?
Mentions refer to your brand appearing in the AI Search Result; citations refer to the client domain appearing in the AI Search Result.
What constitutes a brand mention?
What constitutes a brand mention?
An LLM determines if your brand is mentioned in the answers.
Are brand mentions aligned with branded keywords?
Are brand mentions aligned with branded keywords?
Not currently.
Are brand mentions case-sensitive?
Are brand mentions case-sensitive?
No, brand names are not case-sensitive in brand mentions.
Topics/categories
Is âPeople Also Askâ (PAA) for categories and top keywords?
Is âPeople Also Askâ (PAA) for categories and top keywords?
PAA is used for top keywords, but not for categories. We use âPeople Also Search Forâ (PASF) first, then an LLM to generate category prompts.
How is the category workflow constructed?
How is the category workflow constructed?
We use PASF to identify related keywords, then an LLM to generate prompts based on those keywords.
Campaigns
How are transactional, commercial, and informational intents defined?
How are transactional, commercial, and informational intents defined?
An LLM evaluates intent as follows:
Transactional: A user's desire to complete a specific action, such as making a purchase, event enrollment, scheduling a service, or subscribing to a newsletter.
Commercial: When a user is in the consideration phase of the buyerâs journey, indicated by searches for comparisons or reviews.
Informational: When a user is searching for information or knowledge, often to answer a specific question or learn about a topic. These users may be in the earliest stage of the buyerâs journey.
What is the average campaign size?
What is the average campaign size?
There is no average campaign size. Prompts are distributed equally across all campaigns by default. You can adjust this distribution using sliders to increase or decrease the percentage allocation for each campaign.
Are the Top GSC Keyword campaigns based on the last week, month, or year?
Are the Top GSC Keyword campaigns based on the last week, month, or year?
They are based on the last 60 days.
How many keywords are used in Top GSC Keyword campaigns?
How many keywords are used in Top GSC Keyword campaigns?
The number of keywords is dynamic and adaptive. We fetch as many keywords as necessary to generate the configured number of PAA questions.
What date range is used for keywords?
What date range is used for keywords?
60 days.
Why are my Top GSC Keyword campaigns in two languages showing some answers in the wrong language?
Why are my Top GSC Keyword campaigns in two languages showing some answers in the wrong language?
The country flag is the country where we asked the question to the LLM. A prompt in the same language but in different countries will not produce the same answer, depending on your location. Since we do not specify the language when we submit the question, the LLM may answer in the same language as the question or in the language of the original keyword or category. This can produce unexpected results by returning answers in a language not native to a country (e.g., Italian in France).
Are GSC keyword campaigns a snapshot of the top-performing keywords at that time, or are they refreshed to look at the new best-performing keywords based on clicks over time?
Are GSC keyword campaigns a snapshot of the top-performing keywords at that time, or are they refreshed to look at the new best-performing keywords based on clicks over time?
It is a snapshot of the top-performing keywords by clicks over the last 60 days.
Can you use page segments in the AI Visibility dashboard?
Can you use page segments in the AI Visibility dashboard?
You can use segmentation-style groupings with AI Visibility, but itâs done through Campaigns rather than the âsegmentsâ filters you use in Botify Analytics reports. In AI Visibility, you track and filter results by campaign, and each campaign can be built from different prompt/keyword sources, including your website categories.
See also:
