Skip to content

AI visibility measurement guide · By Yes AI

Questions to ask before hiring a GEO agency

Published 6 min read

Generative engine optimisation (GEO) and answer engine optimisation (AEO) are now sold by SEO agencies, software vendors and freelancers. Google has published advice on hiring SEO help and has said that, for Google Search, this work is SEO. These questions help you compare providers on evidence.

Quick answer

Ask each provider which official documentation supports their recommendations, what they will measure before and after, how they handle answers that vary between runs, which changes they will make to your site and what access they need. Walk away from anyone who promises citations or rankings, claims special relationships with Google or OpenAI, or sells a score they cannot explain. Google says no third-party tool has access to its internal ranking or AI systems.

Business owner and marketing consultant talking across a timber table in a Sydney office with notebooks

What should a GEO provider ask you first?

Google's advice on hiring an SEO says a good provider should be interested in your business and ask what makes it unique, who your competitors are and how your customers find you. The same test applies to AI visibility work. A provider who starts with a package before asking which questions your buyers put to assistants, which suburbs or regions you serve and which jobs you want more of has no basis for choosing prompts or pages. Expect them to ask who on your side will act on the findings, because an audit that nobody implements changes nothing.

Which questions should you ask a provider?

Google suggests asking an SEO for examples of previous work, whether they follow Google Search Essentials, what results they expect and in what timeframe, how they measure success, what experience they have in your industry and location, and whether they will share every change they make with the reasoning. Google's current version of that advice also asks whether they cite official Google documentation for their recommendations and whether any AEO or GEO advice they give is aligned with Google's official guidance. Add the following for assistants other than Google.

  • Which assistants will you test, with which questions, and will I receive the raw answers?
  • How do you handle answers that change between runs of the same question?
  • Which official documentation supports each main recommendation?
  • Which pages, settings and listings will you change, and who approves each change?
  • What will you measure before work starts, and when will you measure it again?

Which claims are warning signs?

Google's hiring advice says nobody can promise a number one ranking on Google, and warns against providers who claim a special relationship with Google, advertise priority submission, are secretive about what they will do or talk about link schemes. Its generative AI guidance adds that no third-party tool has access to Google's internal ranking or AI systems, and that seeking inauthentic mentions across the web is less helpful than it might seem. Apply the same caution to claims about ChatGPT. OpenAI's documentation describes crawler access and no paid or priority route into its search answers.

  • A promise that you will be cited, named or ranked first.
  • A visibility score with no explanation of how it is calculated.
  • Claims of partnerships or insider access to Google or OpenAI.
  • Plans to post mentions or reviews under made-up identities.
  • Requests for owner-level access to every account on the first day.

What access should you give at the start?

Google advises that if a provider offers an SEO audit, you grant read access to Search Console only and do not grant write access at that stage. Search Console has three main roles. An owner has full control, including adding users and configuring settings. A full user can view all data and take some actions. A restricted user has simple view rights on most data. Keep ownership within the business, so access can be removed when the engagement ends. For the website itself, create a separate login for the provider rather than sharing an existing password.

How should results be reported?

Ask for a baseline before any change: the questions tested, the assistants used, the dates and the raw answers with their cited links. Later reports should rerun the same questions under the same conditions and keep each measure in its own column. Search Console's Generative AI report counts impressions, Bing Webmaster Tools counts citations, GA4 counts visits and your enquiry records count leads. A report that blends these into one score hides which one moved. Outcomes such as being named more often can only be measured after the work, so be cautious of a proposal that states them in advance.

When do you not need an agency?

Google's hiring page says a small local business can probably do much of the work itself, starting with Google's SEO starter guide. Much of the AI visibility groundwork is similar: confirm crawlers can reach the site, keep the Business Profile accurate, state the facts buyers need on each service page and fix contradictory listings. An outside provider is worth paying when there is a technical problem you cannot diagnose, when nobody has time to run consistent prompt checks, or when the site needs substantial rewriting. Paying for checks your own team can run is poor value.

Provider claims and what to ask for

What you hearWhat to ask forWhy
We will get you recommended by ChatGPTThe before-and-after method and how varying answers are handledAnswers vary between runs, and OpenAI describes no paid route into them
We are a Google partner for AI OverviewsWhat the partnership covers, in writingGoogle says it never accepts money to include or rank sites in organic results
Your AI visibility score is lowHow the score is calculated and what it was tested againstGoogle says no third-party tool has access to its internal systems
You need llms.txt and special schema for GoogleThe primary source for that requirementGoogle says neither is needed for its AI features
We will build mentions for you across forumsWho writes them and under which namesGoogle says inauthentic mentions are less helpful than they seem
We need owner access to everythingWhy a restricted or full user role is not enoughGoogle advises read-only Search Console access for an audit

Practical checklist

  • The provider has named the official documentation behind each main recommendation.
  • A baseline prompt set and its raw answers will be handed over to you.
  • Search Console access starts at a restricted or full user role, with ownership kept by the business.
  • The scope lists each page and setting that will change, and who approves changes.
  • Reports will keep impressions, citations, visits and enquiries separate.
  • No fee is tied to a citation or mention count the provider generates itself.
  • The contract states how either side can end the engagement and what you keep.

Common questions

Is GEO a separate discipline from SEO?

Google says that, from its perspective, optimising for generative AI search is optimising for the search experience and is still SEO. Other assistants add some separate work, such as allowing their own crawlers and testing answers with repeated prompts. A provider should be able to say which parts of their proposal are standard SEO and which are specific to other assistants.

Can any provider promise that ChatGPT will name us?

No. OpenAI has not published how ChatGPT chooses which businesses to name, its documentation describes no paid route into search answers, and answers vary between runs of the same question. A provider can improve the information assistants can find about you and measure whether mentions change over time. That measurement happens after the work is done.

Should we ask for case studies?

Yes. Google's hiring advice suggests asking for examples of previous work and success stories, and checking references with past clients. For AI visibility work, ask to see the before-and-after prompt data behind a case study, how many runs each figure is based on, and what else changed on the client's site during the same period.

What should a written scope include?

The pages, settings and listings that will change, who writes the new copy, who approves changes before they go live, the measurements taken before and after, what is excluded, and how either side can end the engagement. Timing should be stated in the written quote. If any of these are missing, ask for them before you sign.

Should the fee depend on how often we are cited?

Be careful with that model. Citation and mention counts vary between runs of the same prompt, and a provider measuring its own results with its own tool sets the number that decides its fee. A fixed fee for defined work, with measurements you can rerun yourself, is easier to check.

Sources and further reading

Continue planning

Plan an evidence-led AI visibility review

Describe your business category, service area and the questions buyers ask. We can discuss a repeatable visibility baseline and which public content needs review. Keep customer records and confidential information out of this enquiry.