--- title: "The Fixed Set Method: How to Measure AI Visibility Without Lying to Yourself" description: "Most AI visibility numbers move because someone changed the questions. The Fixed Set Method is how Zion Labs measures generative engine optimization honestly: a fixed prompt set, multi-run sampling, error tracing, and a nine-check readiness score." published: 2026-08-09 updated: 2026-08-09 author: "Ben, Founder" publisher: "Zion Labs" canonical: https://www.zionlabs.io/research/the-fixed-set-method source: Zion Labs research --- # The Fixed Set Method: How to Measure AI Visibility Without Lying to Yourself ## The short version - The Fixed Set Method is how we measure whether AI answer engines name your brand, in a way you can trust and repeat. - Most tools quietly change the questions between runs, so their numbers move for no real reason. We do the opposite. - Four rules: ask the same questions every time, ask each one several times, trace every wrong answer to the page that caused it, and score whether the page is even built for AI to read. - Why it holds up: in one client scan we found 18 contradictions, and 7 showed up in just one of three runs. A single run would have sold those 7 as real, a 39% noise rate. - The payoff: numbers that mean the same thing next quarter, and every problem tied to a page you can fix. ## What generative engine optimization means, and how we measure it **Generative engine optimization (GEO) is the work of getting AI answer engines to name, quote, and recommend your brand when they answer your market's questions.** SEO earns you a spot in a list of links. GEO earns you a spot inside the answer itself: the paragraph ChatGPT writes, the sources Perplexity lists. It is measured by how often you get cited, not by keyword rankings. Answer engine optimization (AEO) is the close cousin: being the one direct answer to a question, like a featured snippet. We pull the terms apart in [AEO vs GEO vs SEO](/research/aeo-vs-geo-vs-seo) and define GEO in full in [What Is Generative Engine Optimization](/research/what-is-generative-engine-optimization). The hard part is measurement. The answer reads differently every time you ask, so how do you get a number you can trust? That is what the Fixed Set Method solves, with four rules. ## Rule one: a fixed prompt set The questions never change. Baseline your brand on fifty questions this quarter and forty different ones next quarter, and any change in the score is meaningless. You cannot tell if you improved or the test got easier. **A number that moves because someone changed the questions is a story, not a measurement.** So we write the questions down at the start and reuse them exactly every time. A new question starts its own count from zero rather than quietly padding the old one. ## Rule two: ask each question several times AI engines are non-deterministic. Ask the same question three times and you often get three different answers. So one run is a single lucky or unlucky pull, not a measurement. We saw why this matters. In one client scan across ChatGPT, Perplexity, and Gemini, running every question three times, we found 18 contradictions with the client's own facts. **7 of those 18 showed up in only one of the three runs.** A one-shot tool would have sold all 7 as real findings, shipping noise at a 39% rate. Several runs tell you what an engine actually tends to say. ## Rule three: trace every error to a page Finding that an engine is wrong about you is half a result. The half that matters is knowing why. **Nobody can edit a model. We control every input it reads.** You cannot call OpenAI and fix their weights, but you can find the page the engine pulled from and fix that. So we trace each wrong answer back to its source, using the links and citations the engines attach themselves. In that scan, one contradiction traced straight to a page on the client's own site, one they could edit that afternoon. When a wrong answer cannot be traced, we say so, rather than blaming whichever source happened to be listed first. ## Rule four: score the page for AI An engine can only cite a page it can reach and read cleanly. Many pages fail before citation is ever in play: they block AI crawlers, bury the answer, or break into chunks that make no sense alone. The [Retrieval Readiness Score](/retrieval-readiness-score) is our free nine-check scan of a single page for exactly those problems. It will not create demand for you on its own, and we have published our finding that readiness does not predict your citation rate once brand size is accounted for. What it does is clear the reasons an engine cannot use your page in the first place.
## How the four rules fit together Fix the questions so the ruler does not move. Ask each one several times so a fluke is not a finding. Trace every error to a page you can fix. Score the page so AI can read it at all. Then run the same set again and watch the number move for a real reason. Each rule closes one way of fooling yourself. Change the questions and you fake progress. Ask once and you ship noise. Skip the trace and you have a complaint, not a fix. Skip the readiness check and you polish a page AI cannot read.
## Where to start Want this run on your own brand? Our [AI Visibility Audit](/services/ai-visibility-audit) applies the full method: a fixed question set for your market, several runs across the major engines, every wrong answer traced to a page, and a readiness pass on the pages that matter. Or start yourself. The [free tools](/tools) need no login. Run the [Retrieval Readiness Score](/retrieval-readiness-score) on your most important page first, to see if it is even in the game. ## Frequently asked questions ### What is generative engine optimization? Generative engine optimization (GEO) is the practice of making your brand the source that AI answer engines cite, quote, and recommend when they answer your market's questions. Where classic SEO earns a ranking in a list of links, GEO earns you a place inside the AI-generated answer itself, and it is measured by citation share and answer accuracy rather than by keyword rankings. ### What is answer engine optimization? Answer engine optimization (AEO) is optimizing to be the single direct answer to a question, whether that is a featured snippet or an AI reply. It sits between SEO and GEO: SEO earns a position, AEO earns the answer, and GEO earns a citation inside a synthesized answer that blends several sources. ### What is the Fixed Set Method? The Fixed Set Method is how Zion Labs measures AI visibility so the numbers mean something over time. It has four planks: a fixed prompt set that never changes between measurements, multi-run sampling because engines are non-deterministic, error tracing that ties every wrong answer back to the source page that caused it, and a nine-check Retrieval Readiness Score for the page itself. ### Why measure AI visibility with the same prompts every time? Because a number that moves because someone changed the questions is a story, not a measurement. If the prompt set changes between runs, you cannot tell whether your visibility improved or the test got easier. Fixing the questions is what turns a demo into a baseline you can trend. ### Why run each AI prompt more than once? AI answer engines are non-deterministic, so the same question returns different answers on different runs. In one Zion Labs scan, 7 of 18 contradictions appeared in only one of three runs. A single-pass tool would have sold those seven as findings at a 39% noise rate. Running each prompt several times separates what repeats from what was noise.