You've found an agency you like. The pitch was clean. The case studies looked impressive. They mentioned AI. You're about to sign.
Stop for ten minutes.
In the last post, we made the case that there are two kinds of marketing systems being sold right now — AI-native and AI-bolted-on. They look identical in a sales meeting. They diverge violently inside 12 months. The bolted-on version costs you twenty grand twice — once to build, once to rebuild when it breaks under load.
This is the post that gives you the diagnostic. Five questions. About ten minutes of conversation. They expose the difference fast.
You don't need a technical background to use them. You don't need to know what GTM is or what a CRM does. You just need to ask each question, listen to the shape of the answer, and notice which agencies get evasive. The evasive ones are the bolted-on ones, almost without exception.
Take this list to every agency you're considering. Compare answers. The shortlist will write itself.
Question 1: Is AI running through every step of your system, or just one?
The bolted-on agency uses AI for ad copy. That's the whole story. They'll call themselves "AI-powered" because they have ChatGPT open in a tab.
The AI-native agency has AI woven through the whole stack — audit, customer research, tracking setup, ad copy, search-intent classification, lead qualification, content production, reporting. AI doesn't sit in one corner; it's load-bearing.
A good answer sounds like: "Walk me through the seven steps and I'll tell you where AI runs in each one." (Then they actually walk you through it. Specifically.)
An evasive answer sounds like: "We use ChatGPT to draft ads." Or worse: "We're an AI agency."
Follow-up if you need it: "Show me one example, end to end." If they can't, the AI is window dressing.
Question 2: Will I own my tracking and my data?
This is the make-or-break question, and almost no one asks it.
Here's why it matters: AI is only as smart as the data feeding it. Your conversion tracking, your GA4, your CRM history — that's the fuel. If the agency owns the access, you're not buying a system. You're renting one. The day you stop paying them, the system stops working for you and starts working for them.
A good answer sounds like: "Your GTM. Your GA4. Your CRM. We get admin access; you keep ownership. If we part ways, you keep everything intact, and any new agency can pick up where we left off."
An evasive answer sounds like: "Don't worry, we handle all that for you." (That's not reassurance. That's hostage-taking dressed up as service.)
Follow-up if you need it: "What happens to my tracking and my data if our contract ends in six months?"
Question 3: Does the CRM talk to the AI directly?
Most agencies have AI in one place and a CRM in another. Humans copy-paste between them. That's not a system; that's two tools in the same room with a person in the middle.
The AI-native agency wires them together. A lead comes in → AI scores it against your ideal customer profile → the right sequence fires → a follow-up email is drafted from real customer language → a human reviews and sends. The human does judgement work, not transcription work.
A good answer sounds like: "The CRM and the AI are wired up via API. Lead lands, qualified within minutes, routing happens automatically, follow-up draft is on the assigned rep's desk before they've finished their coffee. They edit and send."
An evasive answer sounds like: "We integrate them" (without specifics). Or: "We use Zapier to connect things." (Zapier alone usually means glue, not architecture.)
Follow-up if you need it: "Walk me through what happens to a single lead — from form fill to first follow-up email — every step. Tell me which steps are AI and which are human."
Question 4: Can your system scale from 3 leads a month to 300 without a rebuild?
This is the test that surfaces the architecture, not the talk.
The bolted-on system runs out of road around 30 leads a month — about as many as one agency human can nurture by hand. Past that, leads start dropping through cracks. Quality declines. Things break. The agency comes back to you and asks for more retainer to "expand the system."
The AI-native system doesn't have that ceiling, because the work is happening inside the system, not inside someone's inbox. The real constraints become real-world ones: ad budget, sales follow-up capacity, fulfilment.
A good answer sounds like: "Yes — and the constraints at scale would be your ad spend and your sales team's capacity to call leads. Not the system itself."
An evasive answer sounds like: "We'll cross that bridge when we come to it." (Translation: we haven't built that bridge.)
Follow-up if you need it: "At what volume does the system break first, and what breaks?"
Question 5: Who's actually doing the work — the senior, or a junior?
AI doesn't change this question. Expertise is still the bottleneck. AI can compress hours of grunt work into minutes, but it can't make judgement calls a junior can't make. If you're hiring an agency for the senior brain, make sure that brain is the one delivering.
This is also where most agencies fall apart. A senior wins the pitch. A junior does the work. You don't find out for three months.
A good answer sounds like: "[Named senior consultant] — here's their LinkedIn. They handle the strategic work and the deliverable review on every account, and you'll meet them in the kickoff."
An evasive answer sounds like: "Our team" (without specifics). Or: "We have a process" (also without specifics).
Follow-up if you need it: "If something breaks at 3am the day before our launch, who's on the phone?"
What to do with the answers
Take this list to three agencies. Ask the same five questions to each. You don't need to score them. You just need to notice the shape of the answers.
The AI-native operator will breeze through five questions in ten minutes. They'll show you specifics. They'll have data ownership built into how they work. They'll tell you who's on the account and what scales when.
The bolted-on agency will hesitate, deflect, or oversell on at least two of the five.
You'll know.
If you'd rather skip the agency-shopping step entirely and just see what an AI-native version of your marketing looks like, the $1 AI Marketing Audit is the shortcut. Send us your URL and a dollar. We'll come back with the top issues we'd fix and what an AI-native rebuild actually looks like for your business. The audit answers all five of these questions for you without you having to ask anyone.
The next post in this cluster is about what happens when you skip the diagnostic and hire the wrong agency anyway — the renewal trap, twelve months in, with real numbers. If you're already convinced, you can skip it. If you need one more reason to slow down, read it.