The 9 Questions to Ask Before Hiring an AI Marketing Agency

If you're talking to "AI marketing agencies" in 2026, here's what you're actually picking from: 75% are traditional agencies that bought a ChatGPT subscription, 20% are real operators with mixed track records, and 5% are people who have actually shipped substantial AI infrastructure for paying clients.

The 9 questions in this guide are the ones I'd ask if I were on your side of the table evaluating an AI marketing agency. They're designed to filter the 75% out in the first call.

This isn't theoretical. We've sat in pitches against 47 self-described "AI marketing agencies" in 2025. We know how they answer.

Question 1: "Can you screen-share an AI voice agent running on a current client account, right now?"

What this tests: Whether they actually have AI infrastructure deployed in production.

Bad answers: "We can show you a demo on our test environment." "Most of our clients prefer their AI to be private." "Our setup is confidential."

Good answers: They share their screen. You watch a real voice agent take a real call or run a real outbound campaign. You see actual conversation logs, actual integrations, actual data flowing into a CRM.

The reality: Real AI marketing agencies have AI running 24/7 across multiple client accounts. They can show you within 30 seconds. Pretenders need a week to "set up a demo."

Question 2: "What voice agent platform do you deploy, and why?"

What this tests: Technical depth and platform knowledge.

Bad answers: "We use ChatGPT." "We've built our own custom AI." (Unless they actually have — verify) "We work with whatever platform the client prefers."

Good answers: Specific platform names with specific use cases — *"Bland.ai for high-volume outbound and routine inbound because of the pathways system and per-minute economics. Vapi for complex multi-turn conversations where we need custom LLM control. Retell AI when latency under 300ms matters for the use case."*

The reality: Real operators have strong opinions about Bland.ai vs Vapi vs Retell AI because they've shipped on all three and have data on which wins in which scenario.

Question 3: "What's your average client's lead response time?"

What this tests: Whether they have automation that actually works in production.

Bad answers: "We respond to most leads within the first business day." "Our response time is industry-leading." (vague)

Good answers: "Average response time across our portfolio is 71 seconds for AI-handled leads, 4 minutes for human-escalated leads. Worst-case during system maintenance is under 5 minutes."

The reality: If they can't give you a number to the second, they don't measure it. If they don't measure it, they don't optimize it. If they don't optimize it, you'll get the same slow lead response you have now — just with AI buzzwords attached.

Question 4: "Show me a closed deal traced back to a specific ad campaign in your reporting"

What this tests: Whether they have real attribution, not just vanity metrics.

Bad answers: "We use Meta's reported conversions and Google Analytics." "Attribution is hard, we focus on top-of-funnel metrics."

Good answers: They walk you through a specific closed deal — *"This $14,200 roof replacement contract closed February 12. The lead came in January 28 from a Meta ad in our Atlanta storm-response campaign. AI voice agent qualified them at 91 seconds. Estimate scheduled for January 30, signed contract Feb 12."* You see every step in the data.

The reality: Multi-touch attribution from ad to closed deal is hard to build but it's the foundation of real AI marketing. Anyone selling AI marketing without attribution is selling pseudo-science.

Question 5: "What's your client retention rate, and how do you handle clients who cancel?"

What this tests: Quality of work and how they treat clients who leave.

Bad answers: "We don't really lose clients." "Our churn is mostly clients whose businesses fail." "We can't share that."

Good answers: Specific numbers — *"86% annual retention. The clients who leave usually do so because they've reached a maturity where they're hiring an in-house team to take over what we built. We support that transition for 60 days post-cancellation including a full handoff of all AI configurations, automations, and account access."*

The reality: How an agency treats clients who leave tells you everything about how they'll treat you when things get hard. Real operators help clients leave well. Bad ones try to make leaving expensive.

Question 6: "Walk me through your strategic process before you'd start building anything for me"

What this tests: Whether they actually have a strategic process or just sell standardized snapshots.

Bad answers: "We do an onboarding call and then start building." "We have a proven framework we apply to all clients."

Good answers: Specific multi-week process — *"Week 1: Free audit of your current marketing infrastructure, ad accounts, CRM, and lead flow. We map every leak. Week 2: 90-minute strategy session covering offer architecture, ICP definition, channel prioritization, and AI deployment sequencing. Week 3: Detailed scope document with 12-month roadmap, quarterly milestones, and projected unit economics. Then build starts."*

The reality: Real strategic work happens *before* execution. Agencies that skip strategy and go straight to "let's deploy AI" usually fail because they're optimizing for the wrong outcome.

Question 7: "What's the seniority of the person who'd actually own my account, and how often will I talk to them?"

What this tests: Whether you'll get senior operator time or junior account management.

Bad answers: "You'll have a dedicated account manager." (Junior almost always.) "Our team is full of senior operators." (Vague.)

Good answers: Named individuals with named track records — *"Sara owns your account. She's deployed 47 AI marketing infrastructures across home services. You'll talk to her every two weeks for 90-minute strategic reviews, plus async Slack communication daily. She's the decision-maker on strategic direction, not an intermediary."*

The reality: Senior operator time is the input that drives outcomes. Junior account managers run plays they've memorized — they don't make strategic adjustments. If you're paying for senior strategy, demand to know who specifically.

Question 8: "How do you handle a campaign that's losing money? What's your response time and process?"

What this tests: Crisis response capability.

Bad answers: "We discuss in our monthly review." "We optimize continuously based on data."

Good answers: Specific response time and protocol — *"Performance dashboards check every 15 minutes against alert thresholds. If a campaign hits 1.5× projected cost per acquisition for 24 hours, automated alert fires to the account lead. Manual intervention happens within 4 business hours. We've never let a campaign run unprofitable for more than 48 hours."*

The reality: Money-losing campaigns happen. The difference between great agencies and bad ones is how fast they catch and fix them. If they don't have a specific protocol, they don't catch problems fast.

Question 9: "Give me 3 references in my industry that we can talk to, including one client who's been with you 2+ years"

What this tests: Track record depth and willingness to expose long-term performance.

Bad answers: "Our clients prefer to stay confidential." "We can share case studies but not direct references." "We can give you one reference."

Good answers: They give you 3+ names within 48 hours. Bonus: they offer references from clients who churned, not just current ones.

The reality: Real operators have happy long-term clients who will speak to prospects. They also know how to navigate confidentiality (clients can share results without disclosing proprietary data). If an agency can't produce references easily, that's a signal.

Bonus Question: "Are you going to try to sell me on AI as the answer, or are you going to tell me when AI isn't the right fit?"

What this tests: Whether they're consultants or salespeople.

Bad answers: Any version of "AI is the answer for everything."

Good answers: *"For your business specifically, AI lead response and follow-up are no-brainers — that's where 80% of the leverage is. But your strategic positioning and your closing process are human work. AI marketing isn't the answer for those. If we work together, I'll be telling you that constantly."*

The reality: Real consultants tell clients what to do AND what not to do. Salespeople sell whatever they're selling regardless of fit. You want a consultant.

Putting It All Together

If you ask all 10 of these questions and the agency stumbles on more than 2 — walk away. They're not who you want building infrastructure that's supposed to compound your unit economics for years.

The 5% of AI marketing agencies that pass these questions are the ones who'll actually deliver what they pitch. The other 95% will burn 6 months of your time and budget before you fire them.

Frequently Asked Questions

Should I get multiple agency proposals before deciding?

Yes — at least 3. The differences between agencies in this space are massive. Comparing only one proposal is how you get stuck with the wrong fit.

How long should the sales process take with a good AI marketing agency?

3–6 weeks from first call to signed agreement is healthy. Anyone trying to close you in week 1 is selling, not consulting. Anyone taking 12+ weeks is disorganized.

Should I expect the agency to guarantee results?

No. Anyone guaranteeing specific ROAS or revenue numbers is either lying or selling something they don't understand. Real agencies guarantee process, work product, and effort — not outcomes they can't fully control.

What red flags should I watch for in proposals?

Vague scope ("we'll handle your marketing"), no specific milestones, no attribution methodology, no escalation path for issues, long lockup periods (12+ months), prices hidden until contract signing.

Should I work with an agency in my city or remote is fine?

Remote is fine — most AI marketing work is fully remote. The exception: if you want regular in-person strategic sessions or your operation requires on-site visits, then local matters. Most don't.

---

If you've evaluated other AI marketing agencies and you want a direct comparison conversation with no pressure, [book a free 30-minute strategy call](/book). I'll answer all 10 of these questions about us, on the record, and tell you honestly whether we'd be a better fit than your other options — including telling you when we wouldn't be.