THINXSTER
Blog/AI Agents
AI Agents10 min readAugust 7, 2026

How to Build AI Agents for Companies (Without Shipping a Liability)

Building an AI agent for a real business is 20% model work and 80% process and guardrails. Here's the build sequence that survives real customers.

RK
Ryan Korsz
Founder & CEO, Thinxster

TL;DR

Building an AI agent for a real business is 20% model work and 80% process and guardrails. Here's the build sequence that survives real customers.

→ See how this applies to your business (free 30-min call)

The demo is the easy part. Anyone can wire an LLM to a tool call and produce something impressive in an afternoon. The gap between that and an agent a company will let near its customers is roughly twelve weeks of unglamorous work, and almost none of it is model work.

I've shipped agents into live service businesses where a bad conversation costs a $12,000 job. Here's the sequence that holds up.

Step 0: Establish That an Agent Is the Right Tool

Before anything: can you draw the complete flowchart for this task?

If yes, build deterministic automation instead. It's cheaper, faster, testable, and it won't surprise anyone at 2am. Reserve agents for processes with an irreducible "it depends" — where the input is unstructured, the path branches on judgment, or the conversation has to adapt.

The most common expensive mistake in this field is putting a language model where a conditional statement belonged.

Step 1: Shadow the Human Who Does It Today

Spend a full day with the person whose job you're partially automating. Not an interview — observation.

You're looking for the things nobody documents:

  • The questions they ask that aren't on any script
  • The tells they use to decide someone is wasting their time
  • The exceptions they handle without noticing they're exceptions
  • The moment they escalate, and why
  • An agent built from a process document will be competent. An agent built from watching the best person do the work is good. That difference shows up in the first hundred real conversations.

    Record everything with permission. Those recordings become your evaluation set later, which is worth more than the script itself.

    Step 2: Write the Success Definition Before the Prompt

    You cannot improve what you haven't defined. Before any code, write down:

  • The primary metric. Booking rate, resolution rate, qualification accuracy, response time. One number.
  • The guardrail metrics. Escalation rate, customer complaints, false qualification rate. These catch an agent that games the primary metric.
  • The unacceptable outcomes. Explicitly enumerated: never quotes a price, never promises a date, never argues with a customer, never continues when it doesn't understand.
  • The baseline. What the human process produces today. Measure it for two weeks. Skip this and you'll never prove value, and the project will die at the first budget review.
  • Step 3: Design the Architecture Around Failure, Not Success

    The single biggest difference between a demo agent and a production agent is that the production one is designed assuming it will be wrong.

    Four principles:

    Narrow the surface. One agent, one job, a small set of tools. A qualification agent that also handles billing questions and also books service will be mediocre at all three. Multiple narrow agents with clean handoffs beat one broad agent every time.

    Verify at every seam. Force structured output — the agent returns typed fields, not prose you parse hopefully. Validate those fields against rules before acting. A booking agent should never be able to write a calendar event with a date it hallucinated; the date must pass a validator first.

    Checkpoint long chains. Reliability multiplies downward. At 95% per-step accuracy, a ten-step unchecked chain is around 60% reliable end to end. Break it into three-step segments with verification between them.

    Build the exit first. Every agent needs a clean escalation route to a human, with full context transferred. Design this before the happy path. The agents that damage companies are the ones with nowhere to go when confused.

    Design your agent's failure path before its success path. The success path is the part that already works in the demo.

    Step 4: Ground It in Real Data

    Most agent failures in production are knowledge failures, not reasoning failures. The agent is confidently wrong about pricing, service area, availability, or policy.

    Fix this structurally:

  • Retrieve, don't remember. Pricing, hours, service areas, and policies come from a live source at conversation time. Never bake them into a prompt where they'll silently go stale.
  • Give it real-time tool access for anything volatile: calendar availability, inventory, account status.
  • Make "I don't know" a first-class answer. Explicitly instruct and reward escalation over speculation. An agent that says "let me get someone who can confirm that" is doing its job correctly.
  • Step 5: Build an Evaluation Set Before You Launch

    This is the step that separates teams who ship reliably from teams who ship and pray.

    Take 50–100 real conversations from Step 1. Turn each into a test case with an expected outcome. Run every prompt change against the whole set. Track pass rate.

    Without this, every improvement is a guess and every regression is a surprise a customer finds for you. With it, you can change the script on a Tuesday and know by Tuesday afternoon whether it made things better.

    Include the nasty ones deliberately: the caller who interrupts, the wrong number, the person asking about something entirely different, the one-word answers.

    Step 6: Ship Narrow, With a Human Watching

    Launch sequence that works:

    1.

    Shadow mode. Agent handles nothing; it drafts what it would have said while a human handles the real interaction. Compare. One to two weeks.

    2.

    One channel, one segment. After-hours calls only, or one lead source only. Contained blast radius.

    3.

    Human review of every interaction for the first two weeks. Every single one. This is where you find the three specific broken moments every agent has.

    4.

    Widen by segment, not all at once, with the primary metric checked at each widening.

    5.

    Weekly transcript review, permanently. Not a launch activity — an operating one.

    Skipping stage three is the most common cause of a failed rollout. The agent is usually 90% right on day one, and the 10% is concentrated in three fixable patterns you can only find by reading.

    62%
    average lead qualification rate across client accounts — the number that gets tuned weekly

    Step 7: Handle the Non-Technical Requirements

    These kill more deployments than model quality does:

  • Disclosure. Tell people they're talking to an AI when they ask, and in many jurisdictions before they ask. This is a legal requirement in some places and a trust requirement everywhere.
  • Recording consent. Two-party consent states have real rules. Get this right at the greeting.
  • Data handling. Where do transcripts live, who can read them, how long are they retained. Answer before a customer's lawyer asks.
  • Messaging compliance. A2P 10DLC registration for SMS, do-not-call handling for outbound.
  • Change control. Who is allowed to edit the prompt in production, and how does that change get tested? An unversioned prompt edited by three people is an outage waiting to happen.
  • What It Costs and How Long It Takes

    Realistic figures for a customer-facing agent in a mid-sized company:

  • Discovery and shadowing: 1 week
  • Architecture and first build: 2–3 weeks
  • Evaluation set and hardening: 2 weeks
  • Shadow mode and phased launch: 3–4 weeks
  • Total: roughly 8–10 weeks to a trusted production agent
  • Cost typically lands between $15,000 and $60,000 for a genuine custom build, plus $200–$800/month in usage, plus ongoing tuning at 10–20% of build cost annually.

    The cheaper path — and the right one for most companies — is deploying a proven architecture into your specific process rather than inventing one. The hard engineering has already been paid for by someone else; what's left is the part that's actually specific to you, which is the qualifying logic, the escalation rules, and the tone.

    The Agent Most Companies Should Build First

    If you're deciding where to start, the response layer is almost always the answer, because the baseline is so bad and the measurement is so clean.

    The typical starting point in a service business: leads wait four-plus hours for first contact, 38% get contacted exactly once, and booking rates sit near 9%. An agent that reaches every lead within 90 seconds, qualifies against real criteria, and books onto a calendar moves that to 18–25% on identical lead volume.

    90s
    response time an AI caller agent holds around the clock

    That's a measurable, defensible business case you can put in front of a CFO — which matters more than architectural elegance when you're asking for the budget.

    How We Do It

    We build and operate this specific agent for local service businesses: AI callers that handle inbound and instant callback, qualify against owner-defined criteria, and book qualified leads straight onto a calendar, with everything writing back to a GoHighLevel pipeline. Weekly transcript review and tuning is part of the engagement, not an upsell — because an agent nobody reads is an agent that degrades.

    $102M+
    tracked client revenue generated through agent-driven response systems

    If you're scoping an agent build and want a second opinion on architecture, guardrails, or whether the process is even a fit, [book a free strategy call](/book).

    Free Weekly Briefing

    One AI Marketing Tactic.
    Every Tuesday. Free.

    What's actually working across our client accounts right now — ROAS moves, follow-up sequences, creative angles. The stuff that isn't in any blog post yet.

    No spam. Unsubscribe anytime. 1,200+ business owners already in.

    Ready to Deploy

    SEE THIS IN
    YOUR BUSINESS.

    30 minutes. We scope the exact systems that apply to your situation and give you a plan.

    ★★★★★ Trusted by 47+ local service businesses

    BOOK A STRATEGY CALL →