AI & Automation 3 min read April 21, 2026

What's actually in an AI agent stack (and what you're paying for)

The demo shows the brain. The invoice is mostly the other three layers — and they're the ones that decide whether the thing survives contact with production.

The question

We got a proposal for an AI agent and the price is a multiple of the model's API costs. What's actually in the stack, and which parts are worth paying for?

What we told them

Fair question, because the demo only ever shows one part. A production agent has four, and the one in the demo is usually the cheapest.

  • The model — the brain. The AI doing the reasoning. Billed per use, swappable, and increasingly a commodity. This is the line everyone fixates on, and the one that matters least to your invoice.
  • Tools — the hands. The connections that let the agent touch the real world: your CRM, calendar, databases, search, code execution. Every tool is an integration somebody has to build, permission, and maintain. This is where most of the honest engineering hours go.
  • Memory — the notebook. Three kinds: what the agent is working on right now, what it knows long-term (your documents, your policies), and the state of the task it has committed so far. Skimp here and you get the classic complaint — an assistant with amnesia that asks the same question every session.
  • Observability and safety — the wrapper. A log of every step, checks before actions fire, cost tracking, and a way to measure whether it's actually getting things right. Invisible in the demo, and the first thing you'll wish existed the day something goes sideways.

The pattern to watch for: a thin proposal is a prompt and a model with a logo on it. A serious one itemizes the other three layers — and can show them running. Our favorite test fits in one meeting: ask to see the logs and the cost dashboard for an agent they already operate. A builder who has them opens a screen. A builder who doesn't opens a slide.

The takeaway

The model is the cheapest part of an AI agent. If a proposal can't itemize tools, memory, and monitoring — and show them running — you're buying a prompt at a markup.

Got a question like this one?

Send it over — 20 minutes, no pitch, a straight answer either way.