Talk to an engineer

· 2 min read · BluMargins

A model is not a product

Most AI projects do not fail at the model. They fail at the retrieval layer that never had the right context, the evaluation nobody wrote, and the guardrail nobody set.

  • artificial intelligence
  • architecture

A demo takes an afternoon. A system that a business can rely on takes the four things nobody demos: the retrieval layer that gives the model the right context, the evaluation harness that proves it is right, the guardrails that stop it when it is not, and the trace that lets you explain, six months later, why it did what it did.

The context problem is a data problem

When a model gets an answer wrong in an enterprise setting, the cause is usually not the model. It is that the passage it needed was never retrieved: the corpus was chunked by character count instead of by document structure, the search was vector-only where the query was really a keyword lookup, or the permissions were applied after retrieval rather than during it, so half the estate was excluded to be safe.

Fix retrieval and most of what looks like hallucination disappears. Bind every answer to a citable source, and configure the system to decline rather than improvise when the evidence is thin.

If you cannot evaluate it, you cannot ship it twice

The first version of an AI feature is shipped on enthusiasm. The second is shipped on evidence, or it is not shipped at all. Golden sets, rubrics, and outcome scoring turn a prompt change from a gamble into a pull request that either passes a gate or does not. Without them, every improvement is also a regression that nobody has measured yet.

Guardrails are architecture, not policy

An agent that can take an irreversible action needs an approval gate in the code path, not a line in a policy document. Personal data has to be redacted before it reaches a model or a log, not scrubbed afterwards. Budgets have to be enforced per run, with a ceiling that cannot be exceeded. These are design decisions, and they are much cheaper to make at the beginning.

What we build

We build the whole system: the data platform that feeds it, the retrieval that grounds it, the evaluation that gates it, the guardrails that bound it, and the interface that puts the answer in front of the person who has to act on it. That is what the first principle of our approach means in practice, and it is why our AI work is inseparable from our data and software work.

More from the blog

All posts

Bring us the whole problem.

Tell us where the work is stuck, whether that is a model that never reached production, an application nobody can change, a data platform nobody trusts, or a plant the business cannot see. An engineer replies with a first read, not a sales deck.