Vellix AI / Insights / Human-in-the-loop AI

Governed AI

What a human-in-the-loop AI system actually looks like

Published August 11, 2026 · 5 min read

Written by the team building Vellix Business OS.

Almost every AI product now says a person stays in control. Far fewer can tell you which step stops, who is waiting for it, and what happens if that person says no.

The phrase, in plain terms

A human-in-the-loop system is one where the work stops at a defined point and waits for a person to decide before it continues.

The important word is waits. Plenty of tools let you look at what the AI did. That is review after the fact, and it is a different thing. If the email has already gone, the payment has already run or the record has already been filed, a person looking at it is reading history, not making a decision.

So the test is simple. Is there a step where nothing moves until somebody acts? If not, whatever else the system does, nobody is in the loop.

Not everything needs a person

The instinct when adopting this idea is to put approval on everything. That reliably fails, because a queue that asks for twenty decisions a day gets clicked through without being read, which is worse than not having it.

The more useful move is to sort the steps by consequence.

Kind of stepExampleNeeds a person?
Reading and sortingDeciding which queue a request belongs inNo
DraftingWriting a reply nobody has seen yetNo
GatheringPulling the order history for a caseNo
Anything that leaves the buildingSending the reply to the customerYes
Anything that moves moneyIssuing the refundYes
Anything that becomes a recordFiling the documentYes

Read down the right-hand column and a pattern appears. The steps that need a person are the ones that are hard to take back. That is a better rule than trying to judge how clever the AI was at each step.

Why approval has to be its own step

This is the part that gets skipped, and it matters more than the rest.

If the same step both does the work and decides the work was good enough, then the check is being performed by the thing being checked. It does not matter how the confidence score is calculated. Structurally, nothing independent has happened.

Keeping approval as a separate step, assigned to a person in a named role, is what makes it possible to say afterwards that something was reviewed and mean it. It also changes what the record contains. Instead of showing that a process completed, it shows who decided, and when.

An approve button is not supervision

Adding a confirmation dialog to an AI tool is the easiest version of this idea to build and the least useful. Supervision that holds up needs four things:

  • The work genuinely pauses. Nothing downstream runs while the decision is outstanding.
  • The reviewer can judge without redoing the work. They need the draft, the inputs it came from and the rule it was meant to follow, in one place. If checking properly means rebuilding the task by hand, people stop checking properly.
  • No is a real answer. Refusing has to send the work somewhere: back for another pass, or to a person who will finish it. If the only options are approve or abandon, the queue trains people to approve.
  • The decision is recorded. Who approved, what they saw and when. Otherwise there is no way to answer a question about it in three months.

A small example

A customer asks for a refund. The system reads the message, finds the order, checks it against your refund policy and drafts a reply with the amount filled in. All of that can run unattended, because nothing has happened outside the building yet.

Then it stops. Refunds above a threshold you set wait for a named person. They see the request, the order, the policy line it relies on and the draft. They approve it, or send it back, and either way the decision is attached to the case.

Below the threshold, you might let it run. That is a policy choice rather than a technical one, which is the point: the boundary belongs to you, not to the software.

Where Vellix fits

We are building Vellix Business OS, an AI business operating system designed around this shape of work. You write down how your company operates, and the system is meant to run the everyday jobs from that written model, pausing where you said a person must decide.

The written model is the Business Blueprint, and it is also what decides what each step is allowed to reach, which we cover under security and trust.

Where this stands today. The core platform is built and tested. The complete customer product is still in development and is not available yet.

DenialIQ, our denied-claim appeal product for billing teams, is a separate product offered through a pilot program. A person reviews and approves every appeal before anything is submitted.

If you are evaluating anything in this space, the question worth asking a vendor is not whether a human stays in control. Everyone says yes. Ask which step stops, who is waiting on it, and what happens when that person says no. The answers are usually specific, or they are absent.

Frequently asked questions

Does human-in-the-loop mean a person checks everything?
No, and a system that asks for approval on everything usually stops being used. The point is to decide in advance which steps carry real consequences and put the checkpoint there. Reading an email, sorting a request into the right queue or drafting text nobody has seen yet can run unattended, because the next step is where the consequence lands.
Why does the approval have to be a separate step?
Because if the same step both does the work and decides the work was acceptable, the check is being made by the thing being checked. Keeping approval as its own step, assigned to a person in a defined role, is what makes it possible to say honestly that something was reviewed. It also means the record shows who approved what, rather than only that the system finished.
Is an approve button enough to call a system supervised?
Not on its own. Useful supervision needs four things: the work has to stop and wait rather than continue while someone looks; the reviewer needs enough context to judge without rebuilding the work themselves; refusing has to be a real option that sends the work somewhere; and the decision has to be recorded. A button that confirms something already sent is a log, not a checkpoint.
Is Vellix Business OS available to buy?
Not yet. The core platform is built and tested, and the complete customer product is still in development. We are looking for a small number of design partners, each bringing one real workflow, while we build it. DenialIQ, our denied-claim appeal product for billing teams, is a separate product offered through a pilot program.

Have a workflow in mind?

We are taking on a small number of design partners while Business OS is in development. Bring one real job and we will tell you honestly whether this fits it.

Apply as a design partner