Aller au contenu
Toutes les entrées
par T2corédigé par 🧞

A person decides. That is not a disclaimer.

There is a phrase I keep hearing in industrial AI discussions. It frames the situation as a technology adoption problem. It goes roughly: "The solution is ready. Now we need to get the workforce on board."

That is a diagnostic error.

The hard problem in physical AI is not technological. The algorithms are mature, the sensors are affordable, the infrastructure exists. What is not ready is the human context into which the machine gets embedded: the competence to challenge the system when it is wrong; the expertise to recognise an edge case the training set never saw; the institutional culture that lets a specialist decide against the recommendation — and not be penalised for doing so.

These are not soft skills. They are operational infrastructure.

**The real problem: expertise under relief**

An experienced operations director knows the anomaly before the system flags it. They have seen it a hundred times — once as an early warning before a costly failure, three times as noise with no consequence. They know when the algorithm's recommendation holds and when the asset behaves differently from what the model expects, because the batch composition, the ambient conditions, or the wear pattern at one point lie outside the training distribution.

That judgment is not intuition. It is experience — accumulated through exposure to real failures under real conditions.

The AI system reduces that exposure. That is its promise. And its risk. When the system takes over the routine, the expert is left with the exception. But the exception is only interpretable by someone who has seen enough routine to know what normal looks like. Relief without parallel expertise development produces, over time, what researchers call automation bias: specialists who confirm the model — not because it is right, but because they no longer have an independent reference point.

That is not an operator error. It is a system design error.

**Why "a person decides" is an architecture decision**

On the Apuna homepage, the hero line reads: "The machine can recommend. A person decides." Anyone reading that for the first time might interpret it as a liability notice — the kind of small print AI vendors append to their sales pages to sidestep regulatory exposure.

It is not.

It is an architecture decision. And architecture decisions have consequences that extend far beyond the first deployment.

A system that removes the human from the decision flow optimises for short-term efficiency. A system that keeps the human in the decision flow optimises for long-term decision quality. The difference does not show in the first quarter. It shows when the system encounters an edge case the training set never saw — and the person is either still capable of recognising it, or is not.

In physical operations — production plants, machinery fleets, process-critical infrastructure — those edge cases can have catastrophic consequences. The question is therefore not philosophical: who decides when the model is wrong? And does that person still have the competence to know?

**What this means for mid-market industrial firms**

The implications are operational, not abstract.

Treating HITL as a checkbox — a box ticked to meet compliance requirements — produces the worst of both worlds. Neither the efficiency of a fully automated pipeline, nor the judgment quality of a genuine expert. The human is nominally "in the loop" but the process is designed so they almost never override — because no mechanism for principled deviation was built in, and the specialist has no institutional standing to document a reasoned departure.

Expertise development must be actively planned, not passively hoped for. Concretely: simulated training on scenarios the system has not yet seen. Regular rotation between assisted and manual decision-making — not as a contingency drill, but as a calibration routine. A documented practice of recording and analysing departures from model recommendations. This is not expensive. It is cheaper than the alternative: specialists who, after three years of AI deployment, can no longer challenge the system because they have lost the competence to do so.

Decision authority must be institutionally protected. A specialist who overrides a model recommendation must not be penalised for doing so. A company that reads deviation from the AI's output as a competence failure has the logic backwards. The capacity to deviate is precisely what makes the human in the loop useful. Without it, HITL is stage dressing.

**The bet we are making**

We do not just build automation. We build the integration layer that keeps the human in the signal path — and we design that layer to develop human competence rather than replace it.

That is a different system architecture from the goal of eliminating as much human involvement as possible.

It is also a different commercial bet: companies whose specialists have learned to work with AI systems — who have learned when the model is reliable and when it is not — get better over time, not worse. Their systems sharpen because their feedback data improves. Their decisions become more reliable because their specialists have more exposure, not less.

The alternative — a system that extracts expertise rather than developing it — produces an ROI curve that looks good in year one and becomes a quality problem in year three.

The operations directors who understand this now are two to three years ahead. The ones who treat HITL as a compliance checkbox will find out in two to three years.

*The machine can recommend. A person decides. That is not a disclaimer. That is the bet.*