The era of the unlimited, always-on, general-purpose AI agent is ending. Subscriptions weren’t priced for behavior that never sleeps, and a monthly plan burning thousands of dollars in computation was never going to survive the unit economics.
|
ADVERTISEMENT |
If you’ve tried to get an AI pilot past Phase One, none of this is surprising. The conversations have been about deploying AI where it can reliably support complex technical documentation and high-stakes workflows with accuracy that holds up.
That distinction is where value shows up. Much of the last wave of AI investment focused on low-stakes use cases. Those projects make for clean board updates, but they don’t change the cost structure of a service organization or move a P&L.
The work that pays back is in the harder, higher-consequence places—the fault that was diagnosed correctly the first time. The truck roll that didn’t have to happen. The senior technician who didn’t have to be pulled off another job.
The best industrial AI is narrow, workflow-specific, and able to act. It triages tickets, reasons across fragmented documentation, brings up the right fix for a specific fault, and executes the next step throughout the systems an organization already runs.
Industrial AI doesn’t get graded on a curve
Most general-purpose AI tools cap out at 40–60% accuracy on complex, visual technical content such as schematics, wiring diagrams, exploded views, or dense annotated OEM manuals. That accuracy threshold isn’t OK when it’s dispatching the right part to a field site or walking a technician through a repair on a six-figure asset.
On the shop floor, the wrong answer leads to downtime, wasted parts, or costly service calls. The accuracy bar needed in manufacturing isn’t set by a vendor or a benchmark. It’s set by physics and by regulators.
Generic agents are built to generalize across domains. Industrial work is the opposite. Every machine has its own manual, fault codes, torque specs, and constraints. A pressure alarm tied to a specific configuration can easily consume hours of service time and burn margin, not because the reasoning is bad but because the context isn’t there. In practice, that means an always-on agent turned loose in a plant is mostly burning computation to produce answers that sound confident and land somewhere between incomplete and completely wrong.
The accuracy ceiling is an architectural problem
The accuracy ceiling results from the way most general AI is built. Most AI systems convert a document to text first and then reason over the text. The moment you do that on a wiring diagram, you lose the spatial relationships that make the diagram mean anything. A label without the lines is just a word.
There’s a useful distinction worth drawing here. Most of what AI is asked to handle in service environments are what I’d call secondary sources: historical tickets, past case notes, repair logs, and the institutional memory of what’s happened before. That content is text-based and unstructured, and most AI tools can search and summarize it reasonably well. The harder content class comprises primary sources: the OEM service manuals, schematics, wiring diagrams, and exploded views that actually tell you how a piece of equipment works and how to fix it. That’s where the 40–60% accuracy ceiling sits, and that’s where most AI initiatives break down. The problem isn’t the volume of information. It’s the type.
Hallucinations in general-purpose models aren’t just bugs. These systems are optimized to produce confident answers, even when certainty is low.
In a consumer context, that trade-off might be acceptable. In manufacturing or field service, where a technician is deciding on a safety-critical component or reading a schematic under time pressure, it isn’t.
Hallucinations introduce real operational risk. One confident but wrong answer is often enough to lose trust in the system.
Where AI is delivering value in manufacturing
The systems delivering value in manufacturing aren’t general-purpose agents. They’re narrower and bound by scope. They work because someone did the hard work of connecting them to the sources that hold the answers, including the manuals, schematics, diagrams, past escalations, warranty claims, or the customer’s own service history found in the CRM, CMMS, and ERP systems. In practice, that means when a tier-one technician hits a fault code on a specific asset, the response isn’t a generic paragraph that might apply to three different machines. It’s a step-by-step resolution tied to the actual schematic for that unit, the actual torque spec from the correct manual, and the actual note from the last time the same fault was resolved on a similar configuration.
There’s one more move which separates the systems that work in manufacturing from the rest: The outcome of every fix, including what worked, what didn’t, and what part was needed, is logged back into the customer’s own systems of record. The AI in turn gets smarter, and the customer maintains their institutional knowledge.
Test on your hardest content, not your easiest
Evaluating AI in manufacturing means looking past the demos that impress because they’re running on clean, cherry-picked data. The test that matters is whether the AI can handle a 300-page OEM PDF with dense wiring diagrams, or the legacy document with corrections handwritten in the margins.
That test is where cost, control, accuracy, and trust get decided in practice. A narrow agent scoped to a specific workflow; connected to the manuals, schematics, and service history that hold the answers; and that’s able to act across the CRM, ERP, and CMMS, can clear it.
The industrywide signal is the right one. The always-on, general-purpose agent model is running into its limits. On the shop floor, where the answers must hold up against physics, regulators, and the 30-year veteran who will stop using the tool the first time it’s wrong—those limits were always going to show up first.
The rest of the market is just now pricing in what manufacturers already knew. Accuracy isn’t negotiable. Scope is a feature. And trust, once lost, is nearly impossible to earn back.

Add new comment