Why most pilots stall

Pilots tend to be chosen for how well they demonstrate, not for how much they are worth. A tool that summarises documents or drafts replies looks impressive in a meeting because the output is visible and immediate. Whether it removes meaningful cost is a separate question, and it is rarely the one being asked in the room.

The second failure mode is subtler. An automation works, saves twenty minutes a day for one person, and changes nothing — because the twenty minutes were not the constraint. Time saved at a step that was never the bottleneck does not show up anywhere in the business.

The third is ownership. A pilot built by one enthusiastic person, with no plan for who maintains it, degrades the moment that person changes role. This is the same failure pattern as an unmaintained integration, and it is just as common.

What makes a process worth automating

The candidates that actually pay back tend to share a specific shape, and it is recognisable before you build anything.

  • High volume and repetitive. The return scales with frequency. A task done four hundred times a month is worth automating badly; a task done twice is not worth automating well.
  • Rule-based enough to be checkable. If you cannot describe when the output is wrong, you cannot tell whether the automation is working — which means you will not trust it, which means someone will keep checking it manually.
  • Sitting on an actual bottleneck. Automating a step that queues in front of everything else changes throughput. Automating a step that was never waiting changes nothing.
  • Structured, accessible inputs. If the data lives in inboxes and PDFs with no consistent format, most of your project is data plumbing, not AI.
  • A named owner after launch. Somebody has to be responsible when it produces a wrong answer in month seven.

Automation, AI, and agents are not the same thing

The vocabulary has become loose enough to hide real differences in cost and risk, and the distinction matters when you are deciding what to build.

  • Rule-based automation follows a defined path. It is predictable, cheap to run, easy to audit, and handles the large majority of what businesses actually need. Most problems described as "we need AI" are this.
  • AI-assisted steps use a model where a rule does not fit — classifying free text, extracting fields from an unstructured document, drafting language. Powerful, and probabilistic, which means the process around it needs to tolerate being wrong sometimes.
  • Agentic systems pursue a goal across multiple steps and decide their own path. The most capable and the hardest to constrain, audit, and cost. Genuinely useful in some places, and frequently proposed for problems a rule would have solved.
  • Choosing the least sophisticated option that solves the problem is almost always the right call. Sophistication is a maintenance liability, not a feature.

Measuring a return honestly

The measurement has to be agreed before you build, because afterwards everyone will find a number that makes the project look good.

  • Baseline the current state first — how long the process takes now, how often it errors, what the errors cost. Without this you have nothing to compare against.
  • Count hours removed only where those hours went somewhere else that matters. "Saved time" that quietly refills with other work is not a return.
  • Count avoided errors where errors have a real cost — a rejected tax submission, a mispriced order, a missed renewal.
  • Count throughput where the constraint was capacity: same team, more orders processed.
  • Subtract the running cost honestly. Model or platform fees, plus maintenance, plus the time spent checking the output while trust is being established.

A sensible sequence

The businesses that get value out of automation tend to arrive at it in a particular order, and it rarely starts with the technology.

Start with where work actually piles up. Not where it is most annoying — where it queues. Those are different, and the annoying one gets suggested far more often.

Fix the process before automating it. Automating a broken process produces broken output faster, and makes the underlying problem harder to see.

Then check whether the data those steps rely on is structured and reachable. If it is not, that is your first project, and it is worth doing regardless of whether any AI follows.

Only then choose a mechanism — and choose the simplest one that works.