Resources
RAND puts the failure rate above 80 percent. MIT puts generative AI pilots at 95 percent with no measurable return. Almost none of it is the technology's fault, and the decisions that settle it get made before anyone writes a line of code.
Most fail for reasons that have nothing to do with the model. Studies from RAND in 2024 and from MIT and Gartner in 2025 keep landing on the same causes: nobody agreed what success meant, the data was never ready, and the automation got built alongside the real workflow instead of inside it. The failure rate is high enough that it should change how you scope the first project. It is not a reason to skip one. Pick a process you can already measure, wire it into the software your team uses every day, and make sure somebody is accountable for keeping it running after launch.
Somewhere between 80 and 95 percent, depending on what you count as failure.
The RAND Corporation put the figure above 80 percent in its 2024 report, The Root Causes of Failure for Artificial Intelligence Projects and How They Can Succeed, roughly twice the failure rate of IT projects with no AI in them. That number came out of interviews with 65 working data scientists and engineers, not a vendor survey, which is part of why it gets cited so widely.
MIT's Project NANDA put it higher for generative AI specifically. Its 2025 report, The GenAI Divide: State of AI in Business, found that 95 percent of enterprise generative AI pilots produced no measurable impact on profit and loss, with the remaining 5 percent capturing real value. That was against an estimated 30 to 40 billion dollars of enterprise spending.
Read those numbers carefully before you let them scare you off. In both studies, "failure" mostly means the project never produced a return anyone could point to. It rarely means the software did not run. A pilot that works fine in a demo and then sits unused is counted as a failure here, and that is the honest way to count it, because a system nobody uses costs you the build and returns nothing.
So the odds turn on decisions made before anything gets built: what you picked, how you measured it, and who owns it in month six.
Pilots stall before production most often because the data the system needs was never in a usable state, and nobody found that out until the build was underway.
Gartner said as much in a press release on 26 February 2025, Lack of AI-Ready Data Puts AI Projects at Risk, predicting that through 2026 organizations would abandon 60 percent of AI projects that were not supported by AI-ready data. In the same release, a third-quarter 2024 Gartner survey of 248 data management leaders found 63 percent either did not have the right data management practices for AI or were not sure whether they did.
In a small or mid-sized operation this rarely looks like a data problem. It looks like the customer list living in three places, job notes typed into a field that was meant for something else, and one person who knows which spreadsheet is the real one. None of that stops a demo. All of it stops a production system, because the system has to handle the messy record as well as the clean one.
The second reason is scope. A pilot gets chosen because it demos well rather than because it costs real hours, so even a complete success frees up nothing anyone notices. The third is ownership: the project has a champion during the build and nobody after go-live, so the first time an upstream form changes and the automation breaks, it quietly gets switched off.
None of these are technical problems. The fix is in scoping and in who stays accountable once the thing is live.
The problem is the way the project was run, not the technology, in almost every case study that has been published on this.
RAND's 2024 report grouped its root causes around people and process rather than around models: misunderstanding the problem being solved, insufficient or unsuitable data, chasing the technology instead of the business outcome, and inadequate infrastructure for managing data and deploying finished models. Only one of those is something an engineer can fix after the fact.
There is a version of this that shows up constantly in businesses under a hundred people. Somebody buys a tool. The tool is genuinely good. Six weeks later it is producing output that a person still has to check, correct, and paste somewhere else, so the work did not leave the building, it just changed shape. Nobody logs that as a failed AI project, but it is one. MIT's researchers put the core barrier in much the same place when they concluded the problem was not infrastructure or talent but learning: systems that never absorb feedback or fit the workflow around them.
The practical test is whether a task disappeared from someone's day. Not "got faster". Disappeared. If your dispatcher still opens the same tab and reads the same output before anything happens downstream, the system is assisting, and assistance is a much smaller prize than it sounds like when you are quoted for it.
That distinction also tells you where to start. Pick the process where the handoff is mechanical, the rules are already written down somewhere, and the volume is high enough that removing it shows up on a timesheet. Those projects survive. The exploratory ones, where the goal is to see what AI could do here, are the ones that end up in the 80 percent.
Agent washing is a vendor rebranding an existing chatbot, assistant, or scripted automation as an "AI agent" without the underlying product doing anything agentic.
Gartner named it in a press release on 25 June 2025, Gartner Predicts Over 40% of Agentic AI Projects Will Be Canceled by End of 2027. The same release estimated that only about 130 of the thousands of vendors selling agentic AI were offering the real thing, and forecast that more than 40 percent of agentic AI projects would be cancelled by the end of 2027, undone by rising costs, unclear business value, and weak risk controls.
Sit with that ratio for a second. If roughly 130 out of thousands are genuine, then most of what gets pitched to you is a chatbot with a new label, and the failure statistics start to make a lot more sense.
Two questions separate them in a sales call. First: what does it do with no human in the loop? A real agent completes the task and produces the finished result. A relabelled assistant produces a draft for someone to check. Second: what does it touch? An agent that cannot read from and write to the systems you already run, your CRM, your job management software, your accounting package, is a text generator, and text is not the work. If you want the longer version of that distinction, we wrote it up in AI agents vs. chatbots.
Ask for the failure case too. Any system that runs unattended will hit a record it cannot handle. Whoever built it should be able to tell you exactly what happens next, who gets told, and how it gets fixed. A vendor who has not thought about that has not run one in production.
A project that does not fail looks narrow and unglamorous, and somebody counted the hours before it started.
The system we built for the 3D-scanning lab at Universidad Maimonides is a fair example. The lab had a specific, repetitive, countable job: fifty to a hundred data files at a time, each needing fields extracted, records built, related sources linked, and lookup codes generated. A person was doing that by hand. The system ingests the batch, does the work, and produces the records, and it returned about fifteen hours a week to the team. It shipped in two weeks and it has been running ever since, on our infrastructure.
Nothing about that is impressive as technology. What made it work is that the task was already defined, the output was already checkable, and the hours it consumed were already known, so nobody had to argue afterwards about whether it had paid off. Taking that reading before the build, and again a few months after, is the whole of how you measure whether an automation actually saved money. You can read the whole thing in the Universidad Maimonides case study.
Here is the same idea as a checklist you can run against any project somebody is proposing to you.
| Failure signal | What it looks like in practice | What to do instead |
|---|---|---|
| No baseline number | "This will save a lot of time" | Count the hours the task takes now, this week, before anyone builds |
| Data was never checked | The demo used three clean sample records | Have someone pull fifty real records, including the ugly ones, first |
| Built beside the workflow | Output lands in a doc for a person to copy across | Require the system to write into the software the team already uses |
| Chosen because it demos well | The showcase project nobody was struggling with | Pick the task people complain about, even if it is unglamorous |
| No owner after launch | The champion moves on and the system drifts | Name who fixes it when an upstream form changes, before you start |
You keep a system alive after launch by giving it an owner and a monthly report, and by treating both as part of the build rather than as an extra.
Systems break for ordinary reasons: a supplier changes an invoice layout, somebody adds a required field to a form, an API version gets retired. None of that is exotic, and all of it will happen inside the first year. The question is whether anyone notices in an hour or in a quarter.
Most automation buyers underestimate this part, and it is why Gartner's June 2025 cancellation forecast is about running costs and risk controls rather than about capability. Building the thing takes a few weeks. Keeping it correct is ongoing work, and ongoing work needs somebody whose job it is.
Our own answer is that the systems we build live on our infrastructure and we run them from there. You get a monthly report showing what the system processed and what it produced, so you are never taking our word for whether it is still earning its place. If the numbers stop making sense, you can see it in the report before it costs you anything.
The general principle holds whoever builds yours. Ask who is accountable for uptime, ask what you receive every month that proves the system is still doing its job, and ask what happens on the day it hits a record it does not recognise. A build with no answer to those three is a project that ends in the failure statistics, whatever it cost.
It depends on how many systems the process touches, how clean the data is, and how much of the work has to happen without a human checking it. A single process with clear rules and one or two integrations is a much smaller build than a workflow spanning four systems with exceptions in every branch. The honest way to find out is to have someone count the hours the task consumes now and price the build against that, which is what an audit does before anyone commits to anything.
Check three things before the build starts. Do you have a baseline number for how long the task takes today, does someone own the system after launch, and does the output land inside the software your team already uses rather than in a document someone has to copy from? A project missing any of those is the pattern RAND and MIT describe. The technology is rarely the deciding factor.
Build one real process end to end rather than piloting several. MIT's 2025 research put the core barrier at learning and integration, meaning tools that never adapt to feedback or fit the existing workflow, so a small system that genuinely takes a task off someone's desk teaches you more than three experiments that produce drafts for review. Pick the narrowest process that costs you real hours and finish it.
Messy is usually fine; undefined is the problem. If the work follows rules a person could write down, even complicated ones with plenty of exceptions, it can be built. If two people do the same job differently and neither can say why, that gets settled before anything is automated, because the system will need one answer. Volume matters more than tidiness: a repetitive task done fifty times a week is a better candidate than a complex one done twice a month.
A chatbot answers and an agent acts. Gartner's June 2025 estimate that only about 130 of the thousands of vendors selling agentic AI were offering the real thing is worth remembering here, because most projects that fail on this point failed at purchase rather than at build. If the product produces a draft for a person to check, it is an assistant, and the hours stay in the building.
We map where your time and money leak, put a number on each one, and tell you which one is worth building. Then we build it and run it for you from there.