AI Integration That Pays Off: What Separates Profitable Projects From Expensive Experiments

AI Integration That Pays Off: What Separates Profitable Projects From Expensive Experiments

The rise of generative AI has been one of the most fascinating examples of rapid technology adoption in my lifetime. From a business perspective, just mentioning that you will start an AI project can make your stock price rise in the market, and adding “powered by AI” to almost any product makes it more likely to sell. So in stock value and marketing metrics, AI is a proven success, but in more traditional business metrics, it is more of a mixed bag. In the strictest terms, MIT published a review that says that 95% of AI projects have negative ROIs and no path to profitability, and Harvard Business Review revealed that runaway use of AI is actually making companies less productive.

In moments like this, it is easy to get caught up in the buzzwords and rush into new technologies before evaluating whether they actually align with business goals.

How can we avoid this? Where can we allocate funds set aside for "AI automation" without making an unprofitable investment? Or worse, end up with a solution that costs more to maintain than what the original problem costs the operation.

In my experience, the most common reasons AI projects are unsuccessful are lack of managed expectations and overpromising success. Depending on how the project and its goals are set, even perfect technical execution combined with tight project management won’t save an uncertainly developed AI project. A solution that achieves 90% accuracy when stakeholders expect 100%, no matter how impressive, is still a failure.

All projects, especially projects with AI components, should be led by a feasibility study that carefully studies the capabilities of the technology but also the unintended consequences and the actual cultural/business fit. This means not treating “this could be done” as sufficient justification to start a project. A feasibility study should consider, at a minimum:

Feasibility Condition

What Good Looks Like

Red Flag

Data quantity and quality

Clean, labeled, sufficient historical data

"We'll collect it as we go"

Clearly defined problem

Single measurable outcome

Vague efficiency goals

Measurable business outcome

Tied to revenue increase or cost reduction

No baseline metric exists


Without answering those questions, your project risks becoming an expensive experiment at best.

This reality doesn’t mean that we have to get bogged down and drag our feet before we can get benefits from these new technological breakthroughs. If you have a budget allocated for an AI project and want to breeze past the feasibility study part, it helps to look at successful case studies that have been replicated again and again across industries. These AI approaches focus on fixing or assisting users with daily common tasks that need a burst of efficiency, with the important factor of using AI alongside human operators.

AI-Powered Customer Service Automation

How to Reduce Costs Without Losing the Human Touch

Most of us have experienced some form of customer service automation deployed by some company whose services we use. In the last couple of years, more companies have deployed AI features into their automated systems. When done correctly, it is a noticeable upgrade to the older, unbearable IVR systems.

The best deployments are the ones that feel natural, respect your time, and, most importantly, seek to augment rather than replace the trained and empathetic human customer service.

When AI works alongside human operators rather than replace them, you get improvements in both efficiency and customer satisfaction. AI handles the routine stuff on its own while leaving the complex issues to the human agents. By the time a human picks up the case, AI can give them gathered context, verified customer information, and confirmation if they have tried basic troubleshooting. The human agent can focus their time and expertise on problem-solving, rather than doing mechanical tasks.

The path to ROI is clear: by making the human operator decrease their average handle time, a key performance indicator in customer service. This means each human operator can handle more cases, which decreases costs as well as wait times for customers and indirectly increases satisfaction.

Intelligent Document Processing

Where AI Delivers Its Clearest ROI

Most organizations run on documents. Invoices, purchase orders, employee records, contracts, compliance, etc. This means that an army of document-processing humans has to be assigned to run an organization correctly. Realistically, from the point of view of cold ink on paper, most organizations do not devote the time and manpower to do this correctly. Not to mention the high cost of human errors.

Manually extracting information, classifying papers, and remembering where something specific is stored require a huge amount of man-hours, and the risk of errors is always present. Considering this, it should come as no surprise that one of the categories of AI projects that have a good track record when it comes to ROI is intelligent document processing.

Some of the best-proven use cases for AI technologies are the ability to read, understand, classify, and, most importantly, remember where something was stored.

As a firm believer in "human-in-the-loop," I think we shouldn’t give the keys to the car to the robot and forget about it. The idea is to eliminate the tedious and error-prone parts of the process but keep humans supervising and ultimately responsible.

No one gets into a job because they are passionate about manually transferring information from a bad xerox into an accounting system. Automated document processing frees up workers' time and reduces their workload so they can focus on value-added decisions. With a proven workflow that combines humans and AI, you can truly excel. By having humans identify anomalies, use the information to advise key stakeholders, and make judgment calls.

The downstream effects in terms of ROI compound. First of all, you need fewer people to process documents, but that’s the smallest of possible savings. It’s in the cost of errors where the real savings are materialized; in any company, a misread clause in a contract can mean a lot more work that wasn’t properly budgeted for. And in legal, insurance, or medical organizations, one single error can cause hugely expensive lawsuits that have costs that completely surpass the cost of an intelligent document processing system.

When AI Goes Wrong: The Air Canada Case

However, it’s not all smooth sailing, as mentioned before; the project’s goals and scope have to be protected with good project management, and technical execution has to be top-notch. Even in these often replicated projects, there are case studies of failures that have important lessons to teach.

A high-profile example that comes to mind is Air Canada’s AI chatbot. The airline implemented a fully automated chatbot able to respond to clients' requests. The initiative and the vision were good, but implementation was poor, and the chatbot lacked proper guardrails.

The chatbot became notorious for offering customers invalid information and inventing non-existing offers. In one of the documented cases, the chatbot promised a customer free flights in the form of a refund that the customer wasn’t entitled to. The customer sued Air Canada in court and successfully argued that the chatbot was acting as a representative of the airline. The court ruled that the $1,630.36 refund plus interest had to be paid, regardless of the airline’s official policy.

These issues have an impact in three different ways:

  1. The cost of honoring the promotion
  2. The reputational damage
  3. Letting the chatbot hallucinate also creates operational costs.

The third impact is often overlooked as operational costs are seen as separate from the implementation costs. But every interaction with a large language model consumes tokens, and those tokens have a real cost. An unoptimized chatbot can rack up substantial API bills by engaging in lengthy conversations or handling queries it shouldn’t be addressing in the first place. And also, it requires extra cost in the additional time that has to be spent by operators and/or managers to fix the mistakes. When these costs are not offset by driving any business value, an improperly implemented chatbot becomes a money pit.

How to Avoid Becoming a Cautionary Tale

There are many common aspects I see in all of the many cautionary tales that seem to be on the news more and more frequently. Aspects any founder should definitely stay away from:

  • Rushing into a project
  • Following the latest trend or buzzword
  • Launching a product before doing extensive QA or not considering the probabilistic nature of the technology in the QA process

To prevent these risky development aspects, you can start your roadmap by having a well-thought-out definition of success.

This includes how you are going to measure it and which metrics will tell you if things are moving in the right direction. Of course, the opposite is also true: have a defined kill condition and the courage to pull the plug. Not launching a product and absorbing the costs might be significantly less expensive and easier to recover from than a botched implementation that ends up on the news.

The Designli Approach to AI Integration

The gap between a promising AI concept and a profitable implementation is a planning problem. Most AI projects fail before a single line of code is written because the business case was never pressure-tested against reality.

Before any AI project gets scoped or budgeted, the most valuable step is an honest feasibility read, one that stress-tests the idea against real data, defined outcomes, and organizational readiness before a single line of code is written. Structured engagements like Impact Week exist precisely for this, to create a diagnosis of why a proposed use case isn't working and what it would actually take to make it viable.

Nowadays the technology is rarely the hard part. Knowing what to build, and whether to build it at all, is where most AI projects are won or lost.

FAQs

Why do most business AI projects fail to make money?

Most AI projects lose money because companies get caught up in the hype, building expensive tools just to say they use AI rather than fixing a specific business problem.

What does "human-in-the-loop" mean?

"Human-in-the-loop" means using AI to do the heavy lifting of sorting data or typing files, but keeping a real person in charge of checking and approving the final work.

How do you test if an AI project is actually worth building?

Before spending money on code, you need a feasibility check to prove your company has enough clean, organized data for the AI to learn from. 

Strategic AI Integration Starts Before the First Line of Code

The temptation in the coming years will be to automate simply because it is possible. The most effective organizations will resist that impulse and strategically deploy AI solutions where it makes business sense and the correct precautions are taken.

Ultimately the companies that benefit most from AI will evaluate every use case and carefully plan their implementation just as they would with any other tool or purchase. Using it to augment their top talent, recognizing that while AI accelerates output, human oversight provides judgment, context, and accountability. AI will not magically create revenue or reduce costs on its own. Human judgment will still run your business, as will boring metrics such as costs, revenues, and profits. Schedule a consultation.

Related Topics:

Want to learn more?

Subscribe to our newsletter.

Recommendations: