How to Stifle Open Source Without Banning It
Benedikt Langer
6 Min. Read The sharpest argument against China’s top open AI comes from a man at OpenAI. Dean Ball, ...
6 Min. read time
41 percent of German companies now use AI – more than double the number from a year ago. Yet the same costly phrase keeps coming up in CIO meetings: The pilot worked, but the project never made it to full-scale operation. The bottleneck is rarely the technology. It lies in integration, change management, and expectations that were never tested during the pilot.
Key Takeaways
Related:Bitkom Study: AI Projects Spiral Out of Control/AI in the Boardroom: Who Decides, Who Bears Responsibility?
What is AI in full-scale operation? Full-scale operation means an AI application runs continuously, for all intended users, and with real live data – rather than just in a limited pilot. Only then does the system prove whether it can handle load, data quality, and ongoing costs. This transition is the most common sticking point for AI initiatives in 2026.
A pilot is designed to succeed. A handful of motivated users, a meticulously curated dataset, a manageable use case. These conditions vanish in full-scale operation. The number of users grows, data becomes messy, and the load becomes unpredictable. What worked in the pilot turns into a perpetual construction site if no one planned for the difference beforehand.
In practice, the hurdles are organizational: integrating into existing systems, bringing the workforce on board, and managing expectations that were never tested during the pilot. For the CIO, this means the tough part only begins after a successful pilot.
Post-project reviews consistently reveal the same four patterns. None are technology issues – and that’s precisely what makes them so persistent.
First: The pilot proves the wrong thing. It demonstrates that the model can solve a task. Whether the organization handles that task a thousand times a day is another matter entirely. The demo confirms feasibility; scalability remains unanswered. Confuse the two, and you roll out a proof of concept that was never stress-tested for real-world load.
Second: Integration is underestimated. During the pilot, the AI runs alongside existing systems. In full operation, it must integrate into ERP, CRM, and access management. This step often consumes more effort than the model itself – and is never factored into the pilot budget.
Third: No one owns operations. The pilot has a project team; full deployment requires a permanent line role. Without it, the application falls into a responsibility gap the moment the project ends. No one patches it, no one budgets for it, and no one gets called when it fails.
Fourth: Costs spiral out of control. Roughly one-third of companies using AI report that it’s more expensive than anticipated. The reason lies in the transition: token consumption, hosting, and integration costs only surface in full during ongoing operations. The pilot’s calculations were correct – they just covered the small test volume.
Source: Analysis of the Bitkom AI Study 2026
The core issue can be summed up in one table. Almost every failed scaling effort traces back to confusing these two columns.
| Dimension | Pilot | Full Operation |
|---|---|---|
| Users | a handful of volunteers | all intended users |
| Data | curated test dataset | real, messy live data |
| Costs | project budget, one-time | ongoing cost per request |
| Responsibility | the project team | a permanent line role |
| Success Metric | Does the demo work? | Does it deliver in daily use? |
Planning for the right-hand column from the pilot phase doesn’t make for a flashier pilot. It makes for one that survives the transition. That’s slower and less comfortable – but it’s the difference between a showcase project and a functioning system.
Companies where AI reaches routine operations rarely owe their success to a superior model. The deciding factor lies in four key decisions made before the pilot even begins.
Make routine operations the entry ticket. A pilot is only approved if it’s clear from the outset what productive operations will look like: who’s responsible, what it will cost, and which KPI justifies it. This way, the tough questions are addressed upfront – not at the end.
Assign an operational role before launch. Before the first line of code runs, it’s already determined which department will host the application and who will maintain it. The project team builds it; the operational team takes over. Without this handover, there’s no routine operation – just a project winding down.
Calculate costs based on real-world volume. The benchmark is the expected steady-state volume, including peaks, scaled to actual usage levels. An honest upfront calculation prevents the surprise that catches out around a third of organizations.
Treat change management as part of the project. AI transforms processes and roles. If affected employees are only involved at rollout, resistance is inevitable. Acceptance is either planned into the project from the start – or it doesn’t happen at all.
None of these points are new, and none are costly. The real leverage lies in timing: these decisions belong *before* the pilot. Those who address them later have already made the leap harder – before even attempting it.
Because the pilot runs under ideal conditions: few users, clean data, a clearly defined use case. In day-to-day operations, user numbers, data chaos, and workloads increase. Success then depends on integration, change management, and expectation management – not just the model’s performance.
It means defining – before the project starts – which department will ultimately own the application and who will be responsible for it. The project team builds the solution, while the line team ensures its long-term operation. Without this handover, the AI falls into a responsibility gap as soon as the project ends.
Because costs scale with volume. Token consumption, hosting, and integration add up per request and accumulate in continuous operation. Pilot cost estimates usually only account for the small test volume. According to Bitkom, one in three companies finds AI more expensive than expected.
By making day-to-day operations a prerequisite for pilot approval. If you clarify upfront who will run it, what it will cost, and which KPIs define success, you build the transition into the process. That way, the tough questions are addressed early – when they’re still easy to answer.
A critical one. AI transforms workflows and roles, and without employee buy-in, even the best application goes unused. If you only involve the workforce at rollout, you’ll face resistance. That’s why change management belongs in the project from the start – not as an afterthought.
Read more on Digital Chiefs
Digital ChiefsManaged Security Services: CISO Does Not Bear Sole LiabilityDigital ChiefsTechnical Debt: Why the Board Must Act NowDigital ChiefsData Spaces: Where Smart Industry and Smart City ConvergeMore from the MBF Media Network
cloudmagazinWhen AI costs blow up your cloud budget mybusinessfutureWhy AI fails in SMEs: The order of implementation matters securitytodayEU AI Act: High-risk AI must adaptImage source: AI-generated (June 2026)