Local AI: Governance Before Hardware Purchase
Benedikt Langer
10 min readFour developments over two weeks show that locally operated AI goes far beyond the tech stack. ...
Read Article
9 min read
89 percent of all companies still operate with functional hierarchies, matrix structures, or traditional business-unit models. Meanwhile, organizations using product and platform teams deliver features 2.5 times faster and cut their IT costs by 60 percent. By 2026, the gap between outdated structures and new performance capabilities will become a strategic risk.
TL;DR
- 89 percent rely on outdated structures: Functional hierarchies, matrix management, and business-unit models continue to dominate the IT landscape, according to McKinsey’s State of Organizations 2026.
- Product and platform teams deliver measurable gains: Cloud-native organizations achieve 60 percent lower IT costs and 2.5× faster deployment velocity compared to traditional structures.
- Gartner calls for transformation: In Predicts 2026, Gartner explicitly advises CIOs to restructure their IT operating models to realize AI-driven value.
- Redesign success rates are rising: 63 percent of operating-model transformations now meet their goals – up from just 21 percent a decade ago (McKinsey).
- 20-30 percent of potential ROI is lost due to misalignment between strategy and operating model – especially in volatile markets.
Why the Old IT Organization No Longer Works
Most IT departments across DACH-region companies evolved organically over time: Business units place project requests; IT delivers. Requirements flow through committees, budgets are allocated annually, and success is measured by on-time delivery – not business impact. This model worked when technology was merely a cost center. In 2026, technology is the central engine of value creation.
The McKinsey Global Tech Agenda 2026 makes the rupture unmistakable: Among 600 surveyed technology and business leaders, 50 percent plan to increase their technology budgets by more than four percent in 2026. At the same time, AI has displaced both cybersecurity and infrastructure modernization as the top investment priority. Pouring this capital into legacy structures amounts to burning it.
Source: McKinsey State of Organizations, 2025
The Product-and-Platform Model: What Top Performers Do Differently
McKinsey defines the target model as follows: Technology teams organize around user-facing products – and the underlying platforms that enable them. Instead of projects with defined start and end dates, teams are permanent, with clear ownership over a digital product or platform component.
The data speak clearly. Nearly 50 percent of top performers in McKinsey’s survey report that business and technology teams jointly and iteratively develop strategic plans. Across all respondents, that figure stands at 29 percent – nearly double the rate recorded in the previous survey. The trend is unmistakable – but the majority still lags behind.
Concretely, this means: A CIO who restructures their team along product-and-platform principles reduces coordination overhead between business units and IT. Product teams understand the business context because domain experts are embedded permanently. Platform teams ensure shared infrastructure – data, AI models, APIs – is available to all product teams.
The Agentic Organization: McKinsey’s Next Evolutionary Stage
Those who assume product teams represent the final stage underestimate the pace of change. In 2026, McKinsey introduced the concept of the agentic Organization: organizations where humans and AI agents – both virtual and physical – collaborate at scale. Not as isolated experiments within innovation units – but as the core operating model.
The numbers are compelling: AI-centric organizations achieve 20-40 percent lower operating costs and 12-14 percentage points higher EBITDA margins, per McKinsey. And one in four executives expects AI agents to function as autonomous team members in the near term.
For boards, this means: The question is no longer whether AI agents will be integrated into the operating model – but how fast. Organizations still struggling to shift from project-based to product-based structures will find the leap to an AI-integrated organization nearly impossible.
“CIOs must restructure their IT operating models to capture AI value. Current organizational designs are not built to scale AI initiatives.”
Gartner, Predicts 2026: CIOs Must Restructure Their IT Operating Models to Capture AI Value
DACH Reality Check: Why Transformation Is Especially Hard Here
Germany accounts for 24.5 percent of Europe’s digital transformation revenue. Money is flowing – but into which structures? Practice reveals three typical roadblocks across the DACH region:
First: Co-determination and works councils. Shifting from functional teams to cross-functional product units affects job descriptions, reporting lines, and often collective bargaining agreements. What US multinationals implement in quarters takes months of negotiation in Germany.
Second: Historically grown ERP landscapes. Bosch Digital manages over 50 ERP systems and 80 subsystems across more than 300 legal entities in over 100 countries. Introducing platform teams requires simultaneously addressing this technical debt – or else new teams lack the foundational platform they need to build upon.
Third: A shortage of technically skilled leaders. According to McKinsey, top performers hire technical leaders at nearly twice the rate: 37 percent versus 19 percent among average companies. In German mid-sized firms, these profiles are frequently absent altogether.
Five Steps Toward the Digital Operating Model
The good news: Success rates for operating-model transformations have tripled. Today, 63 percent reach their goals – up from 21 percent a decade ago. The difference lies in methodology.
1. Map value streams – not org charts. Which digital products and platforms generate business value? These value streams define team structure – not historical departmental logic.
2. Governance before structure. McKinsey recommends first establishing a governance framework that aligns the technology organization with strategic priorities. Without clear decision rights and prioritization mechanisms, any reorganization fizzles.
3. Platform teams as the foundation. The platform layer – data, AI models, decision systems – must exist as a standalone organizational unit. McKinsey calls this the Intelligence Layer: a unified layer of data, AI models, and decision systems used by all product teams.
4. Involve Financial Managers early. Top performers hire more Financial Managers to ensure technology investments deliver measurable ROI. Linking IT spend to business outcomes isn’t optional – it’s a board-level responsibility.
5. Transform iteratively – not via Big Bang. Transitioning from functional to product-based organization rarely succeeds in one step. Define pilot areas, gather insights, then scale incrementally. The 20-30 percent ROI loss caused by poor operating-model alignment stems largely from half-hearted transformations.
What the Board Must Decide Now
The question for the board is not technical – it’s organizational: Do we want an IT department that fulfills orders – or a technology organization that creates business value? The former is cheaper to set up but costs 20-30 percent of potential ROI. The latter demands restructuring – but delivers demonstrably superior results.
Gartner puts it plainly: CIOs must restructure their operating models to capture AI value. Those still thinking in projects – not products – in 2026 will miss the transition to the agentic Organization – and thus forfeit the next competitive advantage.
Conclusion
The digital operating model is not an IT initiative – it’s a board-level decision. The evidence is unequivocal: Product and platform teams deliver faster, cheaper, and with greater business impact. The next evolutionary stage – the integration of AI agents as full team members – is already at the door. CIOs who delay restructuring deny their companies access to productivity gains McKinsey quantifies at 20-40 percent. The alternative is the status quo – and that carries a 20-30 percent ROI penalty.
Frequently Asked Questions
What is a digital operating model?
A digital operating model describes how a company structures its technology organization to create business value. At its core, it represents the shift from project-based IT delivery to permanent product and platform teams bearing end-to-end responsibility for digital offerings.
Why isn’t agile transformation enough?
Agile methods change how teams work internally. A digital operating model changes the organization itself: reporting lines, budget allocation, decision rights, and collaboration between business and IT. Without structural change, agility remains trapped at the team level.
How long does it take to transition to the product-platform model?
A full transformation typically takes 18-36 months. McKinsey recommends an iterative approach: define a pilot area, establish governance, then scale incrementally. In the DACH region, co-determination extends timelines by six to twelve months.
What role does the CFO play in the digital operating model?
A central one. Per McKinsey, top performers deliberately hire Financial Managers to tie technology investments to measurable ROI. The CFO must understand that IT budgets are no longer allocated by cost center – but by value stream – and that platform investments amortize across multiple products.
What is the agentic Organization?
A concept coined by McKinsey in 2026 describing organizations where humans and AI agents collaborate at scale. AI agents don’t just handle discrete tasks – they act as autonomous team members within workflows. Prerequisites include an operating model that institutionalizes data-driven decision systems and AI platforms as formal organizational units.
Further Reading
CIO Agenda 2026: Between Cost Pressure and Innovation Imperative
Board Reporting for IT: 5 Metrics the Board Actually Understands
AI Is Not a Tech Problem: Why 27 Percent of CEOs Fail at Their Own Organizations
More from the MBF Media Network
cloudmagazin: The VMware Cost Trap 2026 – Why IT Teams Are Exploring Alternatives
MyBusinessFuture: AI in Mid-Sized Companies – Why Firms Hesitate
SecurityToday: NIS2 in Germany – What Companies Need to Know Now
Header Image Source: Pexels / Vlada Karpovich (px:7433851)