Sovereign AI: Responsibility Stays In-House
Eva Mickler
7 Min. Reading time Who brings an AI model into productive operation bears responsibility for its behavior, ...
AI-powered forecasting and resilience systems for supply chains often deliver good results in stable operations. However, they systematically fail exactly where companies rely on them: during sudden geopolitical shocks, route disruptions, or abrupt demand drops. The reason lies in their dependence on historical patterns and the underrepresentation of rare events.
The Essentials at a Glance
Predictive models learn statistical relationships from past observations. They extrapolate distributions of delivery times, freight costs, and availability that occurred during the training period. As long as new developments remain within these distributions, they generate useful point forecasts and bandwidths.
The Red Sea crisis from late 2023 shows the limit. Attacks on ships in the Red Sea forced shipping companies to reroute around the Cape of Good Hope. Transit times on Asia-Europe routes increased by around ten to fourteen days. Freight rates rose on some routes by several hundred percent within a few weeks. Automakers like Tesla halted production at the Gigafactory Berlin for two weeks, and Volvo Cars temporarily paused operations at its plant in Gent. Models that assumed stable routes and historical runtimes reacted too late or underestimated the impact on downstream inventories and production plans.
Structural breaks of this kind do not change individual values but entire distributions simultaneously. Models that assume slow drift or stationarity systematically recognize such jumps too late.
The Break That Models Missed
10 to 14 days longer transit time. This is how much Asia-Europe runtimes increased when shipping companies rerouted around the Cape of Good Hope due to attacks in the Red Sea. Models with stable runtimes reacted too late.
Many systems operate with incomplete visibility across multiple supply chain tiers. They rely on Tier 1 data, public indices, or aggregated market indicators. Rare combinations of events – geopolitical escalation, simultaneous weather events, and port congestion – are underrepresented or entirely absent from training data.
Additionally, implicit assumptions about correlations between indicators come into play. When a shock affects multiple suppliers or regions simultaneously, these relationships break down. As a result, models either provide overly optimistic forecasts or contradictory signals. Digital Twins, intended to serve as simulation environments for resilience, inherit the same issues. They are only as good as the assumptions and data fed into them. In times of rapid change, underlying parameters quickly become outdated.
For CIOs and supply chain managers, this implies a clear priority. Enhancements to the data foundation and multi-tier transparency often yield more resilience than further refining algorithms.
Improvements to the data foundation often provide more resilience than further refining algorithms.
A second blind spot lies in the increasing autonomous control. Many systems automatically trigger reorders, route changes, or inventory adjustments at defined threshold values. In normal operation, this reduces manual work and shortens response times.
In exceptional cases, the same logic can exacerbate the situation. If a model interprets a structural change as a temporary outlier, it continues to order based on incorrect parameters. The result is stock shortages in one place and overstocking in another. At the same time, with high levels of automation, the planning team loses practical knowledge about exceptional situations. When manual intervention is required, the current experience is often lacking.
Analyses by consulting firms and industry observers repeatedly point out that missing or unclear escalation rules increase vulnerability. The human-in-the-loop is not a fallback into manual processes, but a necessary component of robust control.
Most organizations evaluate their systems based on classic accuracy metrics such as mean absolute percentage deviation. These values are useful in a stable environment. However, they reveal little about how the system reacts under extreme conditions.
Robustness manifests itself differently. It lies in three capabilities: quickly recognizing model assumptions as invalid, evaluating several plausible developments in parallel, and maintaining the ability to act within defined tolerances. Relevant factors include the coverage of stress scenarios, the time to the first reliable reassessment, and the quality of decisions under uncertainty.
Therefore, alongside forecast accuracy in daily business, CIOs should conduct regular stress tests and simulations. The key question is not how accurate the model is on average, but rather how it behaves when multiple assumptions collapse simultaneously.
The solution does not lie in abandoning predictive methods, but in their targeted integration. AI and machine learning are particularly well-suited for quickly identifying patterns and anomalies, as well as continuously adapting baseline plans based on current signals. They are less suitable as the sole basis for decisions under high uncertainty.
They must be supplemented by structured scenario planning. This is not about a single worst-case scenario, but about the systematic exploration of several plausible developments. Digital twins can serve as an exploration tool here to simulate the impact of route changes, supplier failures, or demand shifts.
The decisive factor is organizational anchoring. Predefined triggers – such as significant deviations in lead times over several stages or sudden changes in geopolitical indicators – should automatically trigger an escalation to human decision-makers. These require up-to-date situation reports, defined scope for action, and pre-exercised playbooks. Regular exercises keep the interplay functional.
Companies that, based on the experiences of recent years, have exclusively relied on better algorithms, find that true resilience arises from the interplay of data-driven early detection, exploratory scenario techniques, and qualified human evaluation. Technology provides signals and options. The responsibility for the decision remains with humans – also and especially in exceptional cases.
A direct approach is to perform back-calculations based on known historical shocks using current data and parameters. If the models show significant deviations or delayed adaptation, the robustness is insufficient. Additionally, observing how quickly the system triggers alarms in case of real deviations and how well the uncertainty intervals are calibrated during such phases can be helpful.
Workshops alone rarely have an impact. What is required is integration into operational processes through clear triggers, defined responsibilities, and regular exercises. Without this interlocking, scenario work often remains detached and is not utilized in critical situations.
Priority is usually given to improving visibility of critical dependencies across multiple levels. This does not always require new platforms, but rather the systematic linking of existing internal and external signals – from supplier feedback to freight data and geopolitical early indicators. On this basis, extended models and simulations can unfold their benefits.
Image source: AI-generated (July 2026)
Read more on Digital Chiefs
Digital ChiefsWhy More Tech Budget Doesn’t Secure a Competitive EdgeDigital ChiefsThe IT department decides whether the spin-off pays offDigital ChiefsGermany as a Business Location Needs ProductivityMore from the MBF Media Network
cloudmagazinThe deadline that many Navision users are sleeping on MyBusinessFutureWhen every order email is manually entered into the ERP SecurityTodaySupply chain risk is a program, not an audit listAlso available in