AI-Augmented Forecasting

No research briefing. No script. No slide decks. Just two technology executives answering questions as fast and as honestly as they can.After four consecutive research-heavy episodes — management illusions, forecasting science, behavioral data from 250,000 conversations — Kenza and Pascal take a different format. Rapid fire. Maximum 90 seconds per answer. The questions draw on everything covered in Season 3, but the answers come from experience, not studies.Three rounds: what the research actually confirms from real professional experience, personal stories from careers spanning AI strategy, CIO leadership and corporate transformation, and a rapid-fire executive reality check covering everything from governance to the efficiency vs. efficacy distinction.What was the worst AI project either of them has lived through? Which management illusion do they encounter most in their own consulting work? What is the dumbest question an executive can ask about AI — and what is the smartest? What single sentence separates companies that actually use AI from those that only claim to?The format is deliberately lighter than the research episodes. The answers are among the most direct things Kenza and Pascal have said on the podcast.Key TakeawaysThe management illusions both hosts encounter most in practice: the end-to-end illusion and the bottom-up illusion — executives who believe one AI agent can handle a complex process end-to-end, and organizations where AI champions have titles but no authority.The best question an executive can ask: 'What decision would we make differently if we had this capability?' It moves the conversation from technology to value every time.The worst question: 'What is our competitor's AI strategy?' It sends the entire organization into benchmarking mode instead of problem-solving mode.Friction in AI interactions is a feature, not a bug. Productive resistance increases human engagement and output quality.The sentence that separates companies that actually use AI from those that claim to: 'The ones that use it can show you a decision that changed.'The board decision that cannot wait: who is personally accountable when an AI-informed decision goes wrong. Until that question has a name attached to it, everything else is theater. Hosted on Acast. See acast.com/privacy for more information.

We talk a lot about how executives think AI is being used in their organizations. This episode is about how it is actually being used — at scale, in the real world, across a quarter million real conversations.Stanford University's SALT Lab analyzed 249,834 real Claude.ai conversations to answer three questions: what work people bring to AI, what control they retain over the process, and where the collaboration breaks down. The findings challenge some of the most common assumptions executives hold about AI adoption.The most striking finding: 56% of conversations involving actionable tasks were consequential or hard-to-reverse work. Legal guidance. Financial decisions. Strategic choices. People are not using AI for trivial tasks — they are bringing their most difficult problems to it, often without any formal organizational sanction or governance framework in place. Legal and financial guidance had the highest Task Criticality Index at 2.14.And yet — the human remains in control. 72% of conversations were human-led, with AI assisting rather than directing. Users typically adapted AI outputs rather than using them verbatim. Higher-stakes tasks nearly doubled conversation length and engagement. And friction — which appeared in roughly half of all conversations — was often productive: users who encountered resistance from the AI emerged more engaged and more capable.The central tension the study surfaces: does working with AI build human capability, or substitute for human effort? Active teaching — where users explain context, correct outputs, and shape results — occurred in 67% of conversations. But the benefits were unevenly realized. The executives who understand this dynamic will design better governance. The ones who don't will discover the gap the hard way.Key TakeawaysPeople are already using AI for consequential, high-stakes work — whether organizations have sanctioned it or not. The governance gap is real and it is already being filled informally.72% of conversations are human-led. The narrative that AI is taking over is not supported by behavioral data at scale. Humans are still in the room — the question is whether the room has the right rules.Friction is not failure. Productive friction — where AI challenges or resists — increases human engagement and capability. Optimizing for seamless AI interactions may be removing something valuable.AI benefits are unevenly distributed. Employees who already know how to use AI effectively get more capable. Those who don't risk falling further behind. AI literacy is a strategic investment, not a nice-to-have.The governance imperative: the highest-risk work is being brought to AI first. Organizations that are still designing their governance framework are already behind the behavior curve of their own employees.Source: Shao, Y., Zhao, D., Padmakumar, V., Wang, J., & Yang, D. (2026). Human–AI Collaboration at Scale: Task Criticality, Agency, and Friction Across 250,000 Conversations. Stanford University SALT Lab. https://arxiv.org/abs/2608.human-ai-collaboration-at-scale Hosted on Acast. See acast.com/privacy for more information.

After two episodes on what goes wrong in execution and deployment, this episode zooms out to the questions that keep boardrooms busy: What return can we realistically expect? How do we organize for this? And what does a credible AI strategy actually look like?In this second and final episode of the Management Illusions series, Kenza and Pascal cover the remaining three illusion domains — and the findings are the ones most executives will recognize from their own boardrooms.Illusion Domain 3 covers the ROI stage. The downsizing illusion — the most prevalent and most damaging of all ten illusions according to the expert survey — is the belief that AI agents will enable significant workforce reductions. Ford, Klarna, and Salesforce all had to rehire thousands of workers whose AI replacements showed unreliable performance. Up to 30% of workers laid off due to AI may need to be rehired within three years. The productivity illusion reflects the well-known productivity paradox: measured productivity improvements from agentic AI trail perceived and expected improvements. Accelerating one process creates little firm-level value if downstream processes become bottlenecks.Illusion Domain 4 concerns how firms organize for AI. The bottom-up illusion is the belief that AI champions or ambassadors at the mid-level can drive the transformation. No firm has succeeded with this model alone: champions lack time, technical authority, and formal power to change how work is organized. The agent=employee illusion is the urge to anthropomorphize AI agents — giving them human names, placing them on org charts — which early evidence suggests may undermine managerial oversight and accountability.Illusion Domain 5 addresses strategy. The master plan illusion is the belief that firms need a firm-wide agentic AI vision and roadmap. Agentic AI is an instrument for executing a business strategy — not a strategy in itself. The preparation illusion comes in two opposite failure modes: starting without sufficient foundations, or waiting indefinitely for perfect conditions that never arrive.Key TakeawaysThe downsizing illusion is the most damaging of all ten illusions. Up to 30% of workers laid off due to AI may need to be rehired within three years. Deploying AI agents requires substantial human resources to build, test, maintain, and oversee them.Productivity gains in individual tasks do not automatically translate to firm-level productivity. Accelerating one process is worthless if downstream processes become bottlenecks.The honest reframe: agentic AI is a long-term investment in competitiveness — not a short-term cost reduction lever.The bottom-up illusion: AI champions without dedicated time, technical depth, and formal authority produce monthly update meetings, not transformation. Successful firms combine top-down enablement with bottom-up initiative.In one firm of 30,000 employees, successful transformation required approximately 60 dedicated full-time employees centrally — with HR as a close partner, because scaling AI means reorganizing work.A firm-wide agentic AI master plan puts the cart before the horse. What firms need is a governance and infrastructure framework within which functions can deploy AI where it genuinely helps.The final test for any AI investment: if you removed the word 'AI' from the proposal — would it still be a compelling business case? Hosted on Acast. See acast.com/privacy for more information.

Over 40% of agentic AI projects will be cancelled by end of 2027, according to Gartner. Many more remain stuck in experimentation. And even those that scale often fail to deliver the intended return on investment. The technology is not the problem. The mental models are.In this first of two episodes based on a major new study by Johannes Habel and colleagues — validated through a survey of 167 technical experts — Kenza and Pascal unpack the four management illusions that undermine agentic AI at the use case development and deployment stages.Illusion Domain 1 covers two illusions around developing use cases. The agent-first illusion is the belief that AI agents can and should eventually enter virtually any business process. In reality, only about 10% of automations in a large-scale transformation actually require LLM-based agents — the rest can be handled by simpler, more deterministic tools. The end-to-end illusion is the expectation that a single AI agent can reliably navigate complex multi-step processes. Today's agents require highly specialized scope and human orchestration; broader process improvement emerges by combining multiple agents with other technologies and humans in the loop.Illusion Domain 2 covers the deployment stage. The testing illusion is managers' systematic underestimation of the effort required to evaluate and safeguard agent reliability. AI agents that perform well in demos regularly fail in unattended production — often silently — and the availability of domain experts, not technical experts, is usually the bottleneck. The scaling illusion is the assumption that a successful pilot can be replicated quickly and cost-effectively. In practice, processes that look similar often differ in inputs, IT systems, and data quality — and the human resource challenges of scaling AI agents are as significant as the technical ones.Key TakeawaysAI agents should be the last resort for automation, not the first. Only about 10% of identified automations in one large-scale transformation required LLM-based agents.The end-to-end illusion: today's AI agents cannot reliably navigate complex multi-step processes. The right approach is specialized agents for clearly defined subtasks, orchestrated alongside humans and other tools.AI agents that pass demos regularly fail in production — often silently. A voice agent in automotive called former customers to reactivate them; it performed significantly worse than human agents and caused many opt-outs.The testing burden falls on domain experts, not technical experts. Their availability — not the technology — is usually what limits deployment timelines.Scaling is not replication. A pilot designed to prove feasibility is rarely designed to scale. The second implementation almost always takes longer and costs more than expected.Scaling AI agents ultimately means scaling human agents too — reorganizing roles, building new skills, and securing employee buy-in. Hosted on Acast. See acast.com/privacy for more information.

Show NotesMost executive decisions are forecasts in disguise. 'Will this market grow?' 'Will this AI initiative deliver ROI?' 'Will this acquisition integrate well?' These are all probability estimates — and most leadership teams make them without any structured method, relying instead on experience, intuition, and the confidence of whoever speaks loudest in the room.In this episode, Kenza and Pascal explore two landmark studies on AI-augmented forecasting and what they mean for executive decision-making. The first, by Halawi et al. (NeurIPS 2024), shows that a retrieval-augmented AI system can approach the forecasting accuracy of competitive human forecasters — and that combining AI and human judgment always outperforms either alone. The second, by Schoenegger et al. (2025, co-authored with Philip Tetlock, the world's leading expert on forecasting), shows that AI assistance improves human forecasting accuracy by 24–28% — even when the AI assistant is deliberately biased and overconfident.The key insight: the benefit is not just informational. It is cognitive. Engaging with an AI perspective — even an imperfect one — forces assumption-surfacing, reduces overconfidence, and makes human judgment measurably more accurate. The Brier Score — a rigorous calibration metric that measures how well-calibrated probability estimates are, not just whether someone was right or wrong — confirms the improvement is real and quantifiable.For boards making high-stakes decisions under uncertainty, this is not a hypothetical. It is a demonstrated, quantifiable capability that most executive teams are not yet using systematically.Key TakeawaysCombining AI forecasts with human judgment always produces better outcomes than either alone — confirmed across thousands of forecasting questions.AI assistance improves human forecasting accuracy by 24–28%, measured by the Brier Score — the gold standard for calibration.The benefit is cognitive, not just informational: AI forces you to surface assumptions you didn't know you were making and reduces overconfidence even in experienced forecasters.AI performs best exactly where boards struggle most — in the 30–70% uncertainty range where nobody is sure and overconfidence is highest.Most executive teams use AI to summarize and report. The studies suggest they should be using it to challenge assumptions before the decision is made.The practical starting point: pick one recurring decision type, introduce probability language, track outcomes, and score calibration over time. Hosted on Acast. See acast.com/privacy for more information.

Show NotesNearly 9 in 10 organizations report using AI regularly. Only 37% say AI has made a positive contribution to their EBIT. And only 6% qualify as genuine AI high performers. The rest? Optimizing. Automating. Saving costs. Declaring victory.In this episode Kenza and Pascal ask themselves: when does AI actually grow the top line?And close with a board checklist and a final provocation:"Do not ask what AI can do for your current business. Ask what business you can build because AI now exists."Key TakeawaysEfficiency asks 'how.' Growth asks 'what, for whom and why us?' These are different questions requiring different organizational conditions.Capability without mandate produces demos. Mandate without capability produces PowerPoint. Both without a business model hypothesis produce expensive activity.A Copilot license is not a strategy.The winners will not be the companies that bought the most AI. They will be the ones that used AI to become a different company while they still had the luxury of choice. Hosted on Acast. See acast.com/privacy for more information.

Every week, AI teams deliver insights. Dashboards fill up. Reports multiply. And in most organizations nothing changes. Not because the AI didn't work. Because the insight never became a decision.In this episode, Kenza and Pascal tackle the hardest part of AI transformation: the gap between having insight and acting on it. Pascal brings a provocation that cuts to the heart of how most companies measure AI ROI: an insight is not an innovation. It only becomes innovation when it changes a product, process, customer experience, or business model.Key TakeawaysThe last mile of AI is not prediction. It is authority — who owns the decision that needs to change.An insight is not an innovation. If no decision, process, product or customer outcome changes, you produced information, not value.Process intelligence exposes the difference between how a process is described and how it actually behaves. That gap is usually where the real AI opportunity sits.A process map can be political. A timestamp is less diplomatic. Use process evidence to redesign the system, not to publicly grade departments.You cannot ask people to challenge the status quo while measuring them only on how reliably they preserve it.Data without decision rights is just expensive observation. Hosted on Acast. See acast.com/privacy for more information.

Most organizations have data governance policies. Far fewer have data governance that actually works when it meets day-to-day operations. In this episode, Kenza and Pascal move beyond the theory and into the uncomfortable reality: why governance frameworks fail, why data quality is a leadership responsibility that nobody owns, and why the difference between having data and trusting data is exactly where most AI projects quietly fall apart.The episode closes with a line worth writing down: a dashboard can be technically correct and still be organizationally untrustworthy. And another: trust should be earned by the system, not requested by the project team.Key Takeaways•      Data governance only works when it protects value and speeds decisions — not when it is purely a compliance exercise people route around.•      The business owns the meaning of data. Technology owns the enablement. Governance connects the two.•      AI did not repeal garbage-in, garbage-out. It just made the garbage more eloquent. LLMs can mask data quality problems — which makes them more dangerous, not less.•      Trust in data must be built progressively: low-stakes decisions first, visible provenance, measurable error rates, and explicit human override.•      The opposite risk is equally dangerous: executives who trust the data too much. Confidence is not evidence. Mature organizations institutionalize questioning. Hosted on Acast. See acast.com/privacy for more information.

"Data is the new oil." It's one of the most repeated phrases in every AI conversation - and one of the most misleading. Data is not valuable in itself. It is dead storage space until it is connected, trusted, contextualized, and governed in a way that actually improves decisions.In this episode, Kenza and Pascal move from technology foundations into the data layer and make the case that most data problems are not technical problems at all. They are cultural, political, and leadership problems. And often, they are the result of organizations not knowing what they actually want to know.Key topics: the DIKW pyramid (Data, Information, Knowledge, Wisdom) as a framework for understanding where companies get stuck, why data silos are political artifacts rather than technical accidents, how to move from raw data to decisions that actually change something.Data silos are rarely technical accidents. They are political artifacts,  fiefdoms inside organizations that protect data as a source of power. Hosted on Acast. See acast.com/privacy for more information.

Legacy systems are not just old technology. They are the accumulated result of past decisions — many of them made for good reasons at the time — that now constrain everything a company wants to do with AI. In this episode, Kenza and Pascal go one layer deeper than IT image and strategy, into the structural reality of architecture, integration, infrastructure, and cybersecurity. They explore why legacy modernization is a leadership decision, not an IT backlog item, and what executives need to understand about the infrastructure gap between a successful AI pilot and production at scale.Key topics:- architecture choices that enable or constrain AI at scale,- why disconnected systems create AI blind spots,- the infrastructure investment needed for production-grade AI- why cybersecurity is now an expanded executive responsibility.Pascal's provocation: Legacy architecture is frozen decision history. The question for every board is which decisions are you still living with, and are they still the right ones? Hosted on Acast. See acast.com/privacy for more information.