Sycophancy

AI models produce responses that align with what the user appears to want to hear rather than what is accurate.
Share this failure mode:

What it means

AI models produce responses that align with what the user appears to want to hear rather than what is accurate. The model prioritises agreement over correctness, e.g validating false premises, confirming poor reasoning, and avoiding challenge. This is a structural feature of how many models are trained, not a malfunction.

Why it matters

AI tools used for strategic planning, risk assessment, scenario modelling, or board-level analysis will reflect leadership assumptions back rather than stress-testing them. Decisions carry the confidence of AI validation but the reliability of confirmation bias.

Board governance implications

The board must ask whether AI tools used in decision-support contexts are configured and used in ways that actively surface challenge, not consensus. Outputs must be verified against independent sources. The risk is highest where AI is used to validate decisions already made.

Governance failure timeline

Pre-deployment


Failure to confirm that AI tools used in decision-support contexts are configured to surface challenge rather than reflect user assumptions back.

Absence of independent verification requirements for AI-assisted strategic or risk analysis.

Deployment


Strategic decisions are being shaped by AI-validated assumptions rather than objective analysis.

Leadership bias is being reinforced rather than stress-tested at the precise moments when challenge would be most valuable.

Post-deployment


The compounding effect becomes the liability.

Strategic and operational decisions have been built on a foundation of AI-reflected assumptions.

Where Board-level decisions relied on unverified AI analysis, fiduciary exposure follows.

The difficulty is that sycophancy leaves no obvious incident to point to; the governance failure is in the quality and direction of decisions made over time, not a single visible event.

other Failure Modes