What AI Governance Actually Means
AI governance is the set of decisions, structures, and processes that determine how AI is developed, deployed, and monitored in an organisation. It answers: Who has authority to approve AI initiatives? What must be reviewed before deployment? What are the non-negotiable guardrails? How are incidents handled? Who is accountable when something goes wrong?
Governance is not compliance — it's broader. Compliance is about meeting external requirements. Governance is about making good decisions consistently, including in situations that regulations don't yet address.
The Risk Taxonomy for AI
AI risks cluster into four categories, each requiring different governance responses:
Output Risk
AI systems produce incorrect, biased, or harmful outputs. Risk is proportional to: how consequential are the decisions informed by this output, and how much human review is in the loop? A content recommendation system with millions of users and no human review carries higher output risk than a draft-generation tool where every output is reviewed before use.
Data Risk
AI systems use, store, or expose data in ways that violate privacy, contractual, or regulatory requirements. This includes training data issues (consent, representativeness), inference risks (the system's outputs reveal private information about individuals), and third-party data sharing when using external AI providers.
Dependency Risk
Critical organisational processes become dependent on AI systems that can fail, change their behaviour (model updates), or have their access revoked (vendor changes). Single points of failure in AI-dependent workflows are a governance concern that most organisations underweight.
Accountability Risk
When an AI system causes harm, who is responsible? If there is no clear accountability structure, organisations face both ethical and legal exposure. The accountability question must be answered before deployment, not after an incident.
Governance Structure Options
Three governance models that work at different organisational scales:
Centralised review board: All AI initiatives above a materiality threshold require approval from a cross-functional board (legal, risk, technology, business). Works well for high-risk deployments in regulated industries. Risk: creates bottlenecks that slow innovation.
Tiered governance: Low-risk AI use (e.g., using AI assistants for internal document drafting) is approved at manager level. Medium-risk (customer-facing AI with moderate autonomy) requires department head approval plus risk review. High-risk (consequential automated decisions) requires board-level review. Balances speed with oversight.
Distributed governance with standards: Publish clear organisational AI principles and risk standards; empower teams to make deployment decisions within those standards; conduct post-hoc audits. Works when organisational trust is high and the risk of individual deployments is contained.
The Five Non-Negotiables
Regardless of governance model, five things should be non-negotiable across every AI deployment:
- Human accountability is clearly assigned — a named person, not "the team"
- Data use is explicitly reviewed and approved against privacy policy and applicable law
- A shut-down path exists and is documented — how to turn this off quickly if needed
- An incident response plan is in place before deployment, not after
- Regular output review is scheduled — not assumed to be "fine"