Loading...
Your Model Inventory Has a Gap Your Regulators Are About to Find.
How the 2011 model risk framework is now governing your 2025 AI deployments.
The question in front of every bank's model risk management team right now.
SR 11-7 defines a model as a quantitative method or system that applies statistical, economic, or mathematical theories to data inputs, producing outputs used for decision-making. Most bank legal teams have concluded that AI tools in credit, fraud, compliance, and customer operations meet this definition.
If in scope: model inventory entry, validation plan, documented performance standards, ongoing monitoring, and model change governance are all required. For third-party LLM APIs, each of these obligations has an implementation gap.
Model changes are the acute risk. When OpenAI updates GPT-4 to GPT-4o, behavior changes materially. SR 11-7 requires impact assessment before model changes affect consequential outputs. Banks running third-party AI APIs are not in the change management loop.
Argue AI tools in advisory or assist roles do not meet the model definition. Viable for narrow use cases (internal doc summarization). High examiner risk if tool is in credit, fraud, compliance, or customer-facing workflows.
Add all in-scope AI to model inventory. For third-party APIs, conduct output testing, adversarial testing, and demographic parity analysis. Document validation limitations explicitly. Establish model change monitoring. This is the defensible posture under current guidance.
Limit AI to internal productivity tools that do not touch credit, fraud, compliance, or customer decisions. Eliminates SR 11-7 model inventory risk. Forfeits competitive advantage where AI ROI is highest. Not a sustainable long-term posture.
Require bank-controlled infrastructure for any inventoried AI model. Eliminates third-party API black-box risk. Realistic only for top-20 banks by assets with ML engineering capacity. Most regional and community banks cannot execute this posture.
An AI tool in credit decisioning, fraud detection, or compliance monitoring that is not in the model inventory is an SR 11-7 finding. The finding does not depend on whether the tool performed correctly — it depends on whether your governance process covered it.
Third-party AI providers update models without prior notice. Each GPT or Gemini version change that occurs without triggering an impact assessment is an undocumented model change event in your inventory record. Most bank governance processes were designed to catch internal model retrains, not API provider updates.
AI tools in credit underwriting, pricing, or marketing require disparate impact analysis. Most banks that deployed AI credit tools in 2023–2024 have not completed this analysis for current model versions in production. The compliance gap compounds with each untracked version update.
Banks deploying multiple AI workflows on a single provider (OpenAI, Azure AI, Vertex) have created a single dependency spanning multiple model inventory entries. A pricing change, outage, or API deprecation affects multiple critical workflows simultaneously.
Teams built for statistical model validation do not have the tools or methodology to validate LLMs. Validation reports that satisfy procedural requirements but miss LLM-specific failure modes (hallucination, prompt injection, context sensitivity) create an inadequate validation methodology finding even when validation is technically performed.
One enterprise AI deployment, dissected every Tuesday. Written for executives who have to decide, not just read.