Runbook 02 Enterprise AI Security Architecture Review
Purpose
Section titled “Purpose”This runbook provides a repeatable methodology for performing an Enterprise AI Security Architecture Review.
The goal is to evaluate whether an AI solution has been designed with appropriate security controls before production deployment or major architectural change.
A strong architecture review helps identify security weaknesses early, when they are easier and less expensive to correct.
The review should answer:
Does this architecture provide appropriate protection for the business use case, data, identities, AI components and supporting infrastructure?
Runbook Objective
Section titled “Runbook Objective”Use this runbook to:
- Understand the business use case.
- Review the proposed AI architecture.
- Identify security boundaries.
- Review data flows.
- Review identity and authorization.
- Review LLM integration.
- Review RAG architecture.
- Review AI agents and tools.
- Review API security.
- Review cloud and platform security.
- Review secrets management.
- Review security logging.
- Review resilience and availability.
- Identify design weaknesses.
- Recommend security controls.
- Document architecture decisions.
- Define security conditions for production approval.
When to Use This Runbook
Section titled “When to Use This Runbook”Use this runbook when:
- A new AI system is being designed.
- A Generative AI capability is being introduced.
- An organization is integrating an external LLM provider.
- RAG is being added to an existing application.
- AI agents or autonomous workflows are being introduced.
- Sensitive enterprise data will be exposed to AI.
- A new cloud AI platform is being deployed.
- Major architectural changes are planned.
- An AI platform is moving from development to production.
- Security architecture approval is required.
- A previous incident indicates architectural weaknesses.
Typical Enterprise Workflow
Section titled “Typical Enterprise Workflow”Business Requirement ↓Solution Architecture ↓Security Architecture Review ↓Threat Modeling ↓Security Requirements ↓Engineering Changes ↓Security Validation ↓Risk Decision ↓Production DeploymentSecurity should ideally become involved before implementation is complete.
Roles Involved
Section titled “Roles Involved”An architecture review may include:
-
AI Security Engineer
-
Security Architect
-
Enterprise Architect
-
Cloud Security Engineer
-
Application Security Engineer
-
AI / ML Engineer
-
Software Architect
-
DevSecOps Engineer
-
Data Engineer
-
Platform Engineer
-
Privacy
-
Risk and Compliance
-
AI Governance
-
Business Owner
The AI Security Engineer may lead or support the security review.
Required Inputs
Section titled “Required Inputs”Collect:
-
Business requirements
-
Architecture diagrams
-
Data flow diagrams
-
AI / LLM design
-
RAG architecture
-
AI agent design
-
API specifications
-
Identity architecture
-
IAM roles
-
Cloud architecture
-
Network architecture
-
Data classification
-
Secrets management design
-
CI/CD architecture
-
Logging design
-
Monitoring design
-
Third-party integrations
-
Security requirements
-
Compliance requirements
-
Existing threat models
-
Deployment model
If an input is missing, record it.
Missing architecture information is itself a risk to effective review.
Architecture Review Workflow
Section titled “Architecture Review Workflow”Understand Business Requirement ↓Identify Architecture Components ↓Map Data Flows ↓Identify Trust Boundaries ↓Identify Assets ↓Review Identity ↓Review Data Security ↓Review LLM Integration ↓Review RAG ↓Review AI Agents ↓Review APIs ↓Review Infrastructure ↓Review Security Controls ↓Review Logging ↓Review Resilience ↓Identify Threat Scenarios ↓Identify Architecture Gaps ↓Define Required Controls ↓Document DecisionPhase 1 — Understand the Business Requirement
Section titled “Phase 1 — Understand the Business Requirement”Before reviewing components, understand what the system is trying to achieve.
Document:
Business Use Case
Section titled “Business Use Case”Examples:
-
Internal knowledge assistant
-
Customer chatbot
-
Security analyst assistant
-
AI coding assistant
-
Document summarization
-
Fraud analysis
-
AI-driven automation
Identify:
-
Employees
-
Administrators
-
Customers
-
Partners
-
Developers
-
Service accounts
-
AI agents
Business Criticality
Section titled “Business Criticality”Determine:
-
Low
-
Medium
-
High
-
Mission Critical
Sensitive Functions
Section titled “Sensitive Functions”Ask whether the system can:
-
Access sensitive data
-
Modify records
-
Send communications
-
Execute code
-
Create resources
-
Change permissions
-
Perform financial actions
-
Make business decisions
The greater the capability, the stronger the security requirements.
Business Review Checklist
Section titled “Business Review Checklist”-
Business use case documented
-
Business owner identified
-
Users identified
-
Criticality defined
-
Sensitive functions identified
-
Regulatory requirements identified
-
Data sensitivity understood
-
Human oversight requirements identified
Phase 2 — Identify Architecture Components
Section titled “Phase 2 — Identify Architecture Components”List every significant component.
Example:
Users │ ▼Web Application │ ▼API Gateway │ ▼AI Application │ ├── LLM Provider ├── RAG Pipeline ├── Vector Database ├── Enterprise Data └── AI AgentsSupporting components may include:
Cloud AccountIAMSecrets ManagerObject StorageContainersKubernetesDatabasesLoggingMonitoringSIEMCI/CDSource ControlComponent Inventory
Section titled “Component Inventory”Create:
| Component | Purpose | Owner | Trust Level |
|---|---|---|---|
| Web Application | User interface | App Team | Medium |
| API Gateway | API entry point | Platform Team | High |
| LLM Service | AI inference | AI Team | External/Internal |
| Vector Database | RAG storage | Data Team | High |
| Agent Service | Executes tools | AI Team | High |
Phase 3 — Map Data Flows
Section titled “Phase 3 — Map Data Flows”Document how data moves.
Example:
Employee │ │ Prompt ▼Application │ ▼AI Service │ ├── Retrieve Data │ ↓ │ Vector Database │ └── Generate Response ↓ EmployeeFor every data flow ask:
-
What data moves?
-
Is it sensitive?
-
Is it encrypted?
-
Is it authenticated?
-
Is authorization applied?
-
Is it logged?
-
Does it leave the organization?
Data Flow Checklist
Section titled “Data Flow Checklist”-
User input mapped
-
Model input mapped
-
Model output mapped
-
RAG data flow mapped
-
Agent data flow mapped
-
External provider flow mapped
-
Logging flow mapped
-
Sensitive data paths identified
Phase 4 — Identify Trust Boundaries
Section titled “Phase 4 — Identify Trust Boundaries”A trust boundary exists where data crosses between different security contexts.
Examples:
Internet │ ▼Web ApplicationApplication │ ▼External LLM ProviderAI Agent │ ▼Production SystemRAG Pipeline │ ▼Enterprise DataFor each boundary ask:
-
How is identity established?
-
How is authorization enforced?
-
Is traffic encrypted?
-
Is input trusted?
-
Is output trusted?
-
What logging exists?
Trust Boundary Checklist
Section titled “Trust Boundary Checklist”-
Internet boundary identified
-
Cloud boundaries identified
-
External provider boundary identified
-
RAG boundary identified
-
Agent-to-tool boundary identified
-
Administrative boundary identified
-
Data boundary identified
Phase 5 — Identify Critical Assets
Section titled “Phase 5 — Identify Critical Assets”Typical AI assets include:
-
Sensitive data
-
User prompts
-
LLM outputs
-
System prompts
-
Models
-
Embeddings
-
Vector databases
-
API keys
-
Credentials
-
Service accounts
-
Source code
-
AI agents
-
Logs
-
Business workflows
For each asset identify:
-
Owner
-
Classification
-
Required confidentiality
-
Required integrity
-
Required availability
Phase 6 — Review Identity Architecture
Section titled “Phase 6 — Review Identity Architecture”Identity should be explicit throughout the design.
Review:
User Identity
Section titled “User Identity”How does the application authenticate users?
Application Identity
Section titled “Application Identity”How does the application authenticate to backend systems?
Workload Identity
Section titled “Workload Identity”How do cloud workloads authenticate?
AI Agent Identity
Section titled “AI Agent Identity”Does each AI agent have a separate identity?
Administrator Identity
Section titled “Administrator Identity”How is privileged access controlled?
Identity Architecture Checklist
Section titled “Identity Architecture Checklist”-
Central authentication used
-
MFA applied where appropriate
-
User identity propagated safely
-
Service identities separated
-
AI agents use dedicated identities
-
Least privilege applied
-
Privileged access separated
-
Long-lived credentials minimized
-
Identity events logged
Architecture Principle
Section titled “Architecture Principle”Every significant actor should have an identifiable and appropriately scoped identity.
Avoid architectures where many components share one highly privileged credential.
Phase 7 — Review Authorization Architecture
Section titled “Phase 7 — Review Authorization Architecture”Authentication answers:
Who are you?
Authorization answers:
What are you allowed to do?
Review whether authorization exists between:
User → ApplicationApplication → DataApplication → LLMRAG → DocumentsAgent → ToolsService → ServiceAuthorization Checklist
Section titled “Authorization Checklist”-
User roles defined
-
Data authorization enforced
-
RAG respects user access rights
-
API permissions scoped
-
Agent permissions restricted
-
Administrative operations protected
-
Authorization occurs outside model instructions
-
Authorization failures logged
Critical Architecture Principle
Section titled “Critical Architecture Principle”Never design:
User ↓LLM ↓"Decides whether user is allowed"Prefer:
User ↓Trusted Authorization Layer ↓Approved Data / Action ↓LLMThe model should not become the primary security boundary.
Phase 8 — Review Data Architecture
Section titled “Phase 8 — Review Data Architecture”Identify:
-
Data sources
-
Data owners
-
Data classifications
-
Storage locations
-
Processing locations
-
Retention
-
Data transfers
Review whether sensitive data enters:
-
Prompts
-
RAG
-
Logs
-
Model context
-
External AI providers
Data Architecture Checklist
Section titled “Data Architecture Checklist”-
Data inventory exists
-
Sensitive data identified
-
Data classification applied
-
Data minimization considered
-
Encryption in transit enabled
-
Encryption at rest enabled
-
Retention defined
-
Deletion process exists
-
Cross-border considerations reviewed where applicable
-
Third-party data handling reviewed
-
Logging avoids unnecessary sensitive data
Phase 9 — Review LLM Integration Architecture
Section titled “Phase 9 — Review LLM Integration Architecture”Understand how the application interacts with the model.
Example:
User Input ↓Application ↓Prompt Construction ↓LLM API ↓Model Output ↓Application Processing ↓UserReview:
-
Prompt construction
-
System instructions
-
Context
-
Input handling
-
Model outputs
-
Error handling
-
API credentials
-
Rate limits
LLM Architecture Checklist
Section titled “LLM Architecture Checklist”-
Model provider identified
-
Model purpose documented
-
Prompt flow documented
-
Model input classified
-
Model output treated as untrusted
-
Output validation defined
-
API credentials protected
-
Rate limits defined
-
Failure behavior defined
-
Sensitive actions not dependent solely on model output
Phase 10 — Review System Prompt Design
Section titled “Phase 10 — Review System Prompt Design”System prompts may contain:
-
Instructions
-
Business logic
-
Security guidance
-
Internal context
Do not assume system prompts can reliably act as strong access-control mechanisms.
Review:
-
Whether sensitive information is unnecessarily embedded
-
Whether secrets are embedded
-
Whether business rules rely entirely on prompt instructions
-
Whether application controls exist outside the prompt
System Prompt Checklist
Section titled “System Prompt Checklist”-
No credentials embedded
-
No unnecessary sensitive data embedded
-
Security boundaries enforced outside prompt
-
Prompt changes controlled
-
Prompt versions tracked where appropriate
Phase 11 — Review RAG Architecture
Section titled “Phase 11 — Review RAG Architecture”RAG commonly introduces:
Data Source ↓Ingestion ↓Processing ↓Embeddings ↓Vector Database ↓Retrieval ↓LLM ContextEvery stage needs review.
RAG Architecture Checklist
Section titled “RAG Architecture Checklist”Data Sources
Section titled “Data Sources”-
Approved sources identified
-
Data owners identified
-
Sensitive content classified
Ingestion
Section titled “Ingestion”-
Ingestion permissions restricted
-
Source validation exists
-
Changes logged
-
Malicious content considered
Vector Database
Section titled “Vector Database”-
Access restricted
-
Encryption enabled
-
Network exposure minimized
-
Backup and recovery considered
Retrieval
Section titled “Retrieval”-
User authorization enforced
-
Data segmentation implemented where required
-
Results filtered according to access
-
Retrieved content treated as untrusted
Critical RAG Principle
Section titled “Critical RAG Principle”Retrieval must not bypass the organization’s existing data permissions.
If a user cannot open a document directly, the AI assistant should not automatically provide its contents.
Phase 12 — Review AI Agent Architecture
Section titled “Phase 12 — Review AI Agent Architecture”Agents require special attention because they can move from:
Generate Information
to
Perform Actions
Example:
User │ ▼AI Agent │ ├── Email ├── Database ├── Cloud API ├── Ticketing └── Code RepositoryReview every connected tool.
Agent Architecture Checklist
Section titled “Agent Architecture Checklist”-
Agent purpose defined
-
Agent identity defined
-
Tools inventoried
-
Permissions documented
-
Least privilege applied
-
High-risk operations identified
-
Tool inputs validated
-
Tool outputs validated
-
Human approval defined
-
Action limits defined
-
Actions logged
-
Emergency disable capability exists
Agent Risk Tiering
Section titled “Agent Risk Tiering”Consider classifying agents.
Low Risk
Section titled “Low Risk”Read-only access to public or low-sensitivity information.
Medium Risk
Section titled “Medium Risk”Read access to internal information.
High Risk
Section titled “High Risk”Ability to modify enterprise systems.
Critical Risk
Section titled “Critical Risk”Ability to:
-
Change permissions
-
Execute production code
-
Transfer money
-
Delete critical data
-
Perform privileged administrative actions
Security controls should increase with agent capability.
Phase 13 — Review API Architecture
Section titled “Phase 13 — Review API Architecture”AI systems commonly depend on multiple APIs.
Review:
User ↓Application API ↓AI API ↓Data API ↓Tool APIAPI Architecture Checklist
Section titled “API Architecture Checklist”-
APIs inventoried
-
Authentication defined
-
Authorization defined
-
TLS used
-
Rate limiting implemented
-
Input validation defined
-
Error handling defined
-
Secrets protected
-
API logging enabled
-
Administrative APIs separated
-
Public exposure minimized
Phase 14 — Review Secrets Architecture
Section titled “Phase 14 — Review Secrets Architecture”Identify where secrets exist.
Examples:
-
LLM API keys
-
Cloud credentials
-
Database passwords
-
Service tokens
-
Certificates
Prefer:
Application ↓Managed Identity / Secret Store ↓Backend ServiceAvoid:
Source Code ↓Hardcoded API KeySecrets Checklist
Section titled “Secrets Checklist”-
Central secret management used
-
Hardcoded credentials prohibited
-
Short-lived credentials preferred
-
Secret access logged
-
Rotation supported
-
Environment separation implemented
-
Agent secret access minimized
Phase 15 — Review Cloud Architecture
Section titled “Phase 15 — Review Cloud Architecture”If the solution is cloud-hosted, review:
-
Accounts / subscriptions
-
IAM
-
Networks
-
Storage
-
Compute
-
Containers
-
Logging
-
Key management
-
Secrets
-
AI services
Cloud Security Checklist
Section titled “Cloud Security Checklist”-
Production environment separated
-
IAM least privilege applied
-
Network segmentation used
-
Public exposure minimized
-
Private connectivity considered
-
Encryption configured
-
Cloud audit logging enabled
-
Security monitoring enabled
-
Resource ownership defined
-
Backup and recovery defined
Phase 16 — Review Container & Kubernetes Architecture
Section titled “Phase 16 — Review Container & Kubernetes Architecture”If containers are used:
-
Trusted images
-
Image scanning
-
Minimal images
-
Non-root execution
-
Runtime permissions
-
Secrets
-
Resource limits
If Kubernetes is used:
-
RBAC
-
Workload identities
-
Network policies
-
Admission controls
-
Secrets
-
Pod security
-
Logging
Container / Kubernetes Checklist
Section titled “Container / Kubernetes Checklist”-
Trusted container registry used
-
Images scanned
-
Containers run with minimal privilege
-
Kubernetes RBAC reviewed
-
Workload identities separated
-
Network policies considered
-
Secrets managed appropriately
-
Resource limits configured
-
Audit logging enabled
Phase 17 — Review Network Architecture
Section titled “Phase 17 — Review Network Architecture”Understand network flows.
Example:
Internet ↓WAF ↓Application ↓Private AI Service ↓Private Data LayerReview:
-
Public endpoints
-
Private endpoints
-
Firewalls
-
Security groups
-
WAF
-
Egress restrictions
-
Service-to-service communication
Network Checklist
Section titled “Network Checklist”-
Public endpoints identified
-
Public exposure justified
-
Internal services private where possible
-
Inbound restrictions implemented
-
Outbound restrictions considered
-
TLS enforced
-
Administrative paths restricted
-
Network monitoring available
Phase 18 — Review Supply-Chain Architecture
Section titled “Phase 18 — Review Supply-Chain Architecture”Identify external dependencies.
Examples:
-
Models
-
Model repositories
-
Python packages
-
Container images
-
Plugins
-
Datasets
-
SaaS providers
-
AI APIs
Review trust relationships.
Supply-Chain Checklist
Section titled “Supply-Chain Checklist”-
Model source verified
-
Dependency sources approved
-
Container provenance verified
-
Third-party AI providers reviewed
-
Dataset provenance understood
-
Vulnerability scanning implemented
-
Update process controlled
-
Dependency inventory maintained
Phase 19 — Review Logging Architecture
Section titled “Phase 19 — Review Logging Architecture”Security architecture must include observability.
Potential logs:
Identity LogsApplication LogsAPI LogsLLM ActivityRAG Retrieval LogsAgent Tool LogsCloud Audit LogsInfrastructure LogsSecurity AlertsReview the path:
AI System ↓Logging ↓Central Log Platform ↓SIEM ↓Detection ↓SOCLogging Checklist
Section titled “Logging Checklist”-
Required log sources identified
-
Logs centralized
-
Agent actions logged
-
Authentication events logged
-
Authorization failures logged
-
RAG changes logged
-
Administrative changes logged
-
Sensitive data protected in logs
-
Retention defined
-
SOC access available
Phase 20 — Review Detection Architecture
Section titled “Phase 20 — Review Detection Architecture”Ask:
If someone abuses this AI system, how will we detect it?
Potential detections:
-
Repeated prompt abuse
-
Abnormal retrieval patterns
-
Excessive data access
-
Unusual agent actions
-
Credential misuse
-
Knowledge-source modification
-
Abnormal resource consumption
-
Suspicious administrative changes
Detection Checklist
Section titled “Detection Checklist”-
Important threat scenarios identified
-
Relevant telemetry available
-
Detection logic defined
-
Alerts routed to correct team
-
Escalation process defined
-
False-positive handling considered
Phase 21 — Review Incident Response Architecture
Section titled “Phase 21 — Review Incident Response Architecture”Architecture should support containment.
Ask:
If the AI system is compromised, what can we disable?
Possible controls:
Disable UserDisable AgentRevoke TokenRotate SecretBlock APIRemove Data SourceDisable ModelIsolate WorkloadRestrict NetworkIncident Response Checklist
Section titled “Incident Response Checklist”-
Users can be disabled
-
Agent identities can be disabled
-
Tokens can be revoked
-
Secrets can be rotated
-
Malicious data can be removed
-
Workloads can be isolated
-
Logs are retained
-
Response ownership defined
Phase 22 — Review Availability & Resilience
Section titled “Phase 22 — Review Availability & Resilience”AI systems may depend on:
-
External model providers
-
APIs
-
Vector databases
-
Cloud services
-
Internet connectivity
Review failure scenarios.
Example
Section titled “Example”Primary LLM Provider │ X │Application FailureAsk:
-
Is fallback required?
-
What happens when the model is unavailable?
-
What happens during high usage?
-
Are timeouts configured?
-
Are retry limits defined?
Resilience Checklist
Section titled “Resilience Checklist”-
Critical dependencies identified
-
Single points of failure identified
-
Timeouts defined
-
Retry behavior controlled
-
Resource limits defined
-
Backup strategy defined
-
Recovery procedures documented
-
Provider outage considered
Phase 23 — Review Privacy Architecture
Section titled “Phase 23 — Review Privacy Architecture”AI applications may process personal or confidential information.
Review:
-
What information enters prompts?
-
What is retained?
-
Who can retrieve it?
-
Is it used for model improvement?
-
Does it leave the organization?
Privacy Checklist
Section titled “Privacy Checklist”-
Personal data identified
-
Purpose defined
-
Data minimization applied
-
Retention defined
-
Third-party processing understood
-
User transparency considered
-
Privacy team involved where required
Phase 24 — Identify Threat Scenarios
Section titled “Phase 24 — Identify Threat Scenarios”Now challenge the architecture.
Potential scenarios:
Scenario 1 — Prompt Manipulation
Section titled “Scenario 1 — Prompt Manipulation”Can malicious instructions alter expected behavior?
Scenario 2 — RAG Poisoning
Section titled “Scenario 2 — RAG Poisoning”Can untrusted content influence responses?
Scenario 3 — Unauthorized Data Retrieval
Section titled “Scenario 3 — Unauthorized Data Retrieval”Can users access information outside their authorization?
Scenario 4 — Agent Abuse
Section titled “Scenario 4 — Agent Abuse”Can manipulation cause an agent to execute an unauthorized action?
Scenario 5 — Credential Theft
Section titled “Scenario 5 — Credential Theft”Could compromise expose API keys or service identities?
Scenario 6 — Supply-Chain Compromise
Section titled “Scenario 6 — Supply-Chain Compromise”Could a malicious model or dependency enter the environment?
Scenario 7 — Logging Failure
Section titled “Scenario 7 — Logging Failure”Could abuse occur without sufficient investigation evidence?
Threat Review Workflow
Section titled “Threat Review Workflow”Threat ↓Affected Component ↓Attack Path ↓Existing Control ↓Control Gap ↓Business Impact ↓Architecture RecommendationPhase 25 — Identify Architecture Security Gaps
Section titled “Phase 25 — Identify Architecture Security Gaps”A security architecture gap is different from a normal implementation bug.
Examples:
Weak Design
Section titled “Weak Design”AI Agent ↓Shared Administrator CredentialRecommended:
AI Agent ↓Dedicated Identity ↓Least PrivilegeWeak Authorization
Section titled “Weak Authorization”User ↓AI ↓All Enterprise DocumentsRecommended:
User ↓Authorization ↓Approved Documents ↓AIWeak Output Trust
Section titled “Weak Output Trust”LLM Output ↓Automatic ExecutionRecommended:
LLM Output ↓Validation ↓Policy Check ↓Human Approval if Required ↓ExecutionPhase 26 — Define Security Requirements
Section titled “Phase 26 — Define Security Requirements”Convert identified gaps into architecture requirements.
Use:
REQ-AI-001AI agent identities must use least privilege.
REQ-AI-002RAG retrieval must enforce source-system authorization.
REQ-AI-003LLM-generated actions must be validated before execution.
REQ-AI-004AI agent tool calls must be centrally logged.
REQ-AI-005Production API credentials must be stored in an approved secrets platform.Good requirements are:
-
Specific
-
Testable
-
Actionable
-
Assignable
Phase 27 — Prioritize Architecture Findings
Section titled “Phase 27 — Prioritize Architecture Findings”Classify findings based on:
-
Business impact
-
Data sensitivity
-
Exploitability
-
Privilege
-
User exposure
-
Existing controls
Example:
| ID | Architecture Finding | Priority |
|---|---|---|
| AR-01 | RAG bypasses source authorization | Critical |
| AR-02 | AI agent has broad write access | Critical |
| AR-03 | Model output executed without validation | High |
| AR-04 | AI activity not centrally logged | High |
| AR-05 | Public API lacks sufficient rate controls | Medium |
Phase 28 — Document Positive Controls
Section titled “Phase 28 — Document Positive Controls”Architecture reviews should not only identify weaknesses.
Record strong controls as well.
Examples:
-
Dedicated workload identities
-
Private networking
-
Central secrets management
-
RAG authorization
-
Human approval
-
Central logging
-
Container scanning
This provides a more accurate assessment.
Phase 29 — Determine Architecture Decision
Section titled “Phase 29 — Determine Architecture Decision”Possible decisions:
Approved
Section titled “Approved”No material security architecture gaps identified.
Approved with Conditions
Section titled “Approved with Conditions”Deployment may proceed if specified controls are completed.
Remediation Required
Section titled “Remediation Required”Major design changes are required before production.
Risk Acceptance Required
Section titled “Risk Acceptance Required”Known risks require formal business acceptance.
Not Approved
Section titled “Not Approved”Architecture presents unacceptable risk.
Architecture Decision Template
Section titled “Architecture Decision Template”# AI Security Architecture Decision
## System
## Business Owner
## Review Date
## Architecture Version
## Overall Security Assessment
## Critical Architecture Findings
## Required Security Controls
## Conditions for Production
## Residual Risks
## Security Recommendation
## Risk Owner
## Final DecisionPhase 30 — Track Architecture Actions
Section titled “Phase 30 — Track Architecture Actions”Create:
| Action | Owner | Priority | Target | Status |
|---|---|---|---|---|
| Implement RAG authorization | AI Team | Critical | TBD | Open |
| Restrict agent IAM role | Platform Team | Critical | TBD | Open |
| Enable centralized logging | SOC Team | High | TBD | In Progress |
Do not close the architecture review until required security actions are addressed or formally accepted.
Evidence to Retain
Section titled “Evidence to Retain”Maintain:
-
Architecture diagrams
-
Data flow diagrams
-
Threat models
-
IAM design
-
Network design
-
Data classification
-
Security requirements
-
Meeting decisions
-
Risk decisions
-
Validation evidence
-
Final approval
Recommended Review Package
Section titled “Recommended Review Package”AI-Security-Architecture-Review/│├── 01-Business-Requirements.md├── 02-Architecture.md├── 03-Data-Flows.md├── 04-Asset-Inventory.md├── 05-Trust-Boundaries.md├── 06-Threat-Model.md├── 07-Security-Requirements.md├── 08-Architecture-Findings.md├── 09-Action-Register.md├── 10-Architecture-Decision.md│└── Evidence/ ├── IAM/ ├── Data/ ├── RAG/ ├── Agents/ ├── APIs/ ├── Cloud/ ├── Network/ └── Logging/Master Architecture Review Checklist
Section titled “Master Architecture Review Checklist”Business
Section titled “Business”-
Use case understood
-
Owner identified
-
Criticality defined
Architecture
Section titled “Architecture”-
Architecture reviewed
-
Components inventoried
-
Data flows mapped
-
Trust boundaries identified
Identity
Section titled “Identity”-
User authentication reviewed
-
Service identities reviewed
-
Agent identities reviewed
-
Least privilege applied
Authorization
Section titled “Authorization”-
Data access controlled
-
RAG authorization enforced
-
Agent actions authorized
-
LLM not used as primary authorization control
-
Sensitive data identified
-
Encryption reviewed
-
Retention reviewed
-
Third-party transfers reviewed
-
Integration reviewed
-
Output treated as untrusted
-
High-risk actions validated
-
Sources approved
-
Ingestion controlled
-
Retrieval authorized
-
Vector store secured
Agents
Section titled “Agents”-
Tools inventoried
-
Permissions restricted
-
Human approval considered
-
Actions logged
-
Authentication defined
-
Authorization defined
-
Rate limiting considered
-
Secrets protected
-
IAM reviewed
-
Network segmentation reviewed
-
Public exposure minimized
-
Logging enabled
Containers / Kubernetes
Section titled “Containers / Kubernetes”-
Images trusted
-
Privileges minimized
-
RBAC reviewed
-
Secrets protected
Supply Chain
Section titled “Supply Chain”-
Models trusted
-
Dependencies reviewed
-
Third parties assessed
Logging
Section titled “Logging”-
Security telemetry defined
-
Central logging available
-
Sensitive log data protected
Detection
Section titled “Detection”-
Abuse scenarios mapped
-
Detection opportunities identified
-
SOC ownership established
Response
Section titled “Response”-
Containment options available
-
Agent disable capability exists
-
Credentials can be revoked
Resilience
Section titled “Resilience”-
Dependencies identified
-
Failure behavior defined
-
Recovery considered
Governance
Section titled “Governance”-
Privacy reviewed
-
Risk reviewed
-
Human oversight defined
Decision
Section titled “Decision”-
Findings documented
-
Security requirements created
-
Owners assigned
-
Production conditions documented
-
Final decision recorded
Common Architecture Review Mistakes
Section titled “Common Architecture Review Mistakes”Reviewing Only the LLM
Section titled “Reviewing Only the LLM”The LLM is one component.
Architecture review must include:
Identity+Data+Application+API+RAG+Agent+Cloud+Network+OperationsTreating Prompt Instructions as Security Controls
Section titled “Treating Prompt Instructions as Security Controls”Prompt instructions may influence model behavior.
They should not replace trusted controls such as authorization.
Ignoring Data Flows
Section titled “Ignoring Data Flows”If you do not know where information travels, you cannot reliably determine where it may leak.
Ignoring AI Agents
Section titled “Ignoring AI Agents”An AI system that can take actions introduces significantly different risk from a simple chatbot.
Ignoring Operations
Section titled “Ignoring Operations”Architecture must support:
-
Logging
-
Detection
-
Investigation
-
Containment
-
Recovery
Reviewing Too Late
Section titled “Reviewing Too Late”Architecture review provides the most value before major engineering decisions become difficult to change.
Architecture Review Mindset
Section titled “Architecture Review Mindset”For every component, ask:
Why Does It Exist? ↓What Does It Access? ↓Who Can Access It? ↓What Trusts It? ↓What Does It Trust? ↓What Could Manipulate It? ↓What Happens If It Is Compromised? ↓What Prevents That? ↓How Would We Detect It? ↓How Would We Contain It?This thought process is more important than memorizing a checklist.
Runbook Completion Criteria
Section titled “Runbook Completion Criteria”The review is complete when:
-
Business context is understood.
-
Architecture is documented.
-
Data flows are mapped.
-
Trust boundaries are documented.
-
Critical assets are identified.
-
Identity is reviewed.
-
Authorization is reviewed.
-
Data security is reviewed.
-
LLM integration is reviewed.
-
RAG is reviewed.
-
AI agents are reviewed.
-
APIs are reviewed.
-
Cloud and infrastructure are reviewed.
-
Network security is reviewed.
-
Supply-chain risks are reviewed.
-
Logging is reviewed.
-
Detection is reviewed.
-
Incident response is reviewed.
-
Resilience is reviewed.
-
Threat scenarios are documented.
-
Architecture gaps are identified.
-
Security requirements are defined.
-
Findings are prioritized.
-
Owners are assigned.
-
Architecture decision is documented.
Security Engineer Takeaway
Section titled “Security Engineer Takeaway”The purpose of security architecture is not to make an AI system impossible to attack.
The purpose is to design the system so that:
Security Boundaries Are Clear
Access Is Restricted
Sensitive Data Is Protected
AI Capabilities Are Controlled
Failures Are Contained
Suspicious Activity Is Visible
Incidents Can Be Investigated
Risk Is UnderstoodThe earlier these principles are incorporated into architecture, the stronger and easier the system becomes to secure.
Runbook Complete
Section titled “Runbook Complete”You have completed:
Runbook 02 — Enterprise AI Security Architecture Review
You now have a structured methodology for reviewing an AI solution before production and translating security concerns into concrete architecture requirements.
This completes the practical assessment and architecture-review foundation for Module 01 — AI Security Foundations.
What’s Next?
Section titled “What’s Next?”➡️ Module 02 — LLM Security
You now understand the foundations required to assess AI systems, including:
- Enterprise AI architecture
- AI attack surfaces
- AI threat identification
- OWASP and MITRE ATLAS mapping
- AI security assessments
- Enterprise AI security architecture reviews
The next module focuses on one of the most important areas in modern AI Security Engineering:
Securing applications built with Large Language Models.
You will learn how LLM-enabled applications can be attacked, abused, misconfigured and manipulated, and how security engineers assess and defend these systems.
In the next module, you will explore:
- LLM security fundamentals
- Prompt injection
- Indirect prompt injection
- Jailbreaking and safety bypass
- Sensitive information disclosure
- Insecure output handling
- RAG security
- Vector database security
- AI agent and tool security
- Model and data poisoning
- Excessive agency
- Enterprise LLM security architecture
You will also complete practical labs where you will analyze and test LLM applications inside authorized environments.
The goal is to move from:
“I understand AI security risks.”
to:
“I can identify, assess and help secure real LLM-enabled applications.”
➡️ Next Module: 02 — LLM Security