Runbook 01 Security Control Assessment & Evidence Collection
Runbook Information
Section titled “Runbook Information”| Item | Details |
|---|---|
| Runbook | 01 — Security Control Assessment & Evidence Collection |
| Module | 01 — GRC Fundamentals |
| Difficulty | Intermediate |
| Estimated Time | 90–120 Minutes |
| Primary Role | GRC Analyst / Control Assessor |
| Supporting Roles | Control Owner, Internal Audit, Security, Compliance |
| Primary Output | Control Assessment Record & Evidence Package |
| Runbook Type | Operational GRC Procedure |
Purpose
Section titled “Purpose”This runbook provides a repeatable process for assessing enterprise security controls and collecting sufficient evidence to determine whether controls are:
Designed Appropriately +Implemented +Operating Consistently =Effective ControlThe procedure can support:
-
Internal control assessments.
-
Compliance reviews.
-
Certification programs.
-
Internal audits.
-
External audits.
-
Customer assurance.
-
Risk assessments.
-
Continuous control monitoring.
The objective is not simply to collect documents.
The objective is to answer:
Does the control actually reduce the intended risk, and can we demonstrate that conclusion with reliable evidence?
Runbook Outcomes
Section titled “Runbook Outcomes”After following this runbook, the assessor should be able to produce:
-
Defined control scope.
-
Confirmed control ownership.
-
Control design assessment.
-
Evidence request.
-
Evidence inventory.
-
Population validation.
-
Sampling methodology.
-
Test procedures.
-
Test results.
-
Exceptions.
-
Effectiveness conclusion.
-
Findings.
-
Remediation actions.
-
Retest results.
-
Final control status.
Operational Workflow
Section titled “Operational Workflow”Control Selected ↓Understand Requirement ↓Confirm Scope ↓Identify Owner ↓Understand Control Design ↓Define Evidence ↓Request Evidence ↓Validate Evidence ↓Validate Population ↓Select Samples ↓Test Design ↓Test Operating Effectiveness ↓Document Exceptions ↓Determine Control Effectiveness ↓Create Finding ↓Remediation ↓Retest ↓Close / Continue MonitoringPhase 1 — Initiate the Assessment
Section titled “Phase 1 — Initiate the Assessment”Step 1 — Identify the Control
Section titled “Step 1 — Identify the Control”Start with the control being assessed.
Example:
Control ID:IAM-010
Control Name:Quarterly Privileged Access Review
Control Objective:Ensure privileged access remains appropriate and authorized.
Frequency:Quarterly
Control Owner:IAM ManagerRecord the authoritative control definition.
Do not begin testing using only an auditor request or informal description.
Step 2 — Identify the Requirement
Section titled “Step 2 — Identify the Requirement”Determine why the control exists.
The control may support:
-
Enterprise risk treatment.
-
Internal policy.
-
Regulatory requirement.
-
Contractual obligation.
-
Security framework.
-
Audit requirement.
Example:
Risk ↓Unauthorized Privileged Access
Policy ↓Access Control Policy
Control ↓IAM-010 Quarterly Privileged Access Review
Evidence ↓Completed Access ReviewsThis establishes traceability.
Step 3 — Identify Framework Mappings
Section titled “Step 3 — Identify Framework Mappings”One control may satisfy multiple requirements.
Example:
IAM-010 │ ├── ISO/IEC 27001 ├── SOC 2 ├── PCI DSS ├── NIST └── Internal PolicyRecord applicable mappings in the assessment record.
This allows the same testing to support multiple assurance activities.
Phase 2 — Confirm Assessment Scope
Section titled “Phase 2 — Confirm Assessment Scope”Step 4 — Define the Scope
Section titled “Step 4 — Define the Scope”Document exactly what is being assessed.
For IAM-010:
Systems:Production Applications
Accounts:Privileged Accounts
Business Units:All
Locations:Global
Assessment Period:Q2 2026
Control Frequency:QuarterlyScope should be precise enough that another assessor can reproduce the test.
Step 5 — Define Out-of-Scope Items
Section titled “Step 5 — Define Out-of-Scope Items”Document exclusions.
Example:
Excluded:
Development sandbox accounts
Non-production test identities
Service accounts governed by IAM-011Every material exclusion should have a reason.
Step 6 — Validate Scope
Section titled “Step 6 — Validate Scope”Confirm scope with:
-
Control owner.
-
System owner.
-
Compliance team.
-
Relevant policy documentation.
Ask:
Does this scope represent the complete population subject to the control?
This question is critical.
Incomplete scope can make otherwise good testing unreliable.
Phase 3 — Identify Control Ownership
Section titled “Phase 3 — Identify Control Ownership”Step 7 — Identify the Control Owner
Section titled “Step 7 — Identify the Control Owner”Every control should have an accountable owner.
Record:
Control Owner:IAM Manager
Business Function:Identity & Access Management
Evidence Provider:IAM Operations Analyst
Escalation:Director of Security EngineeringStep 8 — Distinguish Control Owner From Evidence Provider
Section titled “Step 8 — Distinguish Control Owner From Evidence Provider”These are not necessarily the same person.
Control Owner ↓Accountable for Control
Evidence Provider ↓Provides Supporting EvidenceAn analyst exporting a report does not automatically own the control.
Step 9 — Confirm Responsibilities
Section titled “Step 9 — Confirm Responsibilities”Ask the control owner:
-
What does the control do?
-
Why does it exist?
-
Who performs it?
-
How frequently?
-
Which systems are included?
-
What happens when exceptions are found?
-
Where is evidence retained?
-
Has the control changed recently?
Document important responses.
Phase 4 — Understand the Control Design
Section titled “Phase 4 — Understand the Control Design”Step 10 — Determine Control Type
Section titled “Step 10 — Determine Control Type”Classify the control.
Preventive
Section titled “Preventive”Stops an event.
MFAFirewallDeployment PolicyDetective
Section titled “Detective”Identifies an event.
SIEM AlertAccess ReviewVulnerability ScanCorrective
Section titled “Corrective”Restores or remediates.
Account DisablementPatch DeploymentBackup RestorationFor IAM-010:
Type:DetectiveStep 11 — Determine Control Method
Section titled “Step 11 — Determine Control Method”Classify as:
Manual
Automated
IT-Dependent Manual
HybridIAM-010 might be:
IT-Dependent Manualbecause a system generates the access population while managers manually review access.
Step 12 — Determine Frequency
Section titled “Step 12 — Determine Frequency”Examples:
Continuous
Daily
Weekly
Monthly
Quarterly
Annual
Event DrivenFrequency affects testing methodology.
Step 13 — Evaluate Control Design
Section titled “Step 13 — Evaluate Control Design”Ask:
If this control operates exactly as designed, could it reasonably achieve its objective?
For example:
Control:Quarterly privileged access review
Process:IAM generates privileged account list.
Managers review access.
Unnecessary access is identified.
IAM removes access.
Completion is recorded.This appears capable of addressing inappropriate privileged access.
Therefore:
Design:AdequatePhase 5 — Define Evidence Requirements
Section titled “Phase 5 — Define Evidence Requirements”Step 14 — Determine Required Evidence
Section titled “Step 14 — Determine Required Evidence”Do this before requesting documents.
For IAM-010, evidence may include:
Access Review Procedure
Privileged Account Population
Review Campaign Export
Reviewer Decisions
Access Removal Tickets
Completion Report
Exception RecordsStep 15 — Create the Evidence Request
Section titled “Step 15 — Create the Evidence Request”Create an evidence request record.
Example:
| Field | Value |
|---|---|
| Request ID | EVD-001 |
| Control | IAM-010 |
| Evidence | Q2 Privileged Access Review |
| Period | Apr–Jun 2026 |
| Owner | IAM |
| Requested | 10 Jul 2026 |
| Due | 17 Jul 2026 |
| Status | Open |
Step 16 — Write Precise Evidence Requests
Section titled “Step 16 — Write Precise Evidence Requests”Avoid:
Please send access-review evidence.
Use:
Provide the complete Q2 2026 privileged access population, completed reviewer decisions, review completion report, and evidence of access removal for users identified as no longer requiring privileged access.
Precise requests reduce unnecessary back-and-forth.
Phase 6 — Collect Evidence
Section titled “Phase 6 — Collect Evidence”Step 17 — Receive Evidence
Section titled “Step 17 — Receive Evidence”When evidence arrives, record:
Evidence ID
Document Name
Source
Owner
Period Covered
Date Received
Assessment StatusNever rely on your inbox as the evidence repository.
Step 18 — Store Evidence
Section titled “Step 18 — Store Evidence”Use a structured repository.
Example:
IAM-010│├── 2026-Q1│├── 2026-Q2│ ├── Population│ ├── Review Results│ ├── Removal Tickets│ └── Assessment│├── 2026-Q3└── 2026-Q4Evidence should be easy to retrieve later.
Phase 7 — Validate Evidence Quality
Section titled “Phase 7 — Validate Evidence Quality”Step 19 — Validate Relevance
Section titled “Step 19 — Validate Relevance”Ask:
Does this evidence actually demonstrate the control being tested?
A security policy may describe the requirement.
It does not prove the quarterly access review occurred.
Step 20 — Validate Period
Section titled “Step 20 — Validate Period”Confirm that evidence covers the assessment period.
Example:
Assessment:Q2 2026
Evidence:Q4 2025
Result:Not sufficient for Q2 operating-effectiveness testing.Step 21 — Validate Authenticity
Section titled “Step 21 — Validate Authenticity”Consider:
-
Source system.
-
Evidence provider.
-
Metadata.
-
Export date.
-
System-generated characteristics.
-
Whether evidence appears manually altered.
Evidence directly generated from authoritative systems generally provides stronger assurance than manually prepared summaries.
Step 22 — Validate Completeness
Section titled “Step 22 — Validate Completeness”Ask:
Is this the complete evidence set?
Example:
The control owner provides:
Completed Review Spreadsheetbut no evidence showing how the account population was generated.
You may not know whether the review covered all privileged accounts.
That creates a completeness problem.
Phase 8 — Validate the Population
Section titled “Phase 8 — Validate the Population”Step 23 — Define the Population
Section titled “Step 23 — Define the Population”A population is the complete set of items subject to testing.
Example:
Control:Quarterly Privileged Access Review
Population:All privileged accounts included in the Q2 review.Step 24 — Obtain Population Evidence
Section titled “Step 24 — Obtain Population Evidence”Request:
System-generated privileged account export
Generation date
Filters used
Systems included
Total account countSuppose:
Total Population:487 Privileged AccountsStep 25 — Validate Population Completeness
Section titled “Step 25 — Validate Population Completeness”Possible procedures:
-
Compare against source-system totals.
-
Reconcile multiple systems.
-
Review report parameters.
-
Compare with prior periods.
-
Confirm excluded account types.
-
Interview system administrator.
Do not sample from a population you cannot reasonably trust.
Phase 9 — Determine Sampling Methodology
Section titled “Phase 9 — Determine Sampling Methodology”Step 26 — Decide Whether Sampling Is Required
Section titled “Step 26 — Decide Whether Sampling Is Required”Some controls can be tested using the entire population.
Examples:
Automated MFA Configuration
Encryption Configuration
Centralized Logging SettingManual controls may require sampling.
Examples:
Access Approvals
Change Approvals
Vendor Reviews
Termination ProcessingStep 27 — Define Sample Size
Section titled “Step 27 — Define Sample Size”Sample size should consider:
-
Population size.
-
Control frequency.
-
Risk.
-
Testing objective.
-
Applicable audit methodology.
-
Prior findings.
Do not invent a universal sample size.
Document the methodology used.
Step 28 — Select Samples
Section titled “Step 28 — Select Samples”Suppose:
Population:487
Selected Samples:25Record each selected item.
| Sample | Account | Reviewer | Result |
|---|---|---|---|
| 01 | Admin-A | Manager 1 | Pending |
| 02 | Admin-B | Manager 2 | Pending |
| 03 | Admin-C | Manager 3 | Pending |
Selection should be reproducible.
Phase 10 — Test Control Design
Section titled “Phase 10 — Test Control Design”Step 29 — Perform Design Effectiveness Testing
Section titled “Step 29 — Perform Design Effectiveness Testing”Verify:
-
Control objective is clear.
-
Control addresses the relevant risk.
-
Responsible roles are defined.
-
Frequency is appropriate.
-
Population is defined.
-
Exceptions are handled.
-
Evidence is retained.
Document:
Design Effectiveness:Effectiveor:
Design Effectiveness:IneffectiveStep 30 — Design Failure Example
Section titled “Step 30 — Design Failure Example”Policy says:
Privileged access must be reviewed quarterly.
Actual procedure says:
Review selected critical systems annually.Even if the annual review occurs perfectly, the control design does not satisfy the stated requirement.
Result:
Design FailurePhase 11 — Test Operating Effectiveness
Section titled “Phase 11 — Test Operating Effectiveness”Step 31 — Define the Test Procedure
Section titled “Step 31 — Define the Test Procedure”For each sample, verify:
Account existed in population.
Correct reviewer performed review.
Review occurred during required period.
Decision was documented.
Inappropriate access was removed.
Removal occurred within required timeframe.Step 32 — Execute Testing
Section titled “Step 32 — Execute Testing”Example:
| Sample | Reviewed | Authorized | Timely | Result |
|---|---|---|---|---|
| 01 | Yes | Yes | Yes | Pass |
| 02 | Yes | Yes | Yes | Pass |
| 03 | Yes | No | No | Exception |
| 04 | Yes | Yes | Yes | Pass |
Document exactly what was tested.
Step 33 — Preserve Testing Evidence
Section titled “Step 33 — Preserve Testing Evidence”Maintain:
Sample Selected
Evidence Reviewed
Test Procedure
Test Result
Assessor Notes
Exception ReferenceAnother qualified assessor should be able to understand how you reached your conclusion.
Phase 12 — Handle Exceptions
Section titled “Phase 12 — Handle Exceptions”Step 34 — Identify an Exception
Section titled “Step 34 — Identify an Exception”Suppose:
Sample 03
User:Former Infrastructure Administrator
Review Decision:Remove Access
Actual Removal:18 Days After Review
Requirement:5 Business DaysThis is an exception.
Step 35 — Validate the Exception
Section titled “Step 35 — Validate the Exception”Before creating a finding:
-
Confirm evidence.
-
Confirm requirement.
-
Ask control owner for context.
-
Determine whether compensating controls existed.
-
Determine whether this is isolated or systemic.
Do not assume every unusual result is automatically a control failure.
Step 36 — Expand Testing if Required
Section titled “Step 36 — Expand Testing if Required”If one sample fails, determine whether additional testing is appropriate.
Example:
Original Sample:25
Exceptions:3
Decision:Expand TestingExpanded testing may help determine whether the issue is isolated or systemic.
Phase 13 — Determine Control Effectiveness
Section titled “Phase 13 — Determine Control Effectiveness”Step 37 — Use Standard Ratings
Section titled “Step 37 — Use Standard Ratings”Use:
Effective
Partially Effective
Ineffective
Not TestedStep 38 — Effective
Section titled “Step 38 — Effective”A control may be Effective when:
-
Design is appropriate.
-
Control operates consistently.
-
Evidence is sufficient.
-
No material exceptions exist.
Step 39 — Partially Effective
Section titled “Step 39 — Partially Effective”Example:
25 Samples
22 Pass
3 ExceptionsThe control operates but has meaningful weaknesses.
Depending on severity and methodology:
Partially Effectivemay be appropriate.
Step 40 — Ineffective
Section titled “Step 40 — Ineffective”A control may be Ineffective where:
-
Design does not address the objective.
-
Control is not performed.
-
Exceptions are widespread.
-
Evidence is unreliable.
-
Material failures exist.
Phase 14 — Create the Finding
Section titled “Phase 14 — Create the Finding”Step 41 — Document Finding Structure
Section titled “Step 41 — Document Finding Structure”Use:
Finding ID
Title
Condition
Criteria
Cause
Risk / Impact
Severity
Owner
Recommendation
Target DateStep 42 — Example Finding
Section titled “Step 42 — Example Finding”Finding ID:FND-001
Title:Delayed Removal of Privileged Access
Condition:Three sampled privileged accounts identified for removal remained active beyond the required five-business-day remediation period.
Criteria:IAM-010 requires inappropriate privileged access to be removed within five business days.
Cause:Access-removal tickets are manually assigned and are not automatically escalated when overdue.
Risk:Users may retain unnecessary privileged access, increasing the likelihood of unauthorized administrative activity.
Severity:HighPhase 15 — Perform Root Cause Analysis
Section titled “Phase 15 — Perform Root Cause Analysis”Step 43 — Identify the Root Cause
Section titled “Step 43 — Identify the Root Cause”Do not stop at:
Team forgot.Ask why.
Example:
Access removal delayed ↓Ticket not actioned ↓No automated escalation ↓No SLA monitoring ↓Process design weaknessThis is more actionable.
Step 44 — Root Cause Categories
Section titled “Step 44 — Root Cause Categories”Common categories include:
People
Process
Technology
Governance
Training
Resource Constraint
Unclear Ownership
Automation GapRoot-cause analysis improves remediation quality.
Phase 16 — Define Remediation
Section titled “Phase 16 — Define Remediation”Step 45 — Develop Remediation Action
Section titled “Step 45 — Develop Remediation Action”Weak:
IAM team will improve the process.
Better:
Configure automated SLA monitoring and escalation for privileged-access removal tickets and produce a weekly overdue-access report reviewed by the IAM Manager.
Step 46 — Assign Ownership
Section titled “Step 46 — Assign Ownership”Record:
Finding Owner:IAM Manager
Remediation Owner:IAM Operations Lead
Target Date:30 September 2026The responsible party must be clear.
Step 47 — Define Closure Evidence
Section titled “Step 47 — Define Closure Evidence”Before remediation begins, define what will prove completion.
Example:
Updated Procedure
Workflow Configuration
SLA Escalation Screenshot
Overdue Report
Implementation Ticket
Post-Implementation SampleThis prevents ambiguous closure decisions.
Phase 17 — Track Remediation
Section titled “Phase 17 — Track Remediation”Step 48 — Create the Remediation Record
Section titled “Step 48 — Create the Remediation Record”| Field | Value |
|---|---|
| Finding | FND-001 |
| Severity | High |
| Owner | IAM Manager |
| Action | Automate escalation |
| Due | 30 Sep 2026 |
| Status | In Progress |
| Retest Required | Yes |
Step 49 — Monitor Status
Section titled “Step 49 — Monitor Status”Use standardized statuses:
Open
Remediation Planned
In Progress
Pending Validation
Closed
Risk AcceptedAvoid informal status labels.
Step 50 — Escalate Overdue Findings
Section titled “Step 50 — Escalate Overdue Findings”Example:
High Finding +Past Due +No Approved Extension ↓EscalationEscalation may go to:
-
Security leadership.
-
Compliance leadership.
-
Risk committee.
-
Executive management.
based on severity.
Phase 18 — Retest
Section titled “Phase 18 — Retest”Step 51 — Obtain Closure Evidence
Section titled “Step 51 — Obtain Closure Evidence”When the owner reports completion:
Do not close the finding immediately.
Obtain the agreed evidence.
Step 52 — Validate Implementation
Section titled “Step 52 — Validate Implementation”Verify:
-
New process exists.
-
Configuration is active.
-
Required personnel understand it.
-
Control documentation was updated.
Step 53 — Test Operating Effectiveness
Section titled “Step 53 — Test Operating Effectiveness”Where appropriate, test transactions after remediation.
Example:
Post-Remediation Population:Recent privileged removals
Sample:10
Result:10 completed within SLAThis provides stronger closure evidence.
Step 54 — Determine Retest Result
Section titled “Step 54 — Determine Retest Result”Possible results:
Pass
Partial
FailRemediation operates effectively.
Partial
Section titled “Partial”Some issues remain.
Remediation does not adequately address the finding.
Phase 19 — Close the Finding
Section titled “Phase 19 — Close the Finding”Step 55 — Document Closure
Section titled “Step 55 — Document Closure”Record:
Finding:FND-001
Remediation:Implemented
Retest:Passed
Closure Date:15 October 2026
Closed By:GRC Control Assessor
Final Status:ClosedRetain closure evidence.
Phase 20 — Evidence Handling Standards
Section titled “Phase 20 — Evidence Handling Standards”Evidence should satisfy several characteristics.
Relevant
Section titled “Relevant”It directly supports the control being tested.
Reliable
Section titled “Reliable”It comes from a trustworthy source.
Complete
Section titled “Complete”It covers the required population or scope.
Accurate
Section titled “Accurate”It correctly represents the underlying activity.
Timely
Section titled “Timely”It relates to the correct assessment period.
Reproducible
Section titled “Reproducible”Another assessor can understand and repeat the procedure.
A useful model is:
Evidence Quality =Relevant+Reliable+Complete+Accurate+TimelyPhase 21 — Evidence Hierarchy
Section titled “Phase 21 — Evidence Hierarchy”Evidence strength may vary.
Generally, stronger evidence includes:
Direct System Observation
System-Generated Configuration
System-Generated Logs
Independent Assurance
Approved Records
Screenshots
Manual Statements
Verbal ConfirmationThe exact reliability depends on context.
A verbal statement alone is usually weaker than independently verifiable system evidence.
Phase 22 — Screenshot Evidence
Section titled “Phase 22 — Screenshot Evidence”Screenshots may be useful but have limitations.
A screenshot might show:
MFA = Enabledbut may not demonstrate:
-
Complete user coverage.
-
Historical operation.
-
Exceptions.
-
Configuration changes.
Whenever practical, prefer structured system-generated evidence.
Phase 23 — Evidence Freshness
Section titled “Phase 23 — Evidence Freshness”Check:
Evidence Date ↓Assessment PeriodDo not use stale evidence for current control conclusions without appropriate justification.
Phase 24 — Evidence Naming Convention
Section titled “Phase 24 — Evidence Naming Convention”Use consistent naming.
Example:
IAM-010_2026Q2_PrivilegedPopulation.csv
IAM-010_2026Q2_ReviewResults.xlsx
IAM-010_2026Q2_RemovalTickets.pdfAvoid:
final.xlsx
final2.xlsx
new-final.xlsx
audit-stuff.pdfGood naming improves audit readiness.
Phase 25 — Evidence Index
Section titled “Phase 25 — Evidence Index”Maintain:
| Evidence ID | Control | Description | Period | Source |
|---|---|---|---|---|
| EVD-001 | IAM-010 | Privileged population | Q2 | IAM |
| EVD-002 | IAM-010 | Review results | Q2 | IAM |
| EVD-003 | IAM-010 | Removal tickets | Q2 | ITSM |
The evidence index creates traceability.
Phase 26 — Assessment Workpaper
Section titled “Phase 26 — Assessment Workpaper”Create a standardized assessment workpaper.
Include:
Assessment ID
Control ID
Control Name
Control Objective
Control Owner
Assessment Period
Scope
Control Type
Frequency
Evidence Reviewed
Population
Sampling Method
Sample Size
Test Procedure
Test Results
Exceptions
Design Effectiveness
Operating Effectiveness
Overall Conclusion
Assessor
Review DateThis becomes the official assessment record.
Phase 27 — Example Assessment Conclusion
Section titled “Phase 27 — Example Assessment Conclusion”Example:
IAM-010 is appropriately designed to identify unnecessary privileged access through quarterly management review. Testing of 25 samples identified three instances where access approved for removal was not revoked within the required five-business-day timeframe. The control is therefore assessed as Partially Effective. A High-severity finding has been issued to improve access-removal SLA monitoring and escalation.
This is clearer than:
Control failed.Phase 28 — Evidence Request Tracker
Section titled “Phase 28 — Evidence Request Tracker”For larger assessments, maintain:
| Request | Control | Owner | Due | Status |
|---|---|---|---|---|
| REQ-001 | IAM-010 | IAM | 17 Jul | Received |
| REQ-002 | LOG-001 | SOC | 18 Jul | Open |
| REQ-003 | VUL-004 | VM Team | 20 Jul | Overdue |
This prevents evidence requests from disappearing across email threads.
Phase 29 — Evidence Escalation
Section titled “Phase 29 — Evidence Escalation”Use a predictable process.
Example:
Evidence Requested ↓Due Date ↓Reminder ↓Overdue ↓Control Owner Escalation ↓Management EscalationGRC should avoid creating unnecessary friction while still enforcing assessment timelines.
Phase 30 — Evidence Reuse
Section titled “Phase 30 — Evidence Reuse”Before requesting evidence, check whether suitable current evidence already exists.
Example:
IAM-010 Evidence ↓Internal Assessment ↓SOC 2 ↓ISO 27001 ↓Customer AssuranceOne authoritative evidence set may support several requirements.
This reduces audit fatigue.
Phase 31 — Automated Controls
Section titled “Phase 31 — Automated Controls”For automated controls, assess:
Configuration
Logic
Change Management
System Reliability
Exceptions
MonitoringExample:
Control:Block public cloud storage.
Implementation:Policy-as-Code Rule
Testing:Inspect policy configuration+Attempt prohibited deployment+Review enforcement logsTesting should verify the automation rather than merely reading the policy.
Phase 32 — Manual Controls
Section titled “Phase 32 — Manual Controls”For manual controls, assess:
Responsible Person
Frequency
Population
Evidence
Reviewer Competence
Approval
Follow-UpManual controls often require stronger evidence of consistent execution.
Phase 33 — IT-Dependent Manual Controls
Section titled “Phase 33 — IT-Dependent Manual Controls”Example:
System Generates Report ↓Manager Reviews Report ↓Manager Records DecisionYou may need to assess both:
-
Reliability of the system-generated report.
-
Effectiveness of the human review.
If the report is incomplete, the manual review may also be ineffective.
Phase 34 — Continuous Controls
Section titled “Phase 34 — Continuous Controls”Some controls operate continuously.
Examples:
-
Endpoint protection.
-
Firewall enforcement.
-
Cloud policy.
-
Security monitoring.
Testing may involve:
Configuration Review
Alert Review
Log Analysis
Exception Review
Change HistoryThe testing method should match the control.
Phase 35 — Evidence Security
Section titled “Phase 35 — Evidence Security”Evidence may contain:
-
Employee information.
-
System configuration.
-
Security findings.
-
Vulnerability details.
-
Customer data.
-
Privileged-account information.
Protect evidence using:
Access Control
Encryption
Retention Rules
Secure Sharing
Need-to-Know AccessGRC evidence repositories themselves require security.
Phase 36 — Evidence Retention
Section titled “Phase 36 — Evidence Retention”Define retention based on:
-
Regulation.
-
Certification requirements.
-
Contract.
-
Audit requirements.
-
Corporate retention policy.
Do not retain sensitive evidence indefinitely without purpose.
Phase 37 — Control Assessment Status
Section titled “Phase 37 — Control Assessment Status”Use:
Not Started
Planning
Evidence Collection
Testing
Finding Review
Remediation
Retesting
CompletedThis enables portfolio-level tracking.
Phase 38 — Control Assessment Dashboard
Section titled “Phase 38 — Control Assessment Dashboard”Example:
| Metric | Count |
|---|---|
| Controls in Scope | 125 |
| Testing Complete | 94 |
| Effective | 76 |
| Partially Effective | 14 |
| Ineffective | 4 |
| Evidence Overdue | 12 |
| Open Findings | 18 |
Dashboards should help management identify areas requiring attention.
Phase 39 — Control Health
Section titled “Phase 39 — Control Health”A simple control-health model can combine:
Design +Operating Effectiveness +Open Findings +Evidence Freshness =Control HealthPossible statuses:
Healthy
Needs Attention
Weak
UnknownDo not use control-health scores without clearly defined criteria.
Phase 40 — Common Mistakes
Section titled “Phase 40 — Common Mistakes”Mistake 1 — Collecting Evidence Without a Test Objective
Section titled “Mistake 1 — Collecting Evidence Without a Test Objective”Always know what the evidence is supposed to prove.
Mistake 2 — Accepting Policies as Operating Evidence
Section titled “Mistake 2 — Accepting Policies as Operating Evidence”Policy tells you what should happen.
It does not necessarily prove what happened.
Mistake 3 — Ignoring Population Completeness
Section titled “Mistake 3 — Ignoring Population Completeness”A perfect sample from an incomplete population can produce a false conclusion.
Mistake 4 — Testing Only One Transaction
Section titled “Mistake 4 — Testing Only One Transaction”A single successful example rarely demonstrates consistent operation of a recurring manual control.
Mistake 5 — Treating Every Exception as a Finding
Section titled “Mistake 5 — Treating Every Exception as a Finding”Validate context, severity, frequency, and impact first.
Mistake 6 — Closing Findings on Management Statements
Section titled “Mistake 6 — Closing Findings on Management Statements”“Fixed.”
is not sufficient closure evidence.
Mistake 7 — Ignoring Root Cause
Section titled “Mistake 7 — Ignoring Root Cause”Fixing one failed transaction without fixing the underlying process may lead to recurrence.
Mistake 8 — Duplicate Evidence Requests
Section titled “Mistake 8 — Duplicate Evidence Requests”Check existing evidence before requesting it again.
Mistake 9 — No Audit Trail
Section titled “Mistake 9 — No Audit Trail”Assessment decisions should be reproducible.
Mistake 10 — No Retesting
Section titled “Mistake 10 — No Retesting”Remediation implementation does not automatically prove operating effectiveness.
Operational Checklist
Section titled “Operational Checklist”Assessment Planning
Section titled “Assessment Planning”-
Identify control.
-
Confirm control objective.
-
Identify requirements.
-
Confirm framework mappings.
-
Define scope.
-
Document exclusions.
-
Identify control owner.
-
Identify evidence provider.
-
Determine control type.
-
Determine control frequency.
Evidence Collection
Section titled “Evidence Collection”-
Define evidence requirements.
-
Create evidence request.
-
Confirm assessment period.
-
Receive evidence.
-
Index evidence.
-
Validate relevance.
-
Validate reliability.
-
Validate completeness.
-
Validate evidence period.
-
Store evidence securely.
Population & Sampling
Section titled “Population & Sampling”-
Define population.
-
Obtain population evidence.
-
Validate population completeness.
-
Determine sampling approach.
-
Select samples.
-
Document methodology.
Testing
Section titled “Testing”-
Test control design.
-
Define operating-effectiveness procedure.
-
Execute testing.
-
Record results.
-
Identify exceptions.
-
Validate exceptions.
-
Expand testing if necessary.
-
Determine effectiveness.
Findings
Section titled “Findings”-
Document condition.
-
Document criteria.
-
Determine root cause.
-
Document risk.
-
Assign severity.
-
Agree remediation.
-
Assign owner.
-
Establish target date.
-
Define closure evidence.
Retesting & Closure
Section titled “Retesting & Closure”-
Receive remediation evidence.
-
Validate implementation.
-
Perform retest.
-
Document retest result.
-
Confirm residual issues.
-
Close finding where appropriate.
-
Retain final assessment package.
Quick Reference — Control Testing Decision Tree
Section titled “Quick Reference — Control Testing Decision Tree”Select Control ↓Is Scope Defined? │ ├── No → Define Scope │ └── Yes ↓Is Design Adequate? │ ├── No → Design Finding │ └── Yes ↓Is Evidence Sufficient? │ ├── No → Request Evidence │ └── Yes ↓Is Population Reliable? │ ├── No → Resolve Population Issue │ └── Yes ↓Test Operation ↓Exceptions? │ ├── No → Effective │ └── Yes ↓Evaluate Severity / Frequency ↓Finding Required? │ ├── No → Document Rationale │ └── Yes ↓Remediate ↓Retest ↓CloseRunbook Deliverables
Section titled “Runbook Deliverables”A completed assessment package should contain:
01 — Control Assessment Workpaper
02 — Evidence Request
03 — Evidence Index
04 — Population Validation
05 — Sampling Record
06 — Test Results
07 — Exception Log
08 — Finding Record
09 — Remediation Plan
10 — Retest Record
11 — Final Assessment ConclusionRunbook Success Criteria
Section titled “Runbook Success Criteria”The assessment is complete when:
Scope is clear
Control ownership is confirmed
Evidence is sufficient
Population is validated
Testing is reproducible
Exceptions are documented
Effectiveness is concluded
Findings have owners
Remediation is tracked
Required retesting is completed
Final evidence is retainedPractical GRC Mindset
Section titled “Practical GRC Mindset”A weak assessment asks:
Did the control owner send us something?
A better assessment asks:
Does the evidence demonstrate that the control operated?
A mature assessment asks:
Is the evidence complete, reliable, and sufficient to demonstrate that the control operated effectively across the required scope and period?
That distinction separates evidence collection from control assurance.
Runbook Complete
Section titled “Runbook Complete”You now have a reusable operational procedure for:
Control ↓Scope ↓Evidence ↓Population ↓Sampling ↓Testing ↓Exceptions ↓Findings ↓Remediation ↓Retesting ↓AssuranceThis workflow can be reused across security frameworks, compliance programs, internal audits, external audits, and enterprise control-assurance activities.
What’s Next?
Section titled “What’s Next?”➡️ Runbook 02 — Third-Party Risk Assessment & Vendor Onboarding
In the final runbook for Module 01 — GRC Fundamentals, you will operationalize the complete third-party onboarding process.
You will build a repeatable workflow covering:
Business Requests Vendor ↓Vendor Intake ↓Inherent Risk Assessment ↓Risk Tiering ↓Due Diligence ↓Security Questionnaire ↓Assurance Evidence Review ↓Findings ↓Residual Risk ↓Contractual Requirements ↓Risk Decision ↓Approval ↓Onboarding ↓MonitoringThe runbook will define the exact actions a GRC Analyst should take when a new vendor enters the organization, including approval gates, evidence requirements, escalation criteria, conditional approvals, risk acceptance, remediation tracking, and ongoing monitoring.