02 Security Monitoring
Welcome to:
Module 02 — Security Monitoring
In the previous module, you learned how Blue Teams and SOC analysts think.
You now understand:
Threats
Telemetry
Alerts
Triage
Investigation
MITRE ATT&CK
Incident ClassificationThe next question is:
Where DoesSecurity EvidenceActually Come From?A SOC can only investigate what it can see.
Security monitoring therefore begins with:
VisibilityA modern enterprise may contain:
Endpoints
Servers
Network Devices
Cloud Accounts
Applications
Identity Platforms
Email Systems
SaaS Platforms
Containers
Security ToolsEach produces different forms of:
Security TelemetryThe job of the monitoring architecture is to bring that information together so analysts can:
Search
Correlate
Detect
Investigate
RespondModule Objectives
Section titled “Module Objectives”By the end of this module, you will understand how to:
-
explain the purpose of security monitoring.
-
understand security monitoring architecture.
-
understand SIEM architecture.
-
distinguish log generation, collection and analysis.
-
identify major security telemetry sources.
-
understand centralized logging.
-
understand log forwarding.
-
understand collectors and agents.
-
understand parsing and normalization.
-
understand enrichment.
-
understand log correlation.
-
understand event pipelines.
-
understand Windows monitoring.
-
understand Linux monitoring.
-
understand endpoint telemetry.
-
understand EDR and XDR monitoring.
-
understand identity monitoring.
-
understand network monitoring.
-
understand DNS monitoring.
-
understand firewall monitoring.
-
understand proxy monitoring.
-
understand VPN monitoring.
-
understand cloud monitoring.
-
understand application monitoring.
-
understand email monitoring.
-
understand SaaS monitoring.
-
understand threat-intelligence enrichment.
-
understand alert generation.
-
understand telemetry coverage.
-
identify monitoring gaps.
-
understand log retention.
-
understand time synchronization.
-
understand monitoring health.
-
design a basic enterprise SOC monitoring architecture.
1 — What Is Security Monitoring?
Section titled “1 — What Is Security Monitoring?”Security monitoring is the continuous process of collecting and analyzing information about activity occurring across an organization’s technology environment.
The objective is to identify:
Suspicious Activity
Malicious Activity
Policy Violations
Security Failures
Control Changes
Indicators of AttackSecurity monitoring supports:
Detection
Investigation
Threat Hunting
Incident Response
Forensics
Compliance2 — Security Monitoring Is About Visibility
Section titled “2 — Security Monitoring Is About Visibility”Consider an attacker who:
Steals Credentials ↓Logs In ↓Creates Admin Account ↓Accesses Cloud Storage ↓Downloads DataDifferent stages may appear in:
Identity Logs
Cloud Audit Logs
Application Logs
Network LogsIf the SOC collects only endpoint logs:
Major Partsof the AttackMay Be Invisible3 — Monitoring Architecture
Section titled “3 — Monitoring Architecture”A simplified monitoring architecture is:
Systems ↓Logs / Telemetry ↓Collection ↓Processing ↓Normalization ↓Storage ↓Detection ↓Alert ↓SOC Analyst4 — Security Data Pipeline
Section titled “4 — Security Data Pipeline”Another way to visualize it:
Telemetry Source ↓Collection Agent ↓Transport ↓Log Platform ↓Parsing ↓Normalization ↓Enrichment ↓Detection Logic ↓AlertEach stage matters.
5 — What Is a SIEM?
Section titled “5 — What Is a SIEM?”SIEM stands for:
Security InformationandEvent ManagementA SIEM helps organizations:
Collect
Store
Search
Normalize
Correlate
Analyze
Alert
Reporton security telemetry.
6 — SIEM Is Not Just Log Storage
Section titled “6 — SIEM Is Not Just Log Storage”A basic log server might:
Store LogsA SIEM typically adds:
Search
Correlation
Detection Rules
Dashboards
Alerting
Case Integration
Threat Intelligence7 — SIEM Architecture
Section titled “7 — SIEM Architecture”A simplified enterprise SIEM architecture:
Endpoints ──────────┐Servers ────────────┤Identity ───────────┤Network ────────────┼→ CollectorsCloud ──────────────┤ ↓Applications ───────┤ SIEM PlatformEmail ──────────────┘ ↓ Search Detection Alerting8 — Telemetry Source
Section titled “8 — Telemetry Source”The first component is:
Telemetry SourceExamples:
Windows Server
Linux Server
Firewall
Identity Provider
Cloud Account
Web Application
Email Gateway
Endpoint Security Platform9 — Log Generation
Section titled “9 — Log Generation”Before logs can be monitored:
The SystemMust Generate ThemThis seems obvious, but many monitoring problems begin because:
Logging WasNever Enabled10 — Log Collection
Section titled “10 — Log Collection”Once generated, telemetry must reach the monitoring platform.
Common methods include:
Agent
Syslog
API
Cloud Connector
Event Stream
Native Integration
File Forwarder11 — Agent-Based Collection
Section titled “11 — Agent-Based Collection”An agent runs on the monitored system.
Example:
Server ↓Monitoring Agent ↓Central PlatformAdvantages may include:
Reliable Collection
Local Processing
Encrypted Transport
Endpoint Context12 — Agentless Collection
Section titled “12 — Agentless Collection”Agentless approaches may use:
API
Syslog
Remote Queries
Cloud ServicesExample:
Cloud Platform ↓API ↓SIEM13 — Syslog
Section titled “13 — Syslog”Syslog is commonly used by:
Network Devices
Linux Systems
Security Appliances
FirewallsConceptually:
Device ↓Syslog ↓Collector ↓SIEM14 — APIs
Section titled “14 — APIs”Modern cloud and SaaS platforms commonly expose:
Security Eventsthrough APIsExample:
Identity Provider ↓API ↓Security Platform15 — Collection Reliability
Section titled “15 — Collection Reliability”A major monitoring question is:
Are WeActually Receivingthe Logs?Logging enabled does not guarantee:
Logging Collected16 — Monitoring Pipeline Failure
Section titled “16 — Monitoring Pipeline Failure”Example:
ServerGenerates Logs
↓
ForwarderStops Working
↓
SIEM ReceivesNothingThe control problem is not:
Logging DisabledIt is:
Collection Failure17 — Log Parsing
Section titled “17 — Log Parsing”Raw logs may look different across platforms.
Example:
USER=aliceSRC=10.0.0.5ACTION=LOGINRESULT=FAILanother system may produce:
username: alicesource_ip: 10.0.0.5authentication_status: failedParsing extracts useful fields.
18 — Normalization
Section titled “18 — Normalization”Normalization converts different source formats into a common structure.
Example:
User
Source IP
Destination
Event Type
Action
Result
TimestampThis allows queries across different platforms.
19 — Why Normalization Matters
Section titled “19 — Why Normalization Matters”Without normalization:
WindowsUses One Field
CloudUses Another
ApplicationUses AnotherA detection may need separate logic for every platform.
Normalized data allows:
CommonDetection Logic20 — Enrichment
Section titled “20 — Enrichment”Enrichment adds context to raw events.
Raw event:
User:alice
Source IP:203.0.113.20Enriched event:
User:alice
Role:Finance Manager
Account Type:Privileged
Source IP:203.0.113.20
Country:X
Threat Reputation:Suspicious21 — Common Enrichment Sources
Section titled “21 — Common Enrichment Sources”Examples:
Asset Inventory
Identity Directory
Threat Intelligence
GeoIP
Vulnerability Data
Business Criticality
CMDB22 — Correlation
Section titled “22 — Correlation”Correlation connects related events.
Example:
20 Failed Logins ↓Successful Login ↓New Administrator ↓Large DownloadThese may occur in different data sources.
Correlation helps the SOC see:
The Pattern23 — Correlation Rule Example
Section titled “23 — Correlation Rule Example”Conceptually:
IF
Multiple Failed Logins
FOLLOWED BY
Successful Login
FROM
Same IP
WITHIN
10 Minutes
THEN
Generate Alert24 — Event Aggregation
Section titled “24 — Event Aggregation”Many systems produce repeated events.
Example:
1000Firewall BlocksAggregation may summarize:
Source IP
Destination
Port
Count
Time Windowrather than displaying every event individually.
25 — Event Deduplication
Section titled “25 — Event Deduplication”Some events may be identical.
Deduplication can reduce:
Noise
Storage
Analyst WorkloadBut careless deduplication can also remove useful context.
26 — Timestamps
Section titled “26 — Timestamps”Every investigation depends on:
TimeEvents must contain reliable timestamps.
27 — Time Synchronization
Section titled “27 — Time Synchronization”Systems should use consistent time sources.
If one system is:
10 Minutes Aheadand another:
5 Minutes Behindyour incident timeline may become misleading.
28 — NTP
Section titled “28 — NTP”Network Time Protocol helps synchronize system clocks.
Consistent time is critical for:
Correlation
Investigation
Forensics
Audit29 — Time Zones
Section titled “29 — Time Zones”Analysts must understand whether timestamps use:
UTC
Local Time
Server Time
User Time ZoneAlways normalize time when building incident timelines.
30 — Windows Monitoring
Section titled “30 — Windows Monitoring”Windows environments produce important security telemetry.
Common areas include:
Authentication
Account Management
Process Creation
Service Creation
Scheduled Tasks
PowerShell
Group Changes
Privilege Usage31 — Windows Security Event Log
Section titled “31 — Windows Security Event Log”Windows Security logs can provide information about:
Logons
Logoff
Account Changes
Privilege Use
Authentication Failures
Audit Events32 — Process Creation
Section titled “32 — Process Creation”Process events can help analysts understand:
Which Program Ran?
Who Started It?
What Was the Parent?
Which Command Was Used?This is essential for detecting suspicious execution.
33 — Command-Line Logging
Section titled “33 — Command-Line Logging”Command-line information may reveal:
Encoded Commands
Downloads
Credential Tools
Reconnaissance Commands
Persistence Commands34 — PowerShell Monitoring
Section titled “34 — PowerShell Monitoring”PowerShell is widely used by:
Administrators
Developers
Security Teams
AttackersTherefore:
PowerShell ≠MaliciousContext and command behavior matter.
35 — Sysmon
Section titled “35 — Sysmon”Sysmon can provide detailed Windows telemetry such as:
Process Creation
Network Connections
File Creation
Registry Changes
Driver Loadingwhen appropriately configured.
36 — Linux Monitoring
Section titled “36 — Linux Monitoring”Linux monitoring commonly uses:
Authentication Logs
System Logs
Audit Frameworks
Application Logs
Shell Activity37 — Linux Authentication
Section titled “37 — Linux Authentication”Useful events may include:
Successful SSH Login
Failed SSH Login
sudo Usage
Account Changes38 — Linux Audit
Section titled “38 — Linux Audit”Linux audit frameworks can record:
System Calls
File Access
Privilege Changes
Command Executiondepending on configuration.
39 — Endpoint Detection and Response
Section titled “39 — Endpoint Detection and Response”EDR stands for:
EndpointDetectionandResponseEDR provides deeper visibility into endpoint activity.
40 — EDR Telemetry
Section titled “40 — EDR Telemetry”Typical EDR data may include:
Processes
Command Lines
Files
Registry
Network Connections
Users
Hashes
Behavior41 — EDR Capabilities
Section titled “41 — EDR Capabilities”EDR platforms may support:
Detection
Investigation
Threat Hunting
Process Trees
Endpoint Isolation
File Quarantine42 — Process Tree
Section titled “42 — Process Tree”A process tree helps understand relationships.
Example:
outlook.exe ↓winword.exe ↓powershell.exe ↓cmd.exeThis sequence may be suspicious depending on context.
43 — Parent-Child Relationships
Section titled “43 — Parent-Child Relationships”A detection can look for unusual relationships such as:
Office Application ↓Command Shellor:
Browser ↓PowerShell44 — XDR
Section titled “44 — XDR”XDR typically extends detection and response across multiple security domains.
It may correlate:
Endpoint
Identity
Email
Cloud
Networktelemetry.
45 — Identity Monitoring
Section titled “45 — Identity Monitoring”Identity is one of the most important modern monitoring domains.
Monitor:
Successful Logins
Failed Logins
MFA
Password Resets
Role Changes
Session Activity
New Accounts
Disabled Accounts46 — Authentication Monitoring
Section titled “46 — Authentication Monitoring”Useful questions include:
Who Logged In?
From Where?
Using Which Device?
Was MFA Used?
Was the Login Successful?
Was This Normal?47 — Failed Login Monitoring
Section titled “47 — Failed Login Monitoring”One failed login may be normal.
Thousands may indicate:
Password Spray
Brute Force
Credential StuffingContext matters.
48 — Successful Login After Failures
Section titled “48 — Successful Login After Failures”Sequence:
50 Failed Logins ↓1 Successful Loginmay deserve higher attention than either event alone.
49 — Impossible Travel
Section titled “49 — Impossible Travel”A monitoring system might identify:
Login in Country A
10 Minutes Later
Login in Country BThis may indicate compromise.
But it may also result from:
VPN
Proxy
Cloud Service
Incorrect GeoIPInvestigation is still required.
50 — MFA Monitoring
Section titled “50 — MFA Monitoring”Monitor:
MFA Success
MFA Failure
MFA Denial
MFA Registration
MFA Removal
Authentication Method Change51 — MFA Fatigue
Section titled “51 — MFA Fatigue”Repeated authentication prompts may indicate:
MFAPush FatiguePotential pattern:
Repeated MFA Denials ↓One ApprovalThis may warrant investigation.
52 — Privilege Monitoring
Section titled “52 — Privilege Monitoring”Monitor events such as:
New Administrator
Role Assignment
Privilege Escalation
Group Membership Change
Cloud IAM Policy Change53 — Service Account Monitoring
Section titled “53 — Service Account Monitoring”Service accounts may have:
Powerful Permissions
Long-Lived Credentials
Non-Interactive UsageMonitor:
Unexpected Interactive Login
Credential Changes
New Privileges
Unusual Source Systems54 — Network Monitoring
Section titled “54 — Network Monitoring”Network telemetry helps analysts understand:
Connections
Protocols
Destinations
Traffic Volume
Communication Patterns55 — Firewall Logs
Section titled “55 — Firewall Logs”Firewalls may record:
Source IP
Destination IP
Source Port
Destination Port
Protocol
Allow / Deny
Rule56 — Firewall Monitoring Use Cases
Section titled “56 — Firewall Monitoring Use Cases”Examples:
Repeated Connection Attempts
Unexpected Outbound Traffic
Connections to KnownMalicious IPs
Access to Restricted Ports57 — DNS Monitoring
Section titled “57 — DNS Monitoring”DNS logs record domain-resolution activity.
They can help identify:
Malicious Domains
Command and Control
Suspicious Subdomains
Unusual DNS Patterns58 — DNS Query Example
Section titled “58 — DNS Query Example”Endpoint ↓Queriesevil-example.testQuestions:
Which Process?
Which User?
Was Connection Made?
Did Other HostsQuery It?59 — Domain Reputation
Section titled “59 — Domain Reputation”A domain being newly registered or suspicious can add context.
But:
Suspicious Domain ≠Confirmed Compromise60 — Proxy Monitoring
Section titled “60 — Proxy Monitoring”Proxy logs can provide:
User
URL
Domain
Destination
Request
Response
Data VolumeUseful for:
Web-Based Malware
Phishing
Data Exfiltration
Command and Control61 — VPN Monitoring
Section titled “61 — VPN Monitoring”VPN logs provide:
User
Source IP
Authentication
Session Start
Session End
Assigned IP
Device Context62 — IDS and IPS
Section titled “62 — IDS and IPS”IDS:
IntrusionDetection SystemIPS:
IntrusionPrevention SystemThey may identify suspicious network patterns or known attack signatures.
63 — IDS Alert Limitation
Section titled “63 — IDS Alert Limitation”An IDS signature match does not always mean:
Successful AttackThe analyst should determine:
Was Target Vulnerable?
Did Connection Succeed?
Was Exploitation Successful?
What Happened Next?64 — Network Flow
Section titled “64 — Network Flow”Flow data can summarize:
Source
Destination
Port
Protocol
Bytes
Durationwithout full packet contents.
65 — Network Detection and Response
Section titled “65 — Network Detection and Response”NDR may use:
Network Telemetry
Behavior Analytics
Protocol Analysisto identify suspicious activity.
66 — Cloud Monitoring
Section titled “66 — Cloud Monitoring”Cloud monitoring is critical because cloud activity often occurs through:
APIsrather than traditional interactive access.
67 — Cloud Audit Logs
Section titled “67 — Cloud Audit Logs”Cloud audit telemetry can reveal:
Who Called an API?
Which Action?
Which Resource?
From Which IP?
Was It Successful?
What Changed?68 — Cloud Identity Monitoring
Section titled “68 — Cloud Identity Monitoring”Monitor:
New Users
New Roles
New Access Keys
Privilege Changes
Authentication
MFA Changes69 — Cloud Resource Monitoring
Section titled “69 — Cloud Resource Monitoring”Monitor changes to:
Storage
Network Rules
Virtual Machines
Databases
Encryption
Logging
Security Services70 — Storage Monitoring
Section titled “70 — Storage Monitoring”High-value events include:
Bucket Made Public
Encryption Disabled
Large Data Download
Access Policy Changed
Logging Disabled71 — Cloud Network Monitoring
Section titled “71 — Cloud Network Monitoring”Monitor:
Security Group Changes
Firewall Rules
Public Exposure
Flow Logs
Load Balancer Events72 — Cloud Logging Gaps
Section titled “72 — Cloud Logging Gaps”A major problem occurs when:
New Cloud AccountCreated ↓Logging Not Integrated ↓SOC Has No VisibilityThis is a monitoring coverage gap.
73 — Application Monitoring
Section titled “73 — Application Monitoring”Applications should log security-relevant actions.
Examples:
Login
Logout
Failed Login
Admin Actions
User Creation
Permission Changes
Sensitive Transactions
Errors74 — Application Context
Section titled “74 — Application Context”Application logs may provide business context unavailable elsewhere.
Example:
User Exported100,000Customer RecordsA network log may show only:
Large HTTPS TransferThe application log explains what happened.
75 — Web Server Monitoring
Section titled “75 — Web Server Monitoring”Useful events include:
HTTP Requests
Response Codes
User Agents
URLs
Source IPs
Request Size76 — Web Attack Indicators
Section titled “76 — Web Attack Indicators”Potential patterns:
SQL Injection Attempts
Directory Traversal
Command Injection
Scanning
Repeated 404s
Suspicious User Agents77 — Email Monitoring
Section titled “77 — Email Monitoring”Email is a major initial-access channel.
Monitor:
Sender
Recipient
Subject
URL
Attachment
Authentication
Delivery
Mailbox Activity78 — Email Authentication
Section titled “78 — Email Authentication”Important technologies include:
SPF
DKIM
DMARCThese help evaluate whether email was authorized by the sender’s domain.
79 — Mailbox Activity
Section titled “79 — Mailbox Activity”After account compromise, attackers may:
Create Inbox Rules
Forward Email
Delete Messages
Search Mailbox
Send Internal PhishingThese actions may generate valuable telemetry.
80 — SaaS Monitoring
Section titled “80 — SaaS Monitoring”Organizations increasingly depend on:
Collaboration Platforms
CRM
File Sharing
HR Platforms
Business ApplicationsMonitor:
Authentication
Administrative Changes
Sharing
Downloads
API Activity
User Management81 — Security Tool Telemetry
Section titled “81 — Security Tool Telemetry”Security tools themselves produce useful information.
Examples:
EDR Alerts
Vulnerability Findings
DLP Events
CASB Events
Email Security Alerts
Cloud Security Findings82 — Vulnerability Context
Section titled “82 — Vulnerability Context”A SIEM alert involving a system with:
CriticalUnpatched Vulnerabilitymay deserve greater priority.
This is an example of:
ContextualEnrichment83 — Threat Intelligence Enrichment
Section titled “83 — Threat Intelligence Enrichment”Events may be enriched with:
Malicious IP Reputation
Known C2 Domain
Malware Hash
Threat Actor Infrastructure84 — Threat Intelligence Limitation
Section titled “84 — Threat Intelligence Limitation”Do not automatically block or escalate only because:
Threat FeedSays MaliciousEvaluate:
Source Quality
Freshness
Confidence
Context
Internal Activity85 — Alert Generation
Section titled “85 — Alert Generation”Alerts may come from:
SIEM Rules
EDR
NDR
Identity Security
Cloud Security
Email Security
Threat Intelligence
Behavior Analytics86 — Signature-Based Detection
Section titled “86 — Signature-Based Detection”Signature detection looks for known patterns.
Examples:
Known Malware Hash
Known Exploit Pattern
Known Network SignatureAdvantages:
Precisefor Known ThreatsLimitations:
Easy to Change
May MissNovel Behavior87 — Behavior-Based Detection
Section titled “87 — Behavior-Based Detection”Behavior detection looks for suspicious activity patterns.
Examples:
OfficeSpawns PowerShell
Credential Dumping
Rapid Privilege Changes
Large Data Transfer88 — Threshold Detection
Section titled “88 — Threshold Detection”Example:
More Than20 Failed Logins
Within5 MinutesThresholds should reflect:
Normal Behavior
Risk
Environment89 — Correlation Detection
Section titled “89 — Correlation Detection”Example:
Failed Logins +Successful Login +New Admin Rolewithin:
15 Minutesmay generate a higher-confidence alert.
90 — Anomaly Detection
Section titled “90 — Anomaly Detection”Anomaly detection identifies behavior different from established baselines.
Examples:
New Country
Unusual Login Time
Unusual Data Volume
New Device
Rare Process91 — Anomaly Does Not Mean Malicious
Section titled “91 — Anomaly Does Not Mean Malicious”Anomalous means:
Differentnot:
MaliciousContext determines significance.
92 — Monitoring Baseline
Section titled “92 — Monitoring Baseline”A baseline describes expected behavior.
Examples:
Typical Login Locations
Normal Process Activity
Expected Network Volume
Standard Administrative Activity93 — Monitoring Coverage
Section titled “93 — Monitoring Coverage”A mature SOC should understand:
What Are WeMonitoring?and:
What Are WeNot Monitoring?94 — Telemetry Coverage Matrix
Section titled “94 — Telemetry Coverage Matrix”Create a matrix:
| Environment | Logging | Collection | Detection | Coverage |
|---|---|---|---|---|
| Windows Endpoints | Yes | Yes | Yes | Strong |
| Linux Servers | Yes | Partial | Partial | Medium |
| Cloud Accounts | Yes | Partial | Partial | Gap |
| SaaS Platform | Unknown | Unknown | No | Gap |
95 — Common Monitoring Gaps
Section titled “95 — Common Monitoring Gaps”Examples:
Logging Disabled
Collector Failure
Unsupported Platform
New Cloud Account
Missing SaaS Integration
No Detection Rule
Insufficient Retention
Poor Parsing96 — Detection Coverage Gap
Section titled “96 — Detection Coverage Gap”Logs may be collected correctly.
But:
No DetectionUses ThemThis is a:
DetectionCoverage Gap97 — Collection Gap
Section titled “97 — Collection Gap”Logging exists on the source.
But:
SIEM Does NotReceive ItThis is a:
Collection Gap98 — Logging Gap
Section titled “98 — Logging Gap”The source does not generate the required event.
This is a:
Logging Gap99 — Parsing Gap
Section titled “99 — Parsing Gap”Logs reach the SIEM.
But important fields are:
Not ParsedCorrectlyThis can break detections.
100 — Monitoring Health
Section titled “100 — Monitoring Health”The SOC should monitor its own monitoring platform.
Questions:
Are Sources Reporting?
Are Collectors Healthy?
Is Ingestion Delayed?
Are APIs Failing?
Are Rules Running?
Is Storage Available?101 — Source Heartbeat
Section titled “101 — Source Heartbeat”A heartbeat confirms a data source is still reporting.
Example:
Cloud AccountLast Event:
3 Days AgoThis may indicate:
Collection Failure102 — Ingestion Delay
Section titled “102 — Ingestion Delay”Security data arriving:
4 Hours Latemay severely reduce detection value.
Real-time detection needs:
TimelyTelemetry103 — Log Retention
Section titled “103 — Log Retention”Retention determines how long logs remain available.
Retention must support:
Investigation
Threat Hunting
Forensics
Compliance
Legal Requirements104 — Retention Challenge
Section titled “104 — Retention Challenge”Suppose:
CompromiseDiscoveredAfter 90 Daysbut logs are retained for:
30 Daysthe investigation may lose critical history.
105 — Hot vs Cold Storage
Section titled “105 — Hot vs Cold Storage”Security platforms may use:
Hot Storage ↓Fast Search
Cold Storage ↓Longer-Term RetentionCost and performance must be balanced.
106 — Log Volume
Section titled “106 — Log Volume”Modern enterprises may generate:
Millions
or
Billionsof events.
Collecting everything without strategy can create:
Cost
Noise
Performance Problems107 — Monitoring Strategy
Section titled “107 — Monitoring Strategy”Collect telemetry based on:
Threat Risk
Asset Criticality
Detection Requirements
Investigation Needs
Compliance Requirements108 — High-Value Telemetry
Section titled “108 — High-Value Telemetry”Examples often include:
Authentication
Privilege Changes
Process Creation
Cloud API Activity
Network Connections
DNS
Security Alerts109 — Monitoring Priority
Section titled “109 — Monitoring Priority”Not every asset requires identical monitoring depth.
Prioritize:
Critical Systems
Privileged Accounts
Internet-Facing Assets
Sensitive Data Systems
Identity Infrastructure110 — Asset Context
Section titled “110 — Asset Context”A process alert on:
Employee Laptopmay be lower priority than the same alert on:
Domain ControllerAsset context should enrich monitoring.
111 — User Context
Section titled “111 — User Context”Similarly:
Standard Userversus:
Global Administratorchanges investigation priority.
112 — Security Monitoring Architecture Example
Section titled “112 — Security Monitoring Architecture Example” USERS ↓ Identity Logs │ │Endpoints ─────────┤Servers ───────────┤Firewalls ─────────┤DNS ───────────────┤Cloud ─────────────┼→ Collection LayerApplications ──────┤ ↓Email ─────────────┤ ProcessingSaaS ──────────────┘ ↓ Normalization ↓ Enrichment ↓ SIEM ↓ Detection / Correlation ↓ Alerts ↓ SOC113 — Monitoring Questions
Section titled “113 — Monitoring Questions”For every environment ask:
What Can Happen?
Which LogsWould Show It?
Are Those LogsGenerated?
Are They Collected?
Are They Parsed?
Are They Searchable?
Do We HaveDetection Logic?114 — Detection Use-Case Architecture
Section titled “114 — Detection Use-Case Architecture”Example:
Threat:
Privileged AccountCompromiseRequired telemetry:
Authentication
MFA
Privilege Changes
Cloud API
EndpointDetections:
Impossible Travel
Repeated MFA Denial
New Administrator
Unusual Cloud API115 — Monitoring and MITRE ATT&CK
Section titled “115 — Monitoring and MITRE ATT&CK”ATT&CK can help determine:
Which TelemetryIs Neededto DetectEach Technique?Example:
Technique:PowerShell
Potential Telemetry:
Process Creation
PowerShell Logs
EDR
Command Line116 — Monitoring Coverage by ATT&CK
Section titled “116 — Monitoring Coverage by ATT&CK”A security team may create:
ATT&CK Technique ↓Data Source ↓Detection Rule ↓Coverage Status117 — Logging Does Not Equal Detection
Section titled “117 — Logging Does Not Equal Detection”Remember:
TelemetryCollected ≠ThreatDetectedYou also need:
Detection Logic118 — Detection Does Not Equal Investigation
Section titled “118 — Detection Does Not Equal Investigation”Likewise:
AlertGenerated ≠ThreatConfirmedA human or automated investigation process must validate it.
119 — Monitoring Does Not Equal Security
Section titled “119 — Monitoring Does Not Equal Security”Collecting billions of events does not automatically create:
Good SecurityThe real chain is:
Useful Telemetry ↓Good Detection ↓Effective Investigation ↓Timely Response120 — Monitoring Documentation
Section titled “120 — Monitoring Documentation”A SOC should maintain:
Log Source Inventory
Data Source Owners
Collection Method
Retention
Parsing Status
Detection Coverage
Health Status121 — Build a Log Source Inventory
Section titled “121 — Build a Log Source Inventory”A useful structure:
| Source ID | Source | Type | Owner | Collection | SIEM | Retention | Status |
|---|---|---|---|---|---|---|---|
| LOG-001 | Identity Platform | Authentication | IAM | API | Yes | TBD | Active |
| LOG-002 | Firewall | Network | Network | Syslog | Yes | TBD | Active |
| LOG-003 | AWS | Cloud | Cloud | API | Partial | TBD | Gap |
122 — Monitoring Ownership
Section titled “122 — Monitoring Ownership”Every source should have someone responsible for:
Logging Configuration
Collection
Availability
ChangesWithout ownership, monitoring gaps can persist unnoticed.
123 — Change Management
Section titled “123 — Change Management”Technology environments change constantly.
Examples:
New Cloud Account
New Application
New Firewall
New SaaS Platform
New Identity ProviderSecurity monitoring should be part of:
ChangeManagement124 — New System Monitoring Checklist
Section titled “124 — New System Monitoring Checklist”When a new system is introduced:
Identify Logs
Enable Logging
Configure Forwarding
Validate Collection
Parse Fields
Apply Enrichment
Create Detections
Test Alerts
Monitor Health125 — Security Monitoring Validation
Section titled “125 — Security Monitoring Validation”Do not assume an integration works because:
ConnectorShows GreenTest:
Generate Event
Confirm Source Log
Confirm Collection
Confirm Parsed Fields
Confirm Search
Confirm Detection126 — End-to-End Test
Section titled “126 — End-to-End Test”Example:
GenerateFailed Login ↓Identity PlatformRecords Event ↓SIEM Receives Event ↓Parser Extracts Fields ↓Detection Matches ↓Alert GeneratedThis validates the complete pipeline.
127 — Monitoring Failure Investigation
Section titled “127 — Monitoring Failure Investigation”If the alert does not appear, identify:
Logging Failure?
Collection Failure?
Parsing Failure?
Rule Failure?
Alert Delivery Failure?128 — Blue Team Monitoring Mindset
Section titled “128 — Blue Team Monitoring Mindset”Do not ask only:
Do WeHave a SIEM?Ask:
Do We Havethe Right Telemetry?
Is It Complete?
Is It Timely?
Can We Search It?
Can We DetectRelevant Threats?
Can We InvestigateWhat Happened?Practical Exercise 1 — Build a Log Source Inventory
Section titled “Practical Exercise 1 — Build a Log Source Inventory”Create a fictional enterprise containing:
Windows
Linux
Firewall
DNS
VPN
Identity
AWS
Email
Web Application
EDRFor each identify:
Source
Event Types
Collection Method
Security Value
Retention
OwnerPractical Exercise 2 — Design a SIEM Architecture
Section titled “Practical Exercise 2 — Design a SIEM Architecture”Draw:
Endpoints
Servers
Network
Identity
Cloud
Email
Applications ↓Collection ↓SIEM ↓Detection ↓SOCInclude:
Collectors
Parsing
Normalization
Enrichment
AlertingPractical Exercise 3 — Monitoring Gap Analysis
Section titled “Practical Exercise 3 — Monitoring Gap Analysis”Scenario:
10 AWS Accounts
Cloud Audit Logging:10
SIEM Integration:7Identify:
Logging Coverage
Collection Coverage
Monitoring Gap
Risk
Recommended ActionPractical Exercise 4 — Identity Monitoring
Section titled “Practical Exercise 4 — Identity Monitoring”Create detections for:
Repeated Failed Logins
Successful Loginafter Failures
New Admin Role
MFA Disabled
MFA FatigueFor each identify required telemetry.
Practical Exercise 5 — Endpoint Monitoring
Section titled “Practical Exercise 5 — Endpoint Monitoring”Create a telemetry map for:
Process Execution
PowerShell
File Creation
Network Connection
PersistenceIdentify which endpoint data could help investigate each activity.
Practical Exercise 6 — Network Monitoring
Section titled “Practical Exercise 6 — Network Monitoring”Build investigation questions for:
Suspicious OutboundConnectionUse:
Firewall
DNS
Proxy
EDR
Threat IntelligencePractical Exercise 7 — Cloud Monitoring
Section titled “Practical Exercise 7 — Cloud Monitoring”Scenario:
Storage BucketMade PublicIdentify:
Which Cloud Log?
Which User?
Which API?
Which Resource?
Previous Configuration?
Subsequent Access?
Detection?Practical Exercise 8 — Email Monitoring
Section titled “Practical Exercise 8 — Email Monitoring”Scenario:
User ReceivesSuspicious EmailIdentify telemetry from:
Email Gateway
Mailbox
Identity
Endpoint
ProxyPractical Exercise 9 — Detection Pipeline Test
Section titled “Practical Exercise 9 — Detection Pipeline Test”Design an end-to-end validation for:
Failed Authenticationcovering:
Event Generation
Log Creation
Forwarding
Parsing
Detection
AlertingPractical Exercise 10 — Build a Telemetry Coverage Matrix
Section titled “Practical Exercise 10 — Build a Telemetry Coverage Matrix”Use:
| Threat Activity | Required Telemetry | Collected? | Detection? | Gap |
|---|---|---|---|---|
| Credential Theft | Identity + Endpoint | Yes | Partial | Detection |
| Public Cloud Storage | Cloud Audit | Yes | Yes | None |
| Data Exfiltration | Proxy + Network | Partial | No | Coverage |
Expand to:
15Threat ActivitiesKnowledge Check
Section titled “Knowledge Check”-
What is security monitoring?
-
Why is visibility important to the Blue Team?
-
What is a SIEM?
-
How is a SIEM different from basic log storage?
-
What are the main stages of a security telemetry pipeline?
-
What is log generation?
-
What is log collection?
-
What is agent-based collection?
-
What is agentless collection?
-
What is syslog?
-
Why are APIs important for modern monitoring?
-
What is parsing?
-
What is normalization?
-
What is enrichment?
-
What is correlation?
-
Why are accurate timestamps important?
-
What is NTP?
-
Why should SOC analysts understand time zones?
-
What can Windows security logs reveal?
-
Why is process creation telemetry important?
-
Why is PowerShell not automatically malicious?
-
What is Sysmon?
-
What types of Linux logs are useful to defenders?
-
What is EDR?
-
What is a process tree?
-
What is XDR?
-
Why is identity monitoring critical?
-
What is MFA fatigue?
-
What security activity should be monitored for privileged accounts?
-
What can firewall logs reveal?
-
Why are DNS logs valuable?
-
What can proxy logs reveal?
-
What is IDS?
-
What is IPS?
-
Why does an IDS alert not prove exploitation succeeded?
-
What is network flow data?
-
What is NDR?
-
Why is cloud audit logging important?
-
What cloud activities should be monitored?
-
What application events are security relevant?
-
Why are email logs important?
-
What is threat-intelligence enrichment?
-
What is signature-based detection?
-
What is behavior-based detection?
-
What is threshold detection?
-
What is anomaly detection?
-
Why does anomalous not mean malicious?
-
What is a logging gap?
-
What is a collection gap?
-
What is a detection gap?
-
What is a parsing gap?
-
Why should the SOC monitor telemetry source health?
-
What is log retention?
-
Why can short retention harm investigations?
-
Why should monitoring priorities consider asset criticality?
-
What is a telemetry coverage matrix?
-
Why should monitoring be included in change management?
-
What is an end-to-end monitoring test?
-
Why does collecting telemetry not guarantee detection?
-
What makes a security monitoring program effective?
Key Takeaways
Section titled “Key Takeaways”Security monitoring follows:
System Activity ↓Telemetry ↓Collection ↓Processing ↓Normalization ↓Enrichment ↓Detection ↓Alert ↓InvestigationThe SOC needs visibility across:
Identity
Endpoint
Network
Cloud
Application
Email
SaaSRemember:
Logging Enabled ≠Logs CollectedLogs Collected ≠Logs ParsedLogs Parsed ≠Detection ExistsDetection Exists ≠Threat DetectedAlert Generated ≠Incident ConfirmedA mature monitoring program asks:
Can We See It?
Can We Search It?
Can We Detect It?
Can We Investigate It?
Can We Respond?Career Connection
Section titled “Career Connection”Security monitoring knowledge is essential for:
SOC Analysts
Blue Team Analysts
Security Analysts
Detection Engineers
Threat Hunters
Incident Responders
SOC Engineers
SIEM EngineersDuring interviews, you should be able to explain:
How Logs Reacha SIEM
What Normalization Means
How Correlation Works
Which Logs You Needfor Different Investigations
How You IdentifyMonitoring Gaps
How You Validatea Logging PipelineThe key professional skill is not simply knowing:
Which SIEMButton to ClickIt is understanding:
Threat ↓Required Telemetry ↓Collection ↓Detection ↓InvestigationWhat’s Next?
Section titled “What’s Next?”➡️ Next: 03 — Threat Detection
You now understand where security telemetry comes from and how a SOC collects and monitors it.
The next step is learning how to transform that telemetry into:
DetectionsIn the next module, you will learn:
Detection Fundamentals
Detection Logic
Indicators of Compromise
Indicators of Attack
Behavior-Based Detection
Threshold Rules
Correlation Rules
Detection Use Cases
MITRE ATT&CK Mapping
Detection Coverage
False Positives
False Negatives
Detection Tuning
Detection Validation
Alert PrioritizationYou will move from:
We Havethe Logsto:
We KnowWhat SuspiciousBehavior to Detect
How to Detect It
and
How to Validatethe Detection➡️ Next: 03 — Threat Detection