Skip to main content
← All controls
IR-4 / A.16.1.5 / CIS-17.3 NIST SP 800-61 Rev 2

Runbooks for top 10 alert types

Demonstrate that the organization maintains current, actionable runbooks for its most common alert types and that SOC personnel follow these procedures during incident response activities.

Description

What this control does

This control requires the Security Operations Center (SOC) to maintain documented runbooks for the ten most frequently triggered alert types in the organization's security monitoring infrastructure. Each runbook must include triage procedures, investigation steps, escalation criteria, containment actions, and resolution workflows. These playbooks standardize incident response, reduce mean time to respond (MTTR), and ensure consistent handling of common security events regardless of analyst experience level.

Control objective

What auditing this proves

Demonstrate that the organization maintains current, actionable runbooks for its most common alert types and that SOC personnel follow these procedures during incident response activities.

Associated risks

Risks this control addresses

  • Inconsistent incident response leading to undetected lateral movement or privilege escalation during active intrusions
  • Delayed containment of critical security events due to analysts lacking clear procedural guidance
  • Escalation failures where junior analysts fail to recognize indicators requiring immediate senior involvement
  • Alert fatigue causing analysts to dismiss legitimate threats when handling repetitive alerts without structured workflows
  • Loss of institutional knowledge when experienced analysts depart without documented investigation procedures
  • Incomplete evidence collection during incident response compromising forensic analysis and root cause determination
  • Regulatory compliance failures when incident handling procedures are undocumented or inconsistently applied

Testing procedure

How an auditor verifies this control

  1. Obtain the organization's SIEM or security monitoring platform alert volume report for the trailing 90 days and identify the ten alert types with the highest trigger frequency.
  2. Request the current runbook repository and verify that documented runbooks exist for each of the top ten identified alert types.
  3. Select three runbooks for detailed review and verify each contains clearly defined sections for detection criteria, triage steps, investigation procedures, escalation thresholds, containment actions, and closure criteria.
  4. Review change control records for the selected runbooks to verify they have been reviewed and updated within the past 12 months.
  5. Interview three SOC analysts of varying experience levels and confirm they can locate and navigate the runbook repository without assistance.
  6. Select five closed incident tickets corresponding to alerts covered by the reviewed runbooks and trace analyst actions against the documented procedures to verify adherence.
  7. Identify any deviations between documented runbook steps and actual analyst actions in the sampled tickets and determine whether exceptions were appropriately documented and justified.
  8. Verify that runbook effectiveness metrics exist, such as MTTR per alert type or runbook utilization rates, and confirm management reviews these metrics quarterly.
Evidence required The auditor collects the 90-day alert volume report showing the top ten alert types by frequency, the complete runbook documents for these alert types including version history and approval records, and change management tickets demonstrating periodic review cycles. Additionally, the auditor obtains a sample of 5-10 closed incident tickets with corresponding SIEM alert data, SOC analyst interview notes documenting runbook accessibility and usability, and management meeting minutes or dashboards showing runbook effectiveness metrics and review activities.
Pass criteria The control passes if documented, current runbooks exist for all top ten alert types, the runbooks contain comprehensive investigation and response procedures, sampled incident response activities demonstrate adherence to documented procedures with documented justification for any deviations, and evidence confirms management reviews runbook effectiveness at least quarterly.

Where this control is tested

Audit programs including this control