Incident runbooks22 runbooks
Measure the queue, inspect a message, and decide whether a delivery retry is appropriate.
6 steps · LinuxDisk pressure diagnosisConfirm filesystem pressure, find the largest consumers, and check whether inode exhaustion is involved.
4 steps · Linux · macOSListening port and process investigationFind the process owning a local port and verify reachability from another host.
4 steps · Linux · macOS · WindowsDocker incident diagnosisInspect container state, resource pressure, logs, and configuration without restarting workloads.
5 steps · Linux · macOSGit recoveryUnderstand the working tree before discarding, restoring, or recovering changes.
5 steps · Linux · macOS · WindowsDNS resolution diagnosisCompare recursive and authoritative DNS answers before changing resolver or application configuration.
4 steps · Linux · macOS · WindowsCPU, memory, and OOM pressureSeparate CPU saturation, memory exhaustion, reclaim pressure, and a recent OOM kill.
6 steps · LinuxDisk I/O pressureConfirm device or process I/O pressure before blaming CPU, memory, or the application.
5 steps · LinuxLinux boot failure or delayFind the critical boot chain, failed units, and kernel warnings without rebooting again.
4 steps · Linuxsystemd unit failureInspect failed units, dependency impact, and recent logs before attempting a restart.
4 steps · LinuxBroken Linux serviceCorrelate service status and logs with host pressure before any restart or configuration edit.
4 steps · LinuxLogin and sudo investigationReview identity, failed logins, and sudo audit evidence without changing accounts or policy.
4 steps · LinuxTLS certificate and handshake diagnosisInspect SNI, certificate chain, expiry, and negotiated protocol before bypassing verification.
4 steps · Linux · macOS · WindowsHTTP latency and 5xx diagnosisSeparate DNS, connect, TLS, redirect, upstream, and application response time.
4 steps · Linux · macOS · WindowsPacket loss and latencyMeasure loss across the path and correlate it with local interface errors.
4 steps · Linux · macOSRouting and next-hop diagnosisConfirm the selected route, source address, gateway, and neighbor reachability.
4 steps · Linux · macOS · WindowsFirewall reachability diagnosisProve listener, route, and remote-port state before changing firewall policy.
4 steps · Linux · WindowsSSH connectivity and authenticationSeparate DNS, transport, host-key, client configuration, and authentication failures.
4 steps · Linux · macOS · WindowsKubernetes Pod incidentInspect context, warning events, restarts, and resource pressure before changing a workload.
4 steps · Linux · macOS · WindowsKubernetes rollout incidentConfirm context, deployment images, rollout status, and warning events before rollback.
4 steps · Linux · macOS · WindowsNginx or Apache upstream incidentSeparate public HTTP failure, local listener state, upstream reachability, and service logs.
4 steps · LinuxPostgreSQL or MySQL connectivitySeparate DNS, port, listener, authentication, and host resource failures without changing data.
5 steps · Linux · macOS · Windows