SIEM Modernization

SIEM Threat Detection: How It Works and Where It Falls Short

How SIEM threat detection actually works: ingestion, correlation, and analytics, plus the coverage gaps rule-based detection leaves open on its own.
published on
October 19, 2026
by
Go Back

SIEM threat detection is how a SIEM spots signs of attack in an organization's logs. The SIEM pulls logs from servers, laptops, firewalls, cloud services, and identity systems such as Active Directory or Okta into one place and analyzes each event as it arrives.

Security teams write correlation rules that link several events into a single suspicious pattern. They also build a baseline of normal behavior for each user and device and load threat intelligence feeds that list known-bad IP addresses and domains.

When an event matches a rule, strays from the baseline, or matches a feed, the SIEM alerts an analyst.

Two decisions limit what a SIEM can catch, and security teams make both before any attacker shows up. They choose which logs the SIEM takes in and which rules it runs.

Most SIEM detections catch one of six patterns.

  • Brute-force and password-spraying attempts, which show up as bursts of failed logins
  • Suspicious authentication, such as a login from an unfamiliar country minutes after one from the office
  • Privilege escalation, such as an account added to the domain admin group outside a scheduled maintenance window
  • Lateral movement, when a compromised machine starts logging in to servers it has never connected to
  • Connections to IP addresses, domains, or files that threat intelligence feeds flag as malicious
  • A spike in outbound data from one host, a common sign of data theft

How SIEM threat detection works in five steps

SIEM threat detection runs in five steps, and each one depends on the step before it. If a log source never reaches the SIEM, it won't be parsed, checked against rules, or matched against threat intelligence.

Step 1: Collect logs from across the environment

Security teams install collectors on laptops and servers, forward logs from firewalls and network devices, and connect cloud platforms and SaaS apps through APIs.

A typical deployment pulls Windows security event logs, firewall and proxy logs, DNS queries, identity provider sign-ins, cloud audit trails, and application logs.

Step 2: Parse and normalize each event

When an event arrives, the SIEM breaks it into fields such as user, source IP, host, action, and timestamp. It maps those fields to a common format, so an Active Directory login lines up with an Okta login.

The SIEM then indexes and stores the results so searches and rule checks run fast. That same processing is why volume-based pricing adds to the bill for every gigabyte.

Step 3: Run detection logic against the parsed events

Detection engineers set up three kinds of logic at this stage, and the SIEM runs all three against the same events at once.

Correlation rules that link events into patterns

A correlation rule describes a set of events that, together, indicate an attack, even when each one looks harmless on its own. A rule might fire when one account logs ten failed logins in five minutes, then a successful login from a new IP address, then a new mailbox forwarding rule.

Each of those events happens every day. In that order, on one account, they describe a likely account takeover, with the forwarding rule keeping the attacker in the victim's inbox after losing access.

Detection engineers build rules from conditions, thresholds, time windows, and a shared field, such as a username or host, that ties the events together. They map each rule to a MITRE ATT&CK technique to track coverage, then tune it to cut false positives.

Behavioral analytics and UEBA baselines

User and entity behavior analytics (UEBA) flags activity that no written rule anticipated. Over several weeks, the SIEM learns what normal looks like for each user, host, and service account, then assigns a risk score to activity that strays from that baseline.

A finance analyst who opens a few dozen files a day and then downloads thousands gets a higher risk score. So does a service account that suddenly starts logging in like a person at a keyboard.

A baseline needs weeks of history. If the team never collected an account's logs, the SIEM has nothing to compare against or flag.

Threat intelligence matching and enrichment

A threat intelligence feed is a constantly updated list of IP addresses, domains, URLs, and file hashes that vendors and researchers have tied to real attacks. Each entry is an indicator of compromise (IOC).

The SIEM checks every incoming event against the feed. When a laptop connects to a listed IP address or a server runs a file with a known-bad hash, the SIEM raises an alert.

The alert arrives with the indicator's reputation, the linked threat actor, and when it was last seen, so an analyst can decide how urgent it is.

IOC matching catches only what someone has already reported. A feed can't flag a domain registered yesterday, or an attacker hosting tools on a legitimate cloud storage service.

Step 4: Alert on hits and group them into incidents

When a rule fires, a UEBA score crosses its threshold, or an IOC matches, the SIEM raises an alert with a severity level and the underlying events. One intrusion can trip dozens of alerts at once.

Mature SOCs group alerts from a single intrusion into one incident, so an analyst works one case instead of 30 separate alerts.

Step 5: Respond with playbooks and analyst approval

In mature SOCs, high-confidence incidents trigger automated playbooks, and most teams run them through a SOAR platform. A typical playbook disables a compromised account, isolates a laptop, or blocks an IP address at the firewall.

Many teams keep an analyst approval step before those actions run, because a bad automated block can take down a business system.

How threat hunting extends SIEM detection

Threat hunting is the practice of searching logs for attacks that no rule or baseline caught. A hunter starts with a hypothesis, such as a new threat report describing an attacker's tools, and queries historical data to see whether that activity has already occurred.

Say a vendor publishes the command-and-control domains from a campaign that started three months ago. The hunter searches three months of DNS and proxy logs for any lookups of those domains.

When a hunter confirms a pattern, a detection engineer turns it into a correlation rule so the SIEM automatically catches the next attempt.

A hunt reaches back only as far as the team's logs and covers only the sources it collected. DNS logs in cold storage have to be restored before anyone can search them.

DNS logs nobody collected can't be hunted at all.

How SIEM differs from EDR, XDR, SOAR, and security data lakes

Related tools either feed a SIEM data, act on its alerts, or store data it could use. This table separates them by their roles.

CategoryPrimary dataMain jobRelationship to SIEM
SIEMLogs and events from endpoints, network, cloud, identity, and applicationsCorrelate events across sources, detect threats, support investigationsThe central detection and analysis layer
EDRDetailed activity data from each device, such as processes, file changes, and network connectionsDetect and contain threats on individual endpointsSends endpoint alerts and activity data into the SIEM
XDRExtended detection and responseEndpoint data plus selected email, identity, network, and cloud sources, often within one vendor's stackCorrelated detection and response across that integrated setOverlaps with SIEM detection across a narrower, tightly integrated set of sources
SOARAlerts and incidents from the SIEM and other toolsRun response playbooks and automate triage stepsActs on SIEM alerts
Security data lakeLarge volumes of raw security data in low-cost storageLong-term storage and on-demand searchesHolds data teams often can't afford to ingest into the SIEM

Scroll sideways to see all columns.

Log aggregation tools collect, store, and search logs, but they lack the correlation rules, UEBA, and alert workflows that turn a SIEM into a detection platform.

Many SOCs run EDR and a SIEM together so analysts can connect what happened on a host to identity, network, and cloud events.

Where SIEM threat detection hits structural limits

A SIEM only detects threats in the data it ingests, using the rules it runs. Both limits hold even in a well-run deployment.

For its fifth annual State of SIEM Detection Risk report, CardinalOps analyzed more than 13,000 detection rules and over 2.5 million log sources from production environments.

Enterprise SIEMs covered only 21% of the MITRE ATT&CK techniques adversaries use, and only on production systems running normally.

Limit 1: Ingestion pricing turns budget into blind spots

SIEM vendors price by the volume of data a team ingests. A 2025 ClearNetwork pricing guide puts ingestion-based pricing at $50 to $200 a month for each gigabyte of daily volume. At 50 GB a day, a team pays $2,500 to $10,000 a month.

Vectra AI estimates the total cost of a 500 GB-a-day enterprise deployment at $350,000 to $430,000 a year once storage, management, and analyst time are counted.

When every gigabyte has a price, teams pick log sources by cost first and by security value second.

Teams cut the highest-volume sources first, such as DNS query logs, flow records, cloud storage access logs, and detailed endpoint activity logs.

Those same sources record the early stages of an attack, from network reconnaissance to command-and-control traffic to files staged for theft. Archiving them saves money, but no correlation rule or baseline ever checks data the SIEM doesn't hold.

Limit 2: Rule dependency leaves novel and credential-based attacks undetected

A correlation rule only fires on a pattern someone defined in advance. A technique nobody wrote a rule for gets through, even when the team ingested every relevant log. Credential-based attacks make the problem worse. An attacker logs in over VPN with a stolen password, then moves around with PowerShell, WMI, or RDP.

To the SIEM, that looks like routine admin work.

CrowdStrike's 2026 Global Threat Report found that 82% of its 2025 detections were malware-free. The attackers used valid credentials and normal logins, so no malicious file ever touched the machines.

Rules broad enough to catch that activity also catch legitimate admin work. To keep alert volume manageable, teams narrow or disable noisy rules, and each narrowing trims coverage further.

One cause behind the coverage gap and the detection gap

Teams usually treat these two limits as separate problems. They buy more ingestion capacity to close coverage gaps, then add network detection and response (NDR) to catch what rules miss.

Both problems trace back to the same budget decision about what gets ingested. A detection engineer can't write or test a rule against a log source the SIEM never receives, and UEBA can't build a baseline for an account whose activity nobody collected.

The same missing logs slow investigations down. In our May 2026 survey, 84% of security leaders said they lack full access to logs for investigations.

Another 65% have had investigations stall because the log data they needed was out of reach.

Closing both gaps means making that data reachable for detection and investigation without paying to ingest every source.

How agentic threat detection differs from rule-based correlation

Rule-based correlation checks each event against patterns someone wrote in advance. In agentic detection, an AI agent starts with an alert or an analyst's question, pulls the logs needed for the investigation, and decides what to check next based on each result.

Take a service account that queries a directory it has never touched and then logs in to a file server. Nobody wrote a correlation rule for that sequence, and each event looks routine on its own.

An agent assigned to the alert pulls the account's identity, endpoint, and network logs and compares the new activity with the account's history. It then writes up the evidence for an analyst to review.

AI models also hallucinate. An agent working from partial logs can reach confident conclusions based on missing evidence, so complete data access matters for agents as much as it does for rules.

Our hybrid workflow architecture splits each Strike48 workflow into two kinds of steps. Steps that must run the same way every time, such as assigning severity, follow fixed logic that auditors can verify.

Agents handle the steps that need judgment, and an analyst approves any action with real consequences, such as pulling a live server off the network. Our agents also log every query and conclusion, so each finding traces back to the log data.

None of those controls help if the agent can't reach the DNS and file-server logs for that service account. In a SIEM-only deployment, those are often the sources the team cut to stay within the ingestion budget.

Augmenting SIEM threat detection with federated search

At Strike48, we remove the choice between paying to ingest a log source and going without it. We search logs where they already live, so nobody has to copy them to another platform before agents can use them.

We call this combination of complete log access and AI agents agentic log intelligence, and we lay out the full design in our platform overview.

Querying logs where they already live

Federated search sends each query to the stores that hold the data, such as the SIEM, a security data lake, or Amazon S3, and returns the results together. Each store keeps its own copy.

Search-in-place stores logs in their original form and translates them into a readable format only when someone searches for them. Nobody has to parse, normalize, and index raw logs up front.

That keeps DNS and flow logs searchable without an ingestion bill.

Agents search through the same layer, so an agent working a SIEM alert pulls matching cloud storage and DNS records without anyone exporting data. We call this layer our Flexible Data Foundation.

Keeping the existing SIEM in place

Teams that add federated search and agents keep their SIEM, along with its correlation rules, compliance reports, dashboards, and SOAR integrations. Agents investigate across data the SIEM never held.

Replacing a SIEM is disruptive. Teams rebuild years of tuned detection rules, reconnect every data source, retrain analysts, and run two platforms side by side until the switch is done.

When teams ask what is replacing SIEM, many say the answer is a layer that runs alongside it.

Running search alongside the SIEM also lets teams split data by purpose. Identity provider sign-ins and EDR alerts that feed real-time correlation rules stay in the SIEM.

DNS logs, flow records, and long-retention data that matter most during investigations and hunts move to search-in-place.

At our January 2026 launch, we reported that early deployments brought MTTD below 8 minutes, a result we attribute to agents working with complete log coverage.

How to evaluate a SIEM's threat detection

SIEM feature lists look more alike every year, so buyers learn more by running five checks against their own environments.

Check 1: ATT&CK coverage

Map the rules that run and fire in the team's own environment to MITRE ATT&CK techniques. A large vendor rule library counts for little if most of it is switched off or never tuned.

Check 2: Pricing model

Check whether cost scales with ingestion volume, users, or assets. Under ingestion pricing, every new log source raises the bill.

Check 3: Investigation reach

Ask whether analysts can search logs the SIEM never ingested, such as archived DNS or flow data, during an investigation or hunt, and how long those searches take.

Check 4: Alert handling

Review how the platform groups related alerts into incidents and how much tuning the team needs to keep false positives down.

Check 5: Detection speed

Measure MTTD on real incidents and red-team exercises, and compare the number before and after any change to rules or data coverage.

A SOC manager can judge any setup by one question. If an alert fires on a service account whose DNS logs the SIEM never ingested, can an analyst pull 90 days of those logs in a few minutes?

How to choose between tuning, augmenting, and replacing a SIEM

Teams whose SIEM already ingests the sources they need, but whose alerts run noisy or whose ATT&CK coverage is thin, get the most from detection engineering. Tuning rules, mapping them to MITRE ATT&CK, and retiring the ones that never fire costs less than any new platform.

If investigations keep stalling because the SIEM never collected the right logs, make those logs searchable first. With our federated search, analysts and agents search those logs where they already live, and the SIEM keeps running its tuned rules.

Replacement makes sense when the SIEM itself is the bottleneck, such as a renewal with a steep price increase or a platform that can't handle the team's cloud sources. Even then, a team can add a search layer first and move sources over in stages.

Request a demo to see where we extend SIEM coverage

SIEM coverage review

See which log sources your SIEM can't reach

Our team reviews each buyer's current SIEM setup and shows which log sources it can't reach and where agents would shift detection and investigation workloads.

Each session includes a live agent demo against scenarios that match the buyer's environment, plus open Q&A.

Frequently asked questions about SIEM threat detection

Is CrowdStrike a SIEM or EDR?

Both, depending on the product. CrowdStrike built its reputation on EDR with the Falcon platform and has since added Falcon Next-Gen SIEM.

What is replacing SIEM?

For most teams, a layer that works alongside the SIEM. Adding federated search and agentic investigation keeps existing detections running while analysts and agents reach data the SIEM doesn't ingest.

What are the three types of SIEM?

Most lists name on-premises, cloud, and hybrid, splitting SIEM by deployment model. An on-premises SIEM runs on hardware the organization owns and operates, a cloud SIEM is a vendor-hosted service, and a hybrid SIEM splits collection or storage between the two.

Some lists swap hybrid for managed or co-managed SIEM, where a managed security service provider (MSSP) runs the platform for the organization.

What are the top 5 SIEM tools?

No single top five holds up, because rankings vary by source and year. Three checks tell a buyer more about a platform's detection than any list.

Teams can measure how much of MITRE ATT&CK the platform's rules cover in their environment, how pricing scales with ingestion volume, and whether analysts can reach the data they need during an investigation.

Garrett Huddy

Garrett Huddy

Garrett Huddy is Director, Content Strategy at Strike48.