LogTotal Sanitizer Pack Pseudonymizes Sensitive Data Before It Reaches Cribl Detect

Summary
The open-source Cribl Pack uses keyed, type-labeled tokens to pseudonymize sensitive log values before they reach Detect, preserving correlation while warning that tokenization can disrupt IOC matching and other lookups.
Key points
- The Pack processes the _raw field in a Cribl Pipeline, replacing detected sensitive values with deterministic, type-labeled HMAC-SHA-256 tokens.
- It detects 11 categories of sensitive values, including secrets, payment data, identifiers, addresses, hostnames and usernames; JSON values under recognized sensitive keys are also replaced.
- The article says analysts can still correlate events containing the same token, while original values are removed from data sent to downstream consumers and storage.
- For deployment, the Pack should run before parsing, and Workers that need matching tokens must share the same key, Pack version and rule configuration.
- Tokenized IPs, domains and usernames will not match IOC feeds, GeoIP databases, CIDR rules or asset lookups; the article recommends running relevant detections and enrichment before sanitization or retaining a restricted full-fidelity copy.
- The article cautions that regex processing can increase CPU use and false positives, and that rotating the key changes all tokens.
Article Details
- Defense Focus
- Pseudonymize sensitive values in log data before it reaches Cribl Detect, analysts, AI-assisted triage, notifications, and retained datasets, while preserving deterministic correlation between events.
- Detection Methods
- Apply the Pack’s built-in detectors to the _raw field before parsing; for JSON, also replace values under recognized sensitive key names.
- Use the bundled preview sample to verify sanitized output and confirm relevant detections still fire.
- Run detections and enrichment that require original values before the sanitization step.
- Data Sources
- Cribl Stream event data, with _raw as the default field processed
- JSON log values under recognized sensitive key names
- Rule Types
- Custom-function JSON rules using a rule ID, regular expression, mode, and token prefix
- Correlation detections operating on deterministic typed tokens
- Platforms
- Cribl Detect
- Cribl Stream Pipelines and Routes
- Defensive Actions
- Place the Pack upstream of parsing and before the Route delivers data to Detect; re-extract fields from sanitized _raw if needed.
- Store a random HMAC key as a Worker Group Secret and use the same key, Pack version, and rule configuration on Workers that must generate matching tokens.
- Start with a high-risk source, validate output and detection behavior, then extend deployment to other Routes.
- Run IOC-dependent detections and enrichment before sanitization; where needed, disable the ips and hosts rules on the affected Route or send a full-fidelity copy to a restricted store.
- Plan key rotation around dataset retention because rotation changes token values.
- Account for regular-expression processing costs when sizing Workers, especially when using aggressive mode.
- Confirm custom-function support before relying on Cribl-managed Workers; the article says support should be confirmed.
People
Vendors
Products
Cribl DetectCribl Detect, released on September 29, 2026, is a SIEM that runs on Cribl’s data platform.Cribl LogTotal SanitizerThe Cribl LogTotal Sanitizer is an open-source Cribl Pack (this project is not affiliated with Cribl or SOC Prime) built on the sanitization engine of SOC Prime’s LogTotal.Cribl StreamThe data it stores and searches is ingested through Cribl Stream Routes and Pipelines, so a sanitization step in those Pipelines determines what analysts, AI-assisted triage, alert notifications and retained datasetsLogTotalThe Cribl LogTotal Sanitizer is an open-source Cribl Pack (this project is not affiliated with Cribl or SOC Prime) built on the sanitization engine of SOC Prime’s LogTotal.LogTotal Sanitizer PackFor deployments that send security data to Cribl Detect, the LogTotal Sanitizer Pack provides in-pipeline pseudonymization at low cost.