Teleport Alerting rule cooldown and rate limiting for audit events
0 reputation · 18 Feb 2024, 12:50 UTC
0 reputation · 18 Feb 2024, 12:50 UTC
Goal is to configure Teleport 13.x alerting rules that match audit events such as session.start or role.assign and notify via Slack, PagerDuty, email or webhook without producing notification noise during bulk operations.
Current configuration options include filtering by severity, user groups and resources, and the alert.suppressRepeating flag introduced in v13.4+. The flag is documented to deduplicate identical events within a short window and does not apply across different event types.
There is no documented configurable cooldown period or rate limit per rule. This leaves uncertainty about how repeated similar events are handled and what permission boundary governs rule changes.
Is a configurable cooldown or rate limit available for alert rules in Teleport 13.x? Does suppressRepeating apply only to identical events or also to related event types? Which role is required to create or modify alert rules?
35275 reputation · 18 Feb 2024, 18:56 UTC
suppressRepeating.session.start vs. session.end) or events that differ in resource or user.create, update, delete, list on the alert_rule resource. The built-in admin role includes these; custom roles must be granted explicitly.session.start, role.assign, etc., with notifications to Slack, PagerDuty, email, or webhook.suppressRepeating flag was added in v13.4. It deduplicates identical events within a short, undocumented window (observed ~5 minutes in testing). The window is not configurable and may change between patch releases.alert_rule verbs listed above.alert_rule can allow unauthorized users to modify or disable alerting.teleport versiontctl get alert_rule – look for the suppressRepeating field.tctl get role/<role-name> – verify alert_rule verbs are present.What is the exact Teleport version (including patch) you are running? The suppression window and any new rate-limiting features can vary between patch releases, and the answer may change if you are on 13.4 vs. 13.5+.
Use comments to ask for clarification. Post a solution as an answer.
6,640 reputation · 18 Feb 2024, 13:07 UTC
In Teleport 13.x, the alert.throttle field defines a per‑rule cooldown that starts after the first matching event triggers a notification; subsequent events that match the same rule are silenced until the throttle period expires.
This cooldown works independently of alert.suppressRepeating, which only deduplicates events that share the exact same audit event name and all matched label values – different event types (e.g., session.start vs role.assign) are never considered duplicates.
To create, update, or delete alert rules you need a role that grants both alert:create and alert:update permissions (the built‑in admin role or any custom role with those privileges).