Skip to content

Epoch AOC: Alerts

Alerts define health conditions for services. In this section we will walk you through setting up of Alerts in the AOC and how you can use them to send notifications to stakeholders via email, pagerduty, webhooks etc.

Creating An Alert

Under the alerts tab, the user will see a summary dashboard of all alerts along with their trigger status. The trigger status is for the selected time window which can be adjusted using the time range slider. Color coding on alert trigger status implies:

  • Red: critical threshold violation
  • Orange: warning threshold violation
  • Green: no violations
  • Grey: "NO DATA" alert when data is missing for an expected metric

Note: It is recommended that users add group(s) in the GroupBy field in the query builder for an alert if they would like to have alerts triggering based on each individual group, eg URIs. You can learn more about the GroupBy field in the analytics documentation.

All_Alerts Alert tab showing summary of all alerts over selected time range

Clicking on any row will take the user to the alert page where the user can see the groups that have been triggered by that alert and modify the alert settings.

Global filters can be modified in the alert. Additional filters can also be defined in the query builder.

Alerts Setup and configure an alert

No Data Alert An example of a "no data" alert

Note: No data alerts are only applicable to metrics that have been seen in the past but are missing data in the evaluation window of the alert. If a metric has never been seen, then we don't trigger a "no data" alert for such metric since the system doesn't know that the data is missing.

Alert Notifications

User can receive notifications for an alert through email, webhooks, Pagerduty, etc. using Configure notification settings.

Notifications Configure Alert Notifications

Viewing Alert Status

On an alert page, under the Status tab, the All Groups tab shows all the groups associated with the alert. The user can also see All Triggered Groups which contains all the groups that have triggered from among the groups that the user has selected in GroupBy (eg. http.uri) when creating an alert.

Users can add/remove/search for groups they are interested in from the filter bar. Triggered_Groups View triggered groups for an alert

Join our Public Slack Channel if you have any questions.