QuorumWiki
Jugar
Patrones

Señales doradas, RED y USE

Vigila cuatro cosas en cada servicio, latencia, tráfico, errores y saturación, y comprueba tres más en cada recurso, para que un panel responda "qué está roto" antes de que nadie abra un log.

Pick a small, fixed set of signals for every service and every resource, so an outage starts with a graph and not a guess.

Use it when#

  • An alert says "something is slow" and nobody knows where to look first.

  • Every team graphs a different set of numbers, so no two dashboards compare.

  • You add a service and need a default dashboard on day one.

How it works#

Three sets of metrics cover a service from different sides:

  • The four golden signals, from Google's SRE book: latency, traffic, errors and saturation.

  • RED, Tom Wilkie's method, keeps three of them for each request-driven service: rate, errors and duration.

  • USE, Brendan Gregg's method, covers each resource, such as a CPU, a disk or a connection pool: utilization, saturation and errors.

Use RED for the thing users call and USE for the thing that call runs on. A checkout service at 2% errors and rising p99 (RED) with its database pool at full utilization and a growing wait list (USE) points straight at the pool.

Split latency by outcome. A fast error hides in an average, so a failed request and a successful one belong on different lines.

What it costs#

Every signal is a series that someone stores and pages on. Alert on symptoms users feel, such as errors and latency, and keep cause signals like CPU on the dashboard. Paging on CPU at 80% wakes people for machines that are fine.

In Quorum#

The Dashboard opens with Metrics, and its first rows chart the four golden signals: traffic, latency, errors and saturation. Distributed tracing adds a Services row, which is RED for each request kind, and Continuous profiling fills a Resources row, which is USE for each Node. Percentiles puts the p99 beside the mean, and Alerting pages on errors, latency, saturation, queue age or budget burn. Insight and observability explains each, and Read p99 shows how to chase a tail. The glossary defines the four golden signals, the RED method and the USE method.