JVM warmup under load

An Autoscaler added Java App Servers during a spike, and the new copies ran cold: 30% speed for their first 30 s.

What happens#

An Autoscaler added Java App Servers during a spike, and the new copies ran cold: 30% speed for their first 30 s.

How to prevent it#

Slow start on the Load Balancer, scheduled scaling, and a GraalVM native image, which starts warm. With slow start a new copy takes traffic gradually, so it never answers cold.

The postmortem opens the first of these that you do not own yet:

  1. GraalVM native image
  2. Autoscaling

Components it hits#

App Server