DevOps Interview DropExpert TierScenario+100 XP on read
p99 latency on a critical API jumped from 120ms to 3s an hour ago. p50 is unchanged. How do you find the cause?
#Observability#Performance#SRE#Incident
Core Summary
An unchanged p50 with a blown p99 means most requests are fine and a specific subset is not — which rules out broad causes like CPU saturation and points at something correlated: one dependency, one shard, one node, one customer, or garbage collection. The shape of the latency distribution is the diagnosis.
Hints
Hint 1: p50 unchanged is the most informative fact you have
Hint 2: Ask what makes only some requests slow
Hint 3: Correlate by dimension before you look at any code
Reported in interviews at Google, Netflix, Uber