When failures become easy to ignore

An automated test that fails unpredictably may be rerun until it passes. Repeated failures that disappear on rerun can make a team miss a real problem.

Causes include network delays, tests affecting one another’s data, or race conditions where actions happen in an unexpected order. Sometimes the test exposes a product bug that only happens occasionally.

Find and fix the cause

Teams compare passing and failing runs to find the cause. They may temporarily remove the test from the usual run, but should fix and restore it: while excluded, it cannot catch problems.