How would you investigate these CI-only failures?

Instruction: Calculate the observed flake rate, prioritize evidence and state a bounded containment plan.

Context:

In one controlled CI sample, 200 first attempts run with eight workers; four fail, and all four pass on one retry. A separate 200-attempt sample with one worker has no failures. Traces from two failures show project not found immediately after another test deletes a shared project. The other two have not yet been inspected. The affected suite includes a critical checkout path. You have 20 minutes for initial triage before the next release review.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

The observed first-attempt failure rate is 4 out of 200, or 2%. Retries recovered those runs but did not erase the failures. The two traces provide a concrete shared-data race to investigate; they do not explain the other two without evidence...

Upgrade to view official answer

Related Questions