Agentic test generation with coverage closure
A long-lived codebase had accumulated a manual regression suite that was costly to maintain and weighted towards brittle end-to-end tests. Simply asking a code-generating model to fill coverage gaps produced plausible tests, but also duplicated existing behaviour and placed tests at the wrong level.
The team built an agent plugin and composable skills that treat test creation as a closed loop. Existing tests are inventoried before anything new is proposed. Gaps are classified and routed to the appropriate level of the test pyramid. Generated tests are run, revised against real failures, checked with coverage and mutation feedback, and held for human review before merge.
This judgement has a longer history. In 2006, the same underlying problem was addressed with a parser that read call-flow diagrams and generated test plans automatically. The technique changed; the judgement about which tests are worth writing did not.
Outcome — coverage gaps were closed at the appropriate level without duplicating tests already in the suite, and every generated test remained subject to human review.