Project-wide flaky test detection

Azure DevOps is a complex platform and today I found out something quite interesting: system-wide flaky test detection.

A really neat feature indeed - you can configure detection and management of flaky (unreliable) tests so that it does not affect the overall statistics of your code quality analysis.

In my opinion this feature shines when your tests are under development, and they are not yet finalised in your codebase. With it you can have a reliable picture with the stable tests as part of the test reporting side of the build, and these tests under development will be left on the side to allow for analysis and fixes.

Of course you have total control over what is recognised as Flaky/UnFlaky, as per this documentation screenshot:

You can always change the category and alter the build result.