kaocha

dergutemoritz 2023-02-15T09:40:42.409789Z

Heya! Is there a builtin way of emitting / persisting which tests failed during a run for the purpose of feeding this list back into the runner for retry? Rationale: Some integrative tests in our test suite are sensitive to load on our CI runner and may flake out when a lot of other jobs are running concurrently. Retrying them usually makes them pass again. Only retrying the failed ones would greatly speed this process up. Other ideas for dealing with this welcome, too 🙂

dergutemoritz 2023-02-23T13:48:07.170869Z

Oh perfect, thanks!!

frank 2023-02-15T13:33:00.405749Z

there's this: https://github.com/lambdaisland/kaocha-junit-xml

frank 2023-02-15T13:34:32.727019Z

alternatively, if your CI system has some sort of workflow system that allows rerun of failed jobs, you could tag the integration tests and run them in their own job

Alys Brooks 2023-02-23T03:59:08.197669Z

Sorry I didn't see this sooner, but if you're still looking for a solution, consider the community-created plugin kaocha-retry: https://github.com/AndreaCrotti/kaocha-retry

dergutemoritz 2023-02-16T12:38:17.474999Z

Ah thanks, using the junit xml report (which we already have) for this purpose didn't occur to me, yet! 🙏

dergutemoritz 2023-02-16T12:39:20.417759Z

Manually tagging the tests is an option but having it work automatically is even nicer since it's easy to forget to tag a test appropriately

dergutemoritz 2023-02-16T12:39:27.514769Z

Thanks for your input!