This page contains supplemental data about the experiments that we performed in our ICSE 2018 paper on DeFlaker. Slides from our ICSE 2018 talk are also available online.
Specifically, we have posted the following data sets:
- Listing of all projects included in the historical evaluation
- Listing of each version of each project included in the historical evaluation
- Listing of all of the hand-confirmed identified flaky tests
- Listing of all of the projects included in the live evaluations
- Listing of flaky tests detected in historical reruns (note: this is not an exhaustive list of all flaky tests in these projects – it only represents what we found)