Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
New performance process (#10361)

This PR introduces new performance test process. See more details in https://docs.google.com/document/u/1/d/1pghuxbCR5oYWhUrIK2e4bmABQt3NEIYOOIK4iHyjWyQ/edit#heading=h.is4fzcbmxxld

    • -4
    • +18
    ./testing/DefaultPerformanceReporter.groovy
    • -0
    • +4
    ./testing/DistributedPerformanceTest.groovy
  1. … 49 more files in changeset.
Fix failures

    • -6
    • +1
    ./testing/DefaultPerformanceReporter.groovy
  1. … 2 more files in changeset.
Debug

    • -1
    • +6
    ./testing/DefaultPerformanceReporter.groovy
  1. … 1 more file in changeset.
Debug

    • -1
    • +4
    ./testing/DefaultPerformanceReporter.groovy
  1. … 1 more file in changeset.
Debug

    • -1
    • +4
    ./testing/DefaultPerformanceReporter.groovy
  1. … 1 more file in changeset.
Make error message more friendly

    • -6
    • +18
    ./testing/DefaultPerformanceReporter.groovy
  1. … 4 more files in changeset.
Make error message more friendly

    • -5
    • +14
    ./testing/DefaultPerformanceReporter.groovy
  1. … 3 more files in changeset.
Make error message more friendly

    • -6
    • +18
    ./testing/DefaultPerformanceReporter.groovy
  1. … 4 more files in changeset.
Report only on big regressions

    • -0
    • +2
    ./testing/DefaultPerformanceReporter.groovy
    • -0
    • +4
    ./testing/DistributedPerformanceTest.groovy
  1. … 4 more files in changeset.
Test

    • -1
    • +1
    ./testing/DistributedPerformanceTest.groovy
Show flakiness data in report

    • -1
    • +1
    ./testing/DistributedPerformanceTest.groovy
  1. … 15 more files in changeset.
Prefer composition over inheritance in PerformanceTest hierarchy (#10262)

### Context

Previously, we had a bad `PerformanceTest` hierarchy:

- PerformanceTest

- ReportGenerationPerformanceTest

- BuildScanPerformanceTest

- DistributedPerformanceTest

- RerunDistributedPerformanceTest

This PR does a refactoring - extracts a `PerformanceTestReporter`/`DistributedPerformanceTestReporter` out of the `PerformanceTest` hierarchy, because https://github.com/gradle/gradle-private/issues/2192 wants a report, too.

The hierarchy after the refactoring:

- PerformanceTest

- DistributedPerformanceTest

- PerformanceTestReporter

So we can make things easier.

    • -73
    • +0
    ./testing/BuildScanPerformanceTest.groovy
    • -0
    • +70
    ./testing/DefaultPerformanceReporter.groovy
    • -4
    • +68
    ./testing/DistributedPerformanceTest.groovy
    • -0
    • +29
    ./testing/PerformanceReporter.groovy
    • -0
    • +261
    ./testing/PerformanceTest.groovy
    • -76
    • +0
    ./testing/ReportGenerationPerformanceTest.groovy
    • -101
    • +0
    ./testing/RerunableDistributedPerformanceTest.groovy
  1. … 3 more files in changeset.
Refine PR

    • -38
    • +3
    ./testing/DefaultPerformanceReporter.groovy
    • -123
    • +0
    ./testing/DistributedPerformanceReporter.groovy
    • -3
    • +75
    ./testing/DistributedPerformanceTest.groovy
  1. … 3 more files in changeset.
Fix @OutputDirectory

  1. … 3 more files in changeset.
Use @CompileStatic

    • -2
    • +4
    ./testing/DistributedPerformanceReporter.groovy
Ignore test for now

    • -1
    • +7
    ./testing/DefaultPerformanceReporter.groovy
    • -2
    • +3
    ./testing/DistributedPerformanceReporter.groovy
  1. … 1 more file in changeset.
Fix test

    • -1
    • +7
    ./testing/DefaultPerformanceReporter.groovy
    • -2
    • +3
    ./testing/DistributedPerformanceReporter.groovy
    • -0
    • +2
    ./testing/DistributedPerformanceTest.groovy
  1. … 1 more file in changeset.
Refine PR

    • -0
    • +99
    ./testing/DefaultPerformanceReporter.groovy
    • -26
    • +37
    ./testing/DistributedPerformanceReporter.groovy
    • -5
    • +1
    ./testing/DistributedPerformanceTest.groovy
    • -76
    • +6
    ./testing/PerformanceReporter.groovy
  1. … 3 more files in changeset.
Skip the skipped test cases

Skip the skipped test cases

Debug json

Debug json

Refactor performance test hierarchy

    • -73
    • +0
    ./testing/BuildScanPerformanceTest.groovy
    • -0
    • +109
    ./testing/DistributedPerformanceReporter.groovy
    • -18
    • +12
    ./testing/DistributedPerformanceTest.groovy
    • -0
    • +99
    ./testing/PerformanceReporter.groovy
    • -0
    • +226
    ./testing/PerformanceTest.groovy
    • -76
    • +0
    ./testing/ReportGenerationPerformanceTest.groovy
    • -101
    • +0
    ./testing/RerunableDistributedPerformanceTest.groovy
  1. … 4 more files in changeset.
Refactor performance test hierarchy

    • -73
    • +0
    ./testing/BuildScanPerformanceTest.groovy
    • -0
    • +109
    ./testing/DistributedPerformanceReporter.groovy
    • -18
    • +12
    ./testing/DistributedPerformanceTest.groovy
    • -0
    • +99
    ./testing/PerformanceReporter.groovy
    • -0
    • +226
    ./testing/PerformanceTest.groovy
    • -76
    • +0
    ./testing/ReportGenerationPerformanceTest.groovy
    • -101
    • +0
    ./testing/RerunableDistributedPerformanceTest.groovy
  1. … 4 more files in changeset.
Fix issue of worker build failing abnormally (#10249)

This fixes https://github.com/gradle/gradle-private/issues/2273

Previously we only read the test class name from JUnit xml result. When the worker build fails prematurely, the JUnit xml result is not available. This PR fixes this issue by adding test class name to scenario list.

    • -45
    • +35
    ./testing/DistributedPerformanceTest.groovy
    • -1
    • +1
    ./testing/ReportGenerationPerformanceTest.groovy
  1. … 7 more files in changeset.
Revert "Revert "Remove test code""

This reverts commit 06f51d8686b99fde97cd6a32c5b214010c250457.

Revert "Debug"

This reverts commit 275352bb85e773f896759ab1c0a7f8a5ea631ce7.

    • -12
    • +0
    ./testing/DistributedPerformanceTest.groovy
    • -4
    • +5
    ./testing/RerunableDistributedPerformanceTest.groovy
Debug

    • -0
    • +12
    ./testing/DistributedPerformanceTest.groovy
    • -5
    • +4
    ./testing/RerunableDistributedPerformanceTest.groovy
Revert "Remove test code"

This reverts commit b9a8918e7b54150686a750e37dc887c7420437eb.

Remove test code