performance

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Add Swift performance tests

- Add project generator that can use build-builder

- Add a mediumSwiftMulti performance project

- Add a task to checkout build-builder

- Add a task to install build-builder

    • -0
    • +108
    ./generator/tasks/BuildBuilderGenerator.groovy
  1. … 3 more files in changeset.
Javadoc on the RemoteProject task

In order to clarify branch & ref properties purposes.

Signed-off-by: Paul Merlin <paul@gradle.com>

    • -5
    • +54
    ./generator/tasks/RemoteProject.groovy
Enhance the RemoteProject task to support git ref checkout

Signed-off-by: Paul Merlin <paul@gradle.com>

    • -2
    • +49
    ./generator/tasks/RemoteProject.groovy
Explain how @Internal annotated inputs are tracked

    • -3
    • +3
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
Fix buildSrc/AbstractProjectGeneratorTask task properties

    • -31
    • +81
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
    • -0
    • +2
    ./generator/tasks/CppMultiProjectGeneratorTask.groovy
    • -4
    • +10
    ./generator/tasks/JvmProjectGeneratorTask.groovy
Always generate `settings.gradle`

If not, when running a build in the performance project, Gradle may

search upwards to find the settings.gradle of the Gradle build itself

and start building buildSrc.

    • -4
    • +9
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
Add performance templates for native tests

    • -0
    • +53
    ./generator/tasks/CppMultiProjectGeneratorTask.groovy
Add performance test for using macro includes

    • -1
    • +3
    ./generator/tasks/CppMultiProjectGeneratorTask.groovy
  1. … 3 more files in changeset.
Finish native performance tests

Fixes gradle/gradle-native#158

    • -50
    • +82
    ./generator/DependencyGenerator.groovy
    • -0
    • +6
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
    • -0
    • +66
    ./generator/tasks/CppMultiProjectGeneratorTask.groovy
    • -30
    • +0
    ./generator/tasks/CppProjectGeneratorTask.groovy
  1. … 11 more files in changeset.
Add {small|medium|big}CppLibrary performance tests

This takes care of single-project C++ builds of three varying sizes.

Part of gradle/gradle-native#158

    • -0
    • +30
    ./generator/tasks/CppProjectGeneratorTask.groovy
  1. … 4 more files in changeset.
Revert "Use separate source directories for native performance tests"

This reverts commit 94110a268552560f08804eafb395d125939b131f.

    • -2
    • +3
    ./generator/tasks/MonolithicNativeProjectGeneratorTask.groovy
  1. … 1 more file in changeset.
Use separate source directories for native performance tests

I also removed the unused files from the source directories.

Our file system mirror will not be used if we use includes in directory

trees, which makes the tests much slower.

    • -3
    • +2
    ./generator/tasks/MonolithicNativeProjectGeneratorTask.groovy
  1. … 1 more file in changeset.
Fix task dependencies between test project generation performance tests

    • -0
    • +21
    ./generator/tasks/JavaExecProjectGeneratorTask.groovy
  1. … 2 more files in changeset.
Fix performance test templates

    • -3
    • +3
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
Instantiate performance test projects at execution time

The detailed configuration possibilities are now unused and

instantiating these objects at configuration time just adds

unnecessary overhead.

    • -16
    • +10
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
Remove some some duplicated words from gradle

    • -1
    • +1
    ./generator/DependencyGenerator.groovy
  1. … 20 more files in changeset.
Cleanup Java performance test projects and scenarios

- Sort tests into packages

- Add new test projects: `largeMonolithicJavaProject`,

`largeJavaMultiProject`, `mediumJavaMultiProjectWithTestNG`

- Cleanup template.gradle file

-- Remove "old Java" templates

-- Remove unused Scala and Groovy performance

test project configurations

-- Remove large enterprise performance test projects

- Simplify Java scenarios: clean assemble, first use, change test,

getting IDE models, dependency report, abi change, non-abi change

- Adjust tests to not use old test projects anymore

- Add file mutators

    • -2
    • +2
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
  1. … 96 more files in changeset.
Add a performance scenario to measure the performance of exclude rule merging

    • -1
    • +10
    ./generator/tasks/RemoteProject.groovy
  1. … 2 more files in changeset.
Fix RemoteProject setup

    • -7
    • +0
    ./generator/tasks/RemoteProject.groovy
Run GSK performance tests against small project only

Until we're sure v0.5.0 is used for all scenarios.

See gradle/gradle-script-kotlin#184

    • -4
    • +15
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
    • -2
    • +16
    ./generator/tasks/KtsProjectGeneratorTask.groovy
  1. … 6 more files in changeset.
Introduce GradleScriptKotlinBuildPerformanceTest

With first use scenario against many projects.

See gradle/gradle-script-kotlin#184

    • -0
    • +28
    ./generator/tasks/KtsProjectGeneratorTask.groovy
  1. … 5 more files in changeset.
Simplify performance measurements

The many measurements that we injected into the build under test were

skewing our measurements to the point of making them unreliable or

unrealistic. We now only measure end to end build time. Here's a breakdown

with the rationale for removing each other measurement:

- configuration time: can be done by having a `gradle help` scenario instead

- execution time: the user does not care whether a long build is stuck in execution or configuration

- setup/teardown: was ill-defined anyway, basically total - configuration - execution

- JIT compile time: this is nothing we can influence and thus pointless to measure

- Memory usage: Was only measured at one point in the build, which doesn't tell us anything about

any problems at any other point in the build

- GC CPU time: If this increases we'd see it in total execution time

Generally, looking at the graphs has never pointed us directly at the problem, we always need to

profile anyway. So instead of skewing our measurements with lots of profling code, we should

instead use a dedicated profiling job to measure if we actually see a regression.

Memory usage can be tested indirectly by giving each scenario a reasonable amount of memory.

If memory usage rises above that reasonable limit, we'd see execution time rise, telling us about

the regression. Generally, we do not optimize for smallest memory usage, but for fastest execution

with reasonable memory overhead.

This change also removes all JVM tweaking and wait periods which we introduced in an attempt to

make tests more predictable and stable. These tweaks have not really helped us achieve more stable

tests and have often done the opposite. They also add lots of complexity and make our tests more

unrealistic. A real users will not add all these JVM options to Gradle.

    • -3
    • +0
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
    • -27
    • +0
    ./generator/tasks/NativeProjectWithDepsGeneratorTask.groovy
    • -20
    • +0
    ./generator/tasks/RemoteProject.groovy
  1. … 57 more files in changeset.
Fix native performance tests

    • -1
    • +3
    ./generator/tasks/NativeProjectWithDepsGeneratorTask.groovy
Fix generation of "java software model" templates

    • -1
    • +8
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
  1. … 8 more files in changeset.
Use `buildSrc` instead of embedding classes in each subproject

The test projects all used their own copy of `CheckstyleExtension` and a custom plugin. This doesn't

reflect real projects at all. Instead, this commit changes the project layout to add a `buildSrc`

directory which contains those custom tasks/plugins.

    • -0
    • +7
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
  1. … 6 more files in changeset.
Integrate `largeEnterpriseBuild` into our performance test suite

    • -2
    • +9
    ./generator/tasks/RemoteProject.groovy
  1. … 2 more files in changeset.
Add a deeper dependency structure for native dependents

+review REVIEW-6181

    • -2
    • +24
    ./generator/tasks/NativeProjectWithDepsGeneratorTask.groovy
  1. … 2 more files in changeset.
Fix measurement plugin jar not being generated for Android performance tests

    • -0
    • +59
    ./generator/tasks/RemoteProject.groovy
  1. … 2 more files in changeset.
Add native project generator that uses project dependencies

    • -0
    • +236
    ./generator/tasks/AbstractProjectGeneratorTask.groovy
    • -1
    • +1
    ./generator/tasks/JvmProjectGeneratorTask.groovy
    • -1
    • +1
    ./generator/tasks/MonolithicNativeProjectGeneratorTask.groovy
    • -1
    • +1
    ./generator/tasks/NativeProjectGeneratorTask.groovy
    • -0
    • +308
    ./generator/tasks/NativeProjectWithDepsGeneratorTask.groovy
    • -211
    • +3
    ./generator/tasks/ProjectGeneratorTask.groovy
  1. … 39 more files in changeset.
Remove unnecessary sharedTemplateArgs feature

    • -3
    • +0
    ./generator/tasks/ProjectGeneratorTask.groovy
  1. … 2 more files in changeset.