Skip to content

Latest commit

 

History

History
68 lines (58 loc) · 3.22 KB

README.md

File metadata and controls

68 lines (58 loc) · 3.22 KB
Raw

Performance Tests

This folder contains files used to run Eclipse Platform Performance tests. Performance tests are run in the Eclipse Platform Releng Jenkins instance.

Results collection is handled by the collection job in Jenkins which runs collectTestResults.xml

Running Performance Tests Locally

In order to run the performance tests locally:

  • Set environment variables for JOB_NAME, WORKSPACE and testToRun.
    • JOB_NAME can be anything, it's used to generate the names for results files and folders
    • WORKSPACE is the location where generated files will be placed.
    • testToRun determines whether to run selectPerformance or otherPerformance (usually selectPerformance) For Reference:
    • Set buildId to the build you want to test
      i.e export buildId=I20220324-0140 or export buildId=R-4.23-202203080310 etc
    • Set baselinePerf=true if running the baseline version of the tests.
  • Download and source buildproperties.shsource for the build. 
    curl -o buildproperties.shsource https://download.eclipse.org/eclipse/downloads/drops4/${buildId}/buildproperties.shsource
source buildproperties.shsource
  • Make sure you have the latest testScripts/hudsonBootstrap/getEBuilder.xml from this folder.
    If you don't want to pull the whole repo: 
    wget -O getEBuilder.xml --no-verbose https://download.eclipse.org/eclipse/relengScripts/production/testScripts/hudsonBootstrap/getEBuilder.xml 2>&1
  • Make sure you have ant installed so you can run the following command: 
    ant -f getEBuilder.xml -Djava.io.tmpdir=${WORKSPACE}/tmp -DbuildId=$buildId -Djvm=$JAVA_HOME/bin/java -DeclipseStream=${STREAM} -DEBUILDER_HASH=${EBUILDER_HASH}  -DbaselinePerf=${baselinePerf} -DdownloadURL=http://download.eclipse.org/eclipse/downloads/drops4/${buildId}  -Dosgi.os=linux -Dosgi.ws=gtk -Dosgi.arch=x86_64 -DtestSuite=${testToRun} -Dtest.target=performance

Select and Other Performance

(From the testToRun parameter description in Jenkins, probably needs to be updated)

Collections:
selectPerformance  (a group of tests that complete in about 3 hours)
otherPerformance   (a small group of tests that either are not working, or take greater than one hour each).

Individual Tests Suites, per collection:
selectPerformance:

antui
compare
coreresources
coreruntime
jdtdebug
jdtui
osgi
pdeui
swt
teamcvs
ua
uiforms
uiperformance
uircp

otherPerformance:
equinoxp2ui
pdeapitooling
jdtcoreperf
jdttext
jdtuirefactoring