Benchmarks v0.2.0

Highlights

This release is a complete refactor of the benchmark suite with the aim of improving consistent and ease of introducing new benchmarks.

• Three new benchmarks have been created as a part of the SC24 artifacts.
• All package dependencies have been pinned to their latest versions.
• Benchmark readmes have been updated.

What's Changed

Breaking Changes

• Prototype new benchmark protocols and runner by @gpauloski in #118
• Refactor and bug fixes in task-pipelining benchmark by @gpauloski in #123
• Refactor workflow-memory benchmark by @gpauloski in #124

Enhancements

• Add Executor abstraction by @gpauloski in #113
• Add task pipelining benchmark by @gpauloski in #114
• Add DAOS ProxyStore backend support by @gpauloski in #115
• Add the workflow simulation benchmark by @gpauloski in #116
• Assorted minor improvements after #119 by @gpauloski in #120
• Add stream scaling benchmark by @gpauloski in #121
• Improve various aspects of new benchmarks for production runs by @gpauloski in #125
• Add manual memory management to workflow memory benchmark by @gpauloski in #126
• Fix bugs and improve workflow memory benchmark. by @gpauloski in #127
• Improve benchmarks for Polaris runs by @gpauloski in #129
• Add --stage-repeat to workflow-memory benchmark by @gpauloski in #132
• Switch executor model to concurrent.futures.Executor by @gpauloski in #135
• Migrate benchmarks to new harness by @gpauloski in #136

Documentation

• Add zenodo badge by @gpauloski in #73

Package Changes

• Drop Python 3.7 support by @gpauloski in #76
• Update copyright year by @gpauloski in #111
• Update to ProxyStore v0.6 and other dependencies by @gpauloski in #112
• Update Colmena and ProxyStore dependencies by @gpauloski in #122
• Bump Globus Compute, Parsl, and ProxyStore versions by @gpauloski in #137
• Bump to Benchmarks v0.2.0 by @gpauloski in #138

Development Workflows

• Bump actions/checkout from 3 to 4 by @dependabot in #85
• Bump actions/setup-python from 4 to 5 by @dependabot in #99
• Bump actions/cache from 3 to 4 by @dependabot in #105

New Contributors

• @dependabot made their first contribution in #85

Full Changelog: v0.1.1...v0.2.0

Benchmarks v0.1.1

What's Changed

Package Changes

• CI/Package improvements by @gpauloski in #65
• Bump ProxyStore dependency to v0.5.1 by @gpauloski in #71

Full Changelog: v0.1.0...v0.1.1

Benchmarks v0.1.0

The first release of the ProxyStore benchmark suite.

What's Changed

• Simple FuncX Benchmark by @gpauloski in #1
• Move benchmarks to executable submodules by @gpauloski in #5
• Endpoint QPS Benchmark by @gpauloski in #6
• Update badge links after ownership transfer by @gpauloski in #7
• Fix package URL by @gpauloski in #8
• Package dependency updates by @gpauloski in #12
• Benchmark Updates by @gpauloski in #14
• Update FuncX to >=1.0.3 (#17) by @gpauloski in #18
• Add endpoint-peering benchmark by @gpauloski in #19
• Change endpoint-peering to remote-ops by @gpauloski in #21
• Update to FuncX>=1.0.5 (#32) by @gpauloski in #33
• Test workflow updates by @gpauloski in #34
• Update FuncX tasks to ProxyStore v0.4.0 by @charliesabino in #37
• Template and Colmena benchmarks by @gpauloski in #38
• Pin dependencies and fix PR template by @gpauloski in #39
• Support Python 3.11 by @gpauloski in #25
• Add websocket, Margo, and UCX stores to FuncX tasks by @charliesabino in #40
• Migrate to pyproject.toml by @gpauloski in #41
• Use importlib to set __version__ by @gpauloski in #42
• Add ZeroMQStore by @charliesabino in #49
• Update development install instructions (#46) by @gpauloski in #51
• Add IPFS to funcx-tasks benchmark by @gpauloski in #53
• Benchmarks v0.1.0 by @gpauloski in #64

New Contributors

• @gpauloski made their first contribution in #1
• @pre-commit-ci made their first contribution in #4
• @charliesabino made their first contribution in #37
• @ValHayot make their first contribution in #64

Full Changelog: https://github.com/proxystore/benchmarks/commits/v0.1.0