Add a periodic workflow that will deploy on EC2 and run benchmarks #114
Description
What problem this enhancement will solve?
We want to have daily benchmarks to ensure the integrity of performance, footprint, etc. Using default github runners alone doesn't give a clear snapshot of performance since the underlying infra is unknown.
What is your proposal?
Spin up EC2 instances for benchmarking. This issue will cover getting the initial setup done. Testing will be a separate issue.
Tentatively the workflow would be:
- Install Ansible, setup vault and secrets from GH actions
- Setup Ansible ENV and VAR files
- Deploy machines to EC2
- Run a dummy test
- Destroy the machines once the test completes