Pre-packed AMI to run e2e tests for 'st2' PRs (GitHub status) #95
Description
The @lakshmi-kannan proposal is to use pre-packed AMI for running e2e tests for st2 PRs:
https://stackstorm.slack.com/archives/C029K4CBU/p1498752800285229
Advantages:
- Reduce surface area of CI failures (:+1:)
Disadvantages:
- With the pre-packed AMI we leave a room for incosistencies in installed software and don't really test full install in a real conditions. With that, we should only use pre-packed AMIs for PR statuses, and not for all internal builds, where we should 100% reproduce user behavior.
- Pre-packed AMI will require from us some infra maintenance overhead to update software/re-pack from time to time, otherwise we'll end up with problems like outdated Mongo2.4 is used on slave nodes.
From the research, installing StackStorm on a clean system in our CI env takes ~200s. From this point it won't speed up the build significantly.
At least it makes sense to improve other much SLOWER spots first.