When the benchmarks in the base commit fails they should be just ignored and not make everything fail