Error when download started multiple times

[stherold]

Background

We have to build many while-albel apps on a regular basis. Each one runs its own bootstrap script which e.g. loads the translations.

Issue

We assume that when 2 apps are built in parallel, we get the following error:

API request error 400 Export process already exists.

Suggestion

Add retry_attempts parameter with exponential backoff so we can define how often a retry should be performed and maybe what the initial timeout should be.

[stherold]

EDIT

… as an alternative you could just permit multiple downloads 😃

[Blackjacx]

IN the end we implemented the exponential backoff ourselves. Was really easy. We have a bash function called download_internal which just encapsulates the download command and now we implemented the function below which tries calling download_internal multiple times which in exponentially increasing delay:

download() {
  MAX_RETRIES=8
  BASE_DELAY=1  # seconds

  for ((i=1; i<=MAX_RETRIES; i++)); do
      echo "Attempt $i..."

      if download_internal; then
          log "Download Completed!"
          break
      fi

      # If it's the last attempt, exit with failure
      if [[ $i -eq $MAX_RETRIES ]]; then
          log_error "All download attempts failed."
          exit 1
      fi

      # Calculate exponential delay: BASE_DELAY * 2^(i-1)
      delay=$((BASE_DELAY * 2 ** (i - 1)))
      log_warning "Retrying download in $delay seconds (attempt $i/$MAX_RETRIES)..."
      sleep $delay
  done
}

download_internal() {
  # Run the loklise2 download here
}

Maybe it helps somebody 👍