Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ignoring of S3 Glacier type errors #2834

Open
Flood-ctrl opened this issue Oct 16, 2024 · 6 comments
Open

Ignoring of S3 Glacier type errors #2834

Flood-ctrl opened this issue Oct 16, 2024 · 6 comments
Labels

Comments

@Flood-ctrl
Copy link

Hello is it possible to add some options or parameter for ignoring S3 Glacier type, I had a bunch of objects in the S3 and I was needed to move the data to AZ Storage account by using azcopy copy and during the copy I had a lot of failed (and canceled by azcopy) attempts due to objects were already moved to S3 Glacier and azcopy shows the error: RESPONSE 403: 403 Forbidden ; ERROR CODE: CannotVerifyCopySource ; and operation was canceled. It will be great if azcopy will be able to skip or/and ignore the errors related to Glacier type.
Thank you,
Serhii

momodedev added a commit to momodedev/azure-storage-azcopy that referenced this issue Oct 29, 2024
@momodedev
Copy link

INFO: Skipping S3 object launch.json, as it is not a valid AWS storage class: DEEP_ARCHIVE

failed to perform copy command due to error: cannot start job due to error: Invalid AWS Storage Class: DEEP_ARCHIVE.

Is the above output message your expectation?

@Flood-ctrl
Copy link
Author

If it doesn’t fail the entire copy process and only notifies about the unavailability of the copying object due to the S3 storage class, then that’s fine. Thank you.

@momodedev
Copy link

Yes, it is. the change just output the message as mentioned above.

@Flood-ctrl
Copy link
Author

Sounds good, cause my concerns were mostly about the interruption of copy process if issues with S3 storage class appear if the fix will ignore this issue and will proceed with the copy then great. Thank you

@momodedev
Copy link

I can send the azcopy.exe to you. You might test it in your environment.

@Flood-ctrl
Copy link
Author

Unfortunately I'm not able to test it cause I don't have sanitized data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants