Skip to content

Releases: Azure/azure-storage-azcopy

v10.27.0

31 Oct 17:35
fed3e4f
Compare
Choose a tag to compare

Version 10.27.0

New Features

  1. Added ability to specify concurrency of piped uploads via the AZCOPY_CONCURRENCY_VALUE environment variable. (#2821)
  2. Update message returned when transfer failure is related to tags permission issues. (#2798)
  3. Optimized number of calls to create directory. (#2828)

Dependency updates

  1. Golang 1.22.5 -> 1.23.1
  2. azidentity 1.7.0 -> 1.8.0
  3. azcore 1.13.0 -> 1.16.0

Bug Fixes

  1. Fixed an issue where piped downloads in Linux would append AzCopy version information if on an older version. (#2774)
  2. Fixed an issue where sync with --hash-meta-dir would cause original files to be hidden. (#2758)
  3. Fixed an issue where jobs list would result in a segmentation violation. (#2714)
  4. Fixed an issue where list for File would not allow OAuth. (#2821)
  5. Fixed an issue where folders would be handled improperly on FNS accounts. (#2809)
  6. Fixed an issue where --dry-run would sometimes panic due to closing a log file that was already closed. (#2832)
  7. Fixed an issue where sync --delete-destination-files was overwriting all destination files. (#2818)
  8. Fixed an issue where AzCopy would panic due to sending on an already closed channel. (#2703)

Documentation

  1. Updated in line text help message to say that source and destinations cannot be modified during transfers. (#2826)

AzCopy v10.26.0

31 Jul 14:24
0054ae0
Compare
Choose a tag to compare

Security fixes

  1. Updated dependencies to address security vulnerabilities.

New Features

  1. AzCopy now supports distribution through package managers for Red Hat Enterprise Linux (RHEL), Ubuntu, Mariner, Debian, SUSE, Rocky and CentOS. (#2728)

Dependency updates

  1. Golang 1.22.4 -> 1.22.5
  2. azidentity 1.6.0 -> 1.7.0

Bug Fixes

  1. Fixed an issue where AzCopy would fail to unmarshal the _token_refresh_source property correctly when performing copy jobs from OAuth-attached containers. (#2710)
  2. Fixed a CI pipeline in Azure DevOps to automatically detect CVEs declared against our dependencies. (#2705)

AzCopy v10.25.1

14 Jun 00:29
d186328
Compare
Choose a tag to compare

Security fixes

  1. Updated Golang to 1.22.4 to address security vulnerabilities

Dependency updates

  1. Golang 1.22.3 -> 1.22.4
  2. azidentity 1.5.1 -> 1.6.0

Bug Fixes

  1. Fixed a regression in list where --output-type=text would not output any information
  2. Adjusted parsing of AZCOPY_OAUTH_TOKEN_INFO to support both enum names as a string and integers (for users that took dependency upon the accidental changes in 10.25)

AzCopy v10.25.0

28 May 20:01
6d9a50c
Compare
Choose a tag to compare

Security fixes

  1. Updated Golang version to 1.22.3 to address security vulnerabilities

New Features

  1. Workload Identity authentication is now available (#2619)
  2. azcopy list now supports a --location flag, to support ambiguous URIs (#2595)
  3. azcopy list now properly supports --output-type=json for users in automated scenarios. (#2629)

Bug Fixes

  1. Fixed a bug where AzCopy was not reporting performance info in -output-type=json (#2636)
  2. Fixed a bug AzCopy would crash when operating on extremely large (16.5+TB) managed disks (#2635)
  3. Fixed a bug with hash-based sync where the directory structure would not be replicated when using --local-hash-storage-mode=HiddenFiles with --hash-meta-dir (#2611)
  4. Fixed a bug where attempting to use a non-S3/GCP/Azure storage URI would result in treating the URI as a local path (#2652)

Documentation changes

  1. Updated inaccurate helptext and filled in missing helptext (#2649)
  2. Many important errors now include a link to relevant documentation to assist users in troubleshooting AzCopy (#2647)
  3. Ambiguous flags (such as --cpk-by-value) have improved clarity in documentation (#2615)
  4. A clearer error message is provided when failing a transfer due to authorization. (#2644)
  5. A special error has been created when performing an Azure Files to Azure Blob Storage transfer, indicating present lack of service-side support (#2616)

AzCopy v10.25.0-Preview-1

AzCopy v10.24.0

26 Mar 21:53
6cd1b4a
Compare
Choose a tag to compare

Version 10.24.0

New Features

  1. Print summary logs at lower log levels and add BytesTransferred to the output in the jobs show command. (#1319)
  2. Added a flag --put-blob-size-mb to copy, sync and bench commands to specify the maximum size of a blob to be uploaded using PutBlob. (#2561)
  3. Added support for latest put blob service limits. Block blob put blob size can now be set up to 5000MB. (#2569)
  4. Updated all SDK dependencies to their latest version. (#2599)
  5. Updated summary logs to use consistent wording across all commands. (#2602)

Bug Fixes

  1. Fixed an issue where AzCopy would fail to auto login with the AZCOPY_AUTO_LOGIN_TYPE environment variable set to PSCRED on certain Linux and MacOS environments. (#2491)(#2555)
  2. Fixed a bug where page blob download optimizer would behave incorrectly on highly fragemented blobs if the service times out. (#2445)
  3. Ignore 404 errors on retried deletes. (#2554)
  4. Fixed a bug where the VersionID property would not be honored on the list command. (#2007)
  5. Fixed a bug where ADLS Gen2 paths with encoded special characters would fail to transfer. (#2549)
  6. Fixed an issue where ACL copying would fail when specifying an ADLS Gen2 account with the blob endpoint. (#2546)
  7. Fixed an issue where the snapshot ID would not be preserved when testing which authentication type to use for managed disks. (#2547)
  8. Fixed an issue where copy would panic if a root directory is specified as the destination. (#2036)

Documentation

  1. Removed the azcopy login/logout deprecation notice. (#2589)
  2. Added a warning for customers using Shared Key for Azure Datalake transfers to indicate that Shared Key authentication will be deprecated and removed in a future release. (#2569)
  3. Updated the list help text to clearly indicate the services and authentication types supported.(#2563)

Security fixes

  1. Updated dependencies to address security vulnerabilities.

AzCopy v10.23.0

29 Jan 19:55
7aa3141
Compare
Choose a tag to compare

Version 10.23.0

New Features

  1. Added support to ignore the error and output a summary if a cancelled job has already completed through the use of the --ignore-error-if-completed flag. (#2519)
  2. Added support for high throughput append blob. Append blob block size can now be set to up to 100 MB. (#2480)
  3. Added support to exclude containers when transferring from account to account through the use of the --exclude-container flag. (#2504)

Bug Fixes

  1. Fixed an issue where specifying AZCOPY_AUTO_LOGIN_TYPE in any form other than uppercase would be incorrectly parsed. (#2499)
  2. Fixed an issue where a failure to rename a file from the temporary prefix to the file name would not be considered to be a failed transfer. (#2481)
  3. Fixed an issue where closing the log would panic for benchmark jobs. (#2537)
  4. Fixed an issue where --preserve-posix-properties would not work on download. (#2497)
  5. Fixed an issue where --decompress would not be honored in Linux. (#2392)
  6. Fixed an issue where log files would miss the .log extension. (#2529)
  7. Fixed an issue where AzCopy would fail to set metadata properties on a read only directory when using the --force-if-read-only flag. (#2515)
  8. Fixed an issue where the AzCopy log location on resumed jobs would be reported incorrectly. (#2466)
  9. Fixed an issue with preserving SMB properties in Linux. (#2530)
  10. Fixed an issue where long-running service to service copies using OAuth at the source would result in the token expiring too early. (#2513)
  11. Fixed an issue where AzCopy would try to create folders that already existed, resulting in many unnecessary requests. (#2511)

Documentation

  1. Updated --include-directory-stub inline help to match public documentation. (#2488)

AzCopy v10.22.2

10 Jan 18:13
Compare
Choose a tag to compare

Version 10.22.2

  1. Fixed an issue where AzCopy operations pointed at a snapshot or version object would operation on the base object instead.
  2. Fixed an issue where AzCopy would download only the base blob when the --list-of-versions flag was used.

AzCopy v10.22.1

20 Dec 16:56
e089ffb
Compare
Choose a tag to compare

Version 10.22.1

Bug Fixes

  1. Fixed a regression with Azurite support. (#2485)
  2. Fixed an issue where AZCOPY_OAUTH_TOKEN_INFO would be refreshed too often. (#2503)
  3. Fixed an issue where commands would lag for multiple seconds. (#2482)
  4. Fixed an issue where azcopy version would crash. (#2483)

Documentation

  1. Updated documentation to include AZCLI and PSCRED auto login types. (#2494)

Security fixes

  1. Updated dependencies to address security vulnerabilities.

AzCopy v10.22.0

05 Dec 20:04
e13f9e5
Compare
Choose a tag to compare

Version 10.22.0

New Features

  1. Migrated to the latest azdatalake SDK.
  2. Added support for OAuth when performing File -> File and Blob -> File copy/sync and File make/list/remove (#2302).
  3. Added support to set tier on premium block blob accounts. (#2337)
  4. Added support to cache latest AzCopy version and check the remote version every 24 hours instead of every run. (#2426)
  5. Updated all SDK dependencies to their latest version and the default service version to 2023-08-03 for all services. (#2402)
  6. Added support to rotate AzCopy logs. (#2213)
  7. Added support to authenticate with Powershell and Azure CLI credentials. (#2433)

Bug Fixes

  1. Fixed an issue where http headers and access tier would sometimes be sent as empty headers.
  2. Fixed an issue where AzCopy would panic when passing an un-parseable URL. (#2404)
  3. Fixed an issue where Object ID would be set as Resource ID when using MSI. (#2395)
  4. Fixed an issue where the percent complete stat could round incorrectly. (#1078)
  5. Fixed an issue where no transfers were scheduled would be logged as an error, it is now logged as a warning. (#874)
  6. Fixed an issue where non canonicalized headers would not be printed in the log. (#2454)
  7. Fixed an issue where cold tier would not be recognized as an allowed tier. (#2447)
  8. Fixed an issue where s2s append blob copies would fail with AppendPositionConditionNotMet error on retry after first experiencing a service timeout error. (#2430)
  9. Fixed an issue where AZCOPY_OAUTH_TOKEN_INFO would not be refreshed. (#2434)

Documentation

  1. Updated --preserve-permissions documentation to indicate the correct roles necessary to perform the operation. (#2440)
  2. Updated help message for sync and copy to include all ADLS Gen2 supported auth methods. (#2440)

Security fixes

  1. Updated dependencies to address security vulnerabilities.