- Added error to using Azure Files without a SAS token (invalid auth configuration)
- AzCopy v10 now outputs a sensible error & warning when attempting to authenticate a storage account business-to-business
--log-level=none
now drops no logs, and has a listing in--help
- Jobs created with earlier releases cannot be resumed with this release. We recommend you update to this release only when you have no partially-completed jobs that you want to resume.
-
Files with
Content-Encoding: gzip
are now downloaded in compressed form. Previous versions tried to save a decompressed version of the file. But they incorrectly truncated it at the original compressed length, so the downloaded file was not complete.By changing AzCopy to save the compressed version, that problem is solved, and Content-MD5 checks now work for such files. (It is assumed that the Content-MD5 hash is the hash of the compressed file.)
- Headers for Content-Disposition, Content-Language and Cache-Control can now be set when uploading
files to Blob Storage and to Azure Files. Run
azcopy copy --help
to see command line parameter information, including those needed to set the new headers. - On-screen job summary is output to the log file at end of job, so that the log will include those summary statistics.
- Fixed typo in local traverser (error handling in walk).
- Fixed memory alignment issue for atomic functions on 32 bit system.
- The
--block-size
parameter has been replaced by--block-size-mb
. The old parameter took a number of bytes; the new one takes a number of Megabytes (MiB). - The following command line parameters have been renamed, for clarity
--output
is now--output-type
--md5-validation
is now called--check-md5
--s2s-source-change-validation
is now called--s2s-detect-source-changed
--s2s-invalid-metadata-handle
is is now called--s2s-handle-invalid-metadata
--quota
(in themake
command) is now called--quota-gb
. Note that the values were always in GB, the new name simply clarifies that fact
- AzCopy is now able to be configured to use older API versions. This enables (limited) support for Azure Stack.
- Listing command now shows file sizes.
- AzCopy v10 now works correctly with ADLS Gen 2 folders that contain spaces in their names.
- When cancelling with CRTL-C, status of in-progress transfers is now correctly recorded.
- For security, the Service-to-Service (S2S) feature will only work if both the source and destination connections are HTTPS.
- Use of the
--overwrite
parameter is clarified in the in-application help. - Fixed incorrect behavior with setting file descriptor limits on platforms including OS X and BSD.
- On Linux and OS X, log files are now created with same file permissions as all other files created by AzCopy.
- ThirdPartyNotice.txt is updated.
- Load DLL in a more secure manner compatible with Go's sysdll registration.
- Fixed support for relative paths and shorthands.
- Fixed bug in pattern matching for blob download when recursive is off.
- For creating MD5 hashes when uploading, version 10.x now has the OPPOSITE default to version
AzCopy 8.x. Specifically, as of version 10.0.9, MD5 hashes are NOT created by default. To create
Content-MD5 hashs when uploading, you must now specify
--put-md5
on the command line.
- Can migrate data directly from Amazon Web Services (AWS). In this high-performance data path the data is read directly from AWS by the Azure Storage service. It does not need to pass through the machine running AzCopy. The copy happens syncronously, so you can see its exact progress.
- Can migrate data directly from Azure Files or Azure Blobs (any blob type) to Azure Blobs (any blob type). In this high-performance data path the data is read directly from the source by the Azure Storage service. It does not need to pass through the machine running AzCopy. The copy happens syncronously, so you can see its exact progress.
- Sync command prompts with 4 options about deleting unneeded files from the target: Yes, No, All or
None. (Deletion only happens if the
--delete-destination
flag is specified). - Can download to /dev/null. This throws the data away - but is useful for testing raw network performance unconstrained by disk; and also for validing MD5 hashes in bulk (when run in a cloud VM in the same region as the Storage account)
- Fixed memory leak when downloading large files
- Fixed performance when downloading a single large file
- Fixed bug with "too many open files" on Linux
- Fixed memory leak when uploading sparse files (files with big blocks of zeros) to Page Blobs and Azure Files.
- Fixed issue where application crashed after being throttled by Azure Storage Service. (The primary fix here is for Page Blobs, but a secondary part of the fix also helps with Block Blobs.)
- Fixed functionality and usabilty issues with
remove
command - Improved performance for short-duration jobs (e.g. those lasting less than a minute)
- Prevent unnecessary error message that sometimes appeared when cancelling a job
- Various improvements to the online help and error messages.
- Rewrote sync command to eliminate numerous bugs and improve usability (see wiki for details)
- Implemented various improvements to memory management
- Added MD5 validation support (available options: NoCheck, LogOnly, FailIfDifferent, FailIfDifferentOrMissing)
- Added last modified time checks for source to guarantee transfer integrity
- Formalized outputs in JSON and elevated the output flag to the root level
- Eliminated outputs to STDERR (for new version notifications), which were causing problems for certain CI systems
- Improved log format for Windows
- Optimized plan file sizes
- Improved command line parameter names as follows (to be consistent with naming pattern of other parameters):
- fromTo -> from-to
- blobType -> blob-type
- excludedBlobType -> excluded-blob-type
- outputRaw (in "list" command) -> output
- stdIn-enable (reserved for internal use) -> stdin-enable