Unable to obtain the files successfully copied from disk to Azure blob

[Chris-Young-Data]

Which version of the AzCopy was used?

AzcopyVersion 10.31.0

Which platform are you using? (ex: Windows, Mac, Linux)

OS-Environment windows
OS-Architecture amd64

What command did you run?

copy \\REDACTED\MySourceFolder https://AzureBlob/MyFolder?si=REDACTED --recursive=true --overwrite=false --output-type=json

What problem was encountered?

The files that are skipped are included in the JSON file, but there is no listing of the files successfully copied.

How can we reproduce the problem in the simplest way?

Copy some files from a folder.
Add another file to the folder.
Re-run AzCopy to copy files from the folder.
You will see the files skipped, but no mention of the files successfully copied.

Have you found a mitigation/solution?

No

[vibhansa-msft]

At the end of the job you will see a summary which clearly indicates number of files copied successfully, skipped and failed. By default the logging level is warning and only skipped or failed will be listed. If you want more details you need to enable debug level logs.

[Chris-Young-Data]

At the end of the job you will see a summary which clearly indicates number of files copied successfully, skipped and failed. By default the logging level is warning and only skipped or failed will be listed. If you want more details you need to enable debug level logs.

So, setting the logging level to debug will cause the output in the data supplied by the --output-type=json option to include the names of the files copied?

[vibhansa-msft]

no log level debug will dump more info in the log files. output-type=json just helps you convert the console output to json format which might be needed for automation tasks.

[Chris-Young-Data]

OK. Thanks.

I am trying to automate the copying of SQL Server database backup files from on-premise storage into Azure storage for redundancy. Unfortunately, SQL Server does not support backup mirroring to disparate storage types, so I can't mirror to DISK and URL.
The number of files transferred is not high, less than 100 each call. I was hoping to get the list of files transferred from the JSON output so I could write a record of the file into a database to then automate the creation of recovery scripts.
Is the parsing of the log files at DEBUG level the only way to get a list of files transferred using AzCopy?

[vibhansa-msft]

You can enable debug logs and then grep for SUCCESSFUL or FAILED to identify the status of each file. As such there is no need to do this because if the transfer for certain file fails you always have resume job option in azcopy where you can just retry for the failed files.