Skip to content

AzCopy v10.31.0 segmentation violation copying from S3 to ADLS #3273

@infuerno

Description

@infuerno

Which version of the AzCopy was used?

10.31.0

Which platform are you using? (ex: Windows, Mac, Linux)

macOS ARM M3 (same error "2-panic" on Linux)

What command did you run?

azcopy cp https://s3.eu-west-2.amazonaws.com/s3-bucket/s3-directory/* https://adls-storage-account.blob.core.windows.net/adls-container/adls-folder?sas-key

What problem was encountered?

Command errored with message:
panic: runtime error: invalid memory address or nil pointer dereference

Full stack trace in console:

INFO: Scanning...
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x2 addr=0x0 pc=0x1059afe0c]

goroutine 1 [running]:
github.com/Azure/azure-storage-azcopy/v10/common.(*ServiceClient).FileServiceClient(...)
	github.com/Azure/azure-storage-azcopy/v10/common/util.go:279
github.com/Azure/azure-storage-azcopy/v10/cmd.getShareProtocolType({0x1061ca200, 0x1400031ede0}, 0x0, {{0x140002586e0, 0x3f}, {0x0, 0x0}, {0x0, 0x0}}, 0x0)
	github.com/Azure/azure-storage-azcopy/v10/cmd/flagsValidation.go:364 +0x11c
github.com/Azure/azure-storage-azcopy/v10/cmd.validateShareProtocolCompatibility({0x1061ca200?, 0x1400031ede0?}, {{0x140002586e0, 0x3f}, {0x0, 0x0}, {0x0, 0x0}}, 0x105a3129d?, 0x1, ...)
	github.com/Azure/azure-storage-azcopy/v10/cmd/flagsValidation.go:323 +0x58
github.com/Azure/azure-storage-azcopy/v10/cmd.validateProtocolCompatibility({0x1061ca200, 0x1400031ede0}, 0x603, {{0x140002586e0, 0x3f}, {0x0, 0x0}, {0x0, 0x0}}, {{0x1400014e150, ...}, ...}, ...)
	github.com/Azure/azure-storage-azcopy/v10/cmd/flagsValidation.go:413 +0xd4
github.com/Azure/azure-storage-azcopy/v10/cmd.(*CookedCopyCmdArgs).processCopyJobPartOrders(0x14000207908)
	github.com/Azure/azure-storage-azcopy/v10/cmd/copy.go:1199 +0xda8
github.com/Azure/azure-storage-azcopy/v10/cmd.(*CookedCopyCmdArgs).process(0x14000479d00?)
	github.com/Azure/azure-storage-azcopy/v10/cmd/copy.go:798 +0x70
github.com/Azure/azure-storage-azcopy/v10/cmd.init.2.func2(0x140001eec08, {0x14000181500?, 0x2?, 0x105a24197?})
	github.com/Azure/azure-storage-azcopy/v10/cmd/copy.go:1652 +0x24c
github.com/spf13/cobra.(*Command).execute(0x140001eec08, {0x140001814a0, 0x6, 0x6})
	github.com/spf13/[email protected]/command.go:989 +0x7d4
github.com/spf13/cobra.(*Command).ExecuteC(0x106f0d700)
	github.com/spf13/[email protected]/command.go:1117 +0x344
github.com/spf13/cobra.(*Command).Execute(...)
	github.com/spf13/[email protected]/command.go:1041
github.com/Azure/azure-storage-azcopy/v10/cmd.InitializeAndExecute()
	github.com/Azure/azure-storage-azcopy/v10/cmd/root.go:279 +0x28
main.main()
	github.com/Azure/azure-storage-azcopy/v10/main.go:34 +0x48

How can we reproduce the problem in the simplest way?

Attempt a similar copy from S3 to ADLS?

Have you found a mitigation/solution?

Rollback to previous version 10.30.1

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions