Skip to content

ZTS: zpool_import/import_devices_missing failures #16669

Open
@behlendorf

Description

@behlendorf

System information

Type Version/Name
Distribution Name Linux
Distribution Version Any
Kernel Version Any
Architecture x86_64
OpenZFS Version 2.3-rc2

Describe the problem you're observing

On Linux the zpool_import/import_devices_missing test occasionally fails unexpectedly.

Describe how to reproduce the problem

Can be reproduced occasionally by the CI.

https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290

Include any warning/errors/backtraces from the system logs

Test: /usr/share/zfs/zfs-tests/tests/functional/cli_root/zpool_import/import_devices_missing (run as root) [00:07] [FAIL]
  18:09:04.88 SUCCESS: mkdir -p /var/tmp/bakdev_import-test
  18:09:04.88 NOTE: test_devices_missing: pool '/var/tmp/dev_import-test/disk0', adding /var/tmp/dev_import-test/disk1, then moving away /var/tmp/dev_import-test/disk1.
  18:09:04.93 SUCCESS: zpool create testpool1 /var/tmp/dev_import-test/disk0
  18:09:04.97 SUCCESS: zfs create testpool1/first1
  18:09:05.05 SUCCESS: zpool sync testpool1
  18:09:05.09 SUCCESS: zfs create testpool1/first2
  18:09:05.17 SUCCESS: zpool sync testpool1
  18:09:05.21 SUCCESS: zfs create testpool1/first3
  18:09:05.29 SUCCESS: zpool sync testpool1
  18:09:05.29 SUCCESS: generate_data testpool1 /var/tmp/hashsums.352497 first
  18:09:05.34 SUCCESS: zpool add testpool1 /var/tmp/dev_import-test/disk1
  18:09:05.38 SUCCESS: zfs create testpool1/second1
  18:09:05.[45](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:46) SUCCESS: zpool sync testpool1
  18:09:05.49 SUCCESS: zfs create testpool1/second2
  18:09:05.57 SUCCESS: zpool sync testpool1
  18:09:05.61 SUCCESS: zfs create testpool1/second3
  18:09:05.69 SUCCESS: zpool sync testpool1
  18:09:05.69 SUCCESS: generate_data testpool1 /var/tmp/hashsums.352497.2 second
  18:09:05.74 SUCCESS: zpool export testpool1
  18:09:05.75 SUCCESS: mv /var/tmp/dev_import-test/disk1 /var/tmp/bakdev_import-test
  18:09:05.75 SUCCESS: set_zfs_max_missing_tvds 1
  18:09:05.75 SUCCESS: set_spa_load_verify_data 0
  18:09:05.97 SUCCESS: zpool import -o readonly=on -d /var/tmp/dev_import-test testpool1
  18:09:06.17 SUCCESS: verify_data_hashsums /var/tmp/hashsums.352[49](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:50)7
  18:09:06.17 NOTE: Try reading second batch of data, make sure pool doesn't get suspended.
  18:09:06.25 SUCCESS: zpool export testpool1
  18:09:06.26 SUCCESS: mv /var/tmp/bakdev_import-test/disk1 /var/tmp/dev_import-test
  18:09:06.26 SUCCESS: set_spa_load_verify_metadata 1
  18:09:06.27 SUCCESS: set_spa_load_verify_data 1
  18:09:06.27 SUCCESS: set_zfs_max_missing_tvds 0
  18:09:06.61 SUCCESS: zpool import -d /var/tmp/dev_import-test testpool1
  18:09:06.72 SUCCESS: verify_data_hashsums /var/tmp/hashsums.3[52](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:53)497
  18:09:06.87 SUCCESS: verify_data_hashsums /var/tmp/hashsums.352497.2
  18:09:06.93 SUCCESS: zpool destroy testpool1
  18:09:06.93 NOTE: 
  18:09:06.93 NOTE: test_devices_missing: pool '/var/tmp/dev_import-test/disk0', adding /var/tmp/dev_import-test/disk1 /var/tmp/dev_import-test/disk2, then moving away /var/tmp/dev_import-test/disk1.
  18:09:07.01 SUCCESS: zpool create testpool1 /var/tmp/dev_import-test/disk0
  18:09:07.07 SUCCESS: zfs create testpool1/first1
  18:09:07.18 SUCCESS: zpool sync testpool1
  18:09:07.23 SUCCESS: zfs create testpool1/first2
  18:09:07.34 SUCCESS: zpool sync testpool1
  18:09:07.40 SUCCESS: zfs create testpool1/first3
  18:09:07.52 SUCCESS: zpool sync testpool1
  18:09:07.52 SUCCESS: generate_data testpool1 /var/tmp/hashsums.352497 first
  18:09:07.59 SUCCESS: zpool add testpool1 /var/tmp/dev_import-test/disk1 /var/tmp/dev_import-test/disk2
  18:09:07.67 SUCCESS: zfs create testpool1/second1
  18:09:07.81 SUCCESS: zpool sync testpool1
  18:09:07.85 SUCCESS: zfs create testpool1/second2
  18:09:07.95 SUCCESS: zpool sync testpool1
  18:09:07.99 SUCCESS: zfs create testpool1/second3
  18:09:08.10 SUCCESS: zpool sync testpool1
  18:09:08.10 SUCCESS: generate_data testpool1 /var/tmp/hashsums.352497.2 second
  18:09:08.28 SUCCESS: zpool export testpool1
  18:09:08.29 SUCCESS: mv /var/tmp/dev_import-test/disk1 /var/tmp/bakdev_import-test
  18:09:08.29 SUCCESS: set_zfs_max_missing_tvds 1
  18:09:08.30 SUCCESS: set_spa_load_verify_data 0
  18:09:08.57 SUCCESS: zpool import -o readonly=on -d /var/tmp/dev_import-test testpool1
  18:09:08.68 SUCCESS: verify_data_hashsums /var/tmp/hashsums.352497
  18:09:08.68 NOTE: Try reading second batch of data, make sure pool doesn't get suspended.
  18:09:08.80 SUCCESS: zpool export testpool1
  18:09:08.81 SUCCESS: mv /var/tmp/bakdev_import-test/disk1 /var/tmp/dev_import-test
  18:09:08.82 SUCCESS: set_spa_load_verify_metadata 1
  18:09:08.83 SUCCESS: set_spa_load_verify_data 1
  18:09:08.83 SUCCESS: set_zfs_max_missing_tvds 0
  18:09:09.26 SUCCESS: zpool import -d /var/tmp/dev_import-test testpool1
  18:09:09.44 SUCCESS: verify_data_hashsums /var/tmp/hashsums.352497
  18:09:09.[55](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:56) SUCCESS: verify_data_hashsums /var/tmp/hashsums.352497.2
  18:09:09.65 SUCCESS: zpool destroy testpool1
  18:09:09.65 NOTE: 
  18:09:09.65 NOTE: test_devices_missing: pool 'mirror /var/tmp/dev_import-test/disk0 /var/tmp/dev_import-test/disk1', adding mirror /var/tmp/dev_import-test/disk2 /var/tmp/dev_import-test/disk3, then moving away /var/tmp/dev_import-test/disk2 /var/tmp/dev_import-test/disk3.
  18:09:09.72 SUCCESS: zpool create testpool1 mirror /var/tmp/dev_import-test/disk0 /var/tmp/dev_import-test/disk1
  18:09:09.79 SUCCESS: zfs create testpool1/first1
  18:09:09.97 SUCCESS: zpool sync testpool1
  18:09:10.04 SUCCESS: zfs create testpool1/first2
  18:09:10.14 SUCCESS: zpool sync testpool1
  18:09:10.23 SUCCESS: zfs create testpool1/first3
  18:09:10.40 SUCCESS: zpool sync testpool1
  18:09:10.41 SUCCESS: generate_data testpool1 /var/tmp/hashsums.352497 first
  18:09:10.49 SUCCESS: zpool add testpool1 mirror /var/tmp/dev_import-test/disk2 /var/tmp/dev_import-test/disk3
  18:09:10.[59](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:60) SUCCESS: zfs create testpool1/second1
  18:09:10.80 SUCCESS: zpool sync testpool1
  18:09:10.90 SUCCESS: zfs create testpool1/second2
  18:09:11.07 SUCCESS: zpool sync testpool1
  18:09:11.14 SUCCESS: zfs create testpool1/second3
  18:09:11.31 SUCCESS: zpool sync testpool1
  18:09:11.32 SUCCESS: generate_data testpool1 /var/tmp/hashsums.352497.2 second
  18:09:11.42 SUCCESS: zpool export testpool1
  18:09:11.43 SUCCESS: mv /var/tmp/dev_import-test/disk2 /var/tmp/dev_import-test/disk3 /var/tmp/bakdev_import-test
  18:09:11.43 SUCCESS: set_zfs_max_missing_tvds 1
  18:09:11.43 SUCCESS: set_spa_load_verify_data 0
  18:09:11.[64](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:65) SUCCESS: zpool import -o readonly=on -d /var/tmp/dev_import-test testpool1
  18:09:11.[65](https://github.com/openzfs/zfs/actions/runs/11370356852/job/31629970290#step:11:66) Error: Could not open '/testpool1/first1/file1': No such file or directory. 
  18:09:11.65 ERROR: verify_data_hashsums /var/tmp/hashsums.352497 exited 1

Metadata

Metadata

Assignees

No one assigned

    Labels

    Component: Test SuiteIndicates an issue with the test framework or a test caseType: DefectIncorrect behavior (e.g. crash, hang)

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions