grub-probe error: unknown filesystem

[azeemism]

Hi,

Regarding the dailies version of zfs: 0.6.3-222d9d57jessie

Mounted zfs files systems are not detected by grub-probe with "error: unknown filesystem" being returned. No such issue found with version v0.6.3-766_gfde0d6d (non-dailies). I am running Debian Jessie of VirtualBox.

All packages below are version: 2.02~beta2-19 amd64
grub-efi
grub-efi-amd64
grub-efi-amd64-bin
grub2-common

Thanks for all that you do,

Azeem

[FransUrbo]

Mounted zfs files systems are not detected by grub-probe with "error: unknown filesystem" being returned.

All packages below are version: 2.02~beta2-19 amd64
grub-efi
grub-efi-amd64
grub-efi-amd64-bin
grub2-common

Since you're using efi, I have no idea how to proceed, never tried it.

[azeemism]

To duplicate the issue:

Install Jessie in VirtualBox (tested in RAID 10)
sda1 - UEFI partition (must be on sda1 or sdb1 only for VirtualBox)
sd[a-d]2 - unformatted partition for zfs
sd[a-d]3 - swap on
sd[a-d]4 - /boot on ext4 RAID 10
sd[a-d]5 - / on ext4 RAID 10

EFI will already be install by select the option in Debian Jessie,
Install zfs dailies,
zpool create -m none spool mirror /dev/disk/by-id /dev/disk/by-id mirror /dev/disk/by-id /dev/disk/by-id
create datasets for spool/ROOT/debian
zfs set mountpoint=/test spool/ROOT/debian
Fix the canonical path error: #5

cat > /etc/udev/rules.d/70-zfs-grub-fix.rules << 'EOF'
ENV{DEVTYPE}=="partition", IMPORT{parent}="ID_*", ENV{ID_FS_TYPE}=="zfs_member", SYMLINK+="$env{ID_BUS}-$env{ID_SERIAL} $env{ID_BUS}-$env{ID_SERIAL}-part%n"
EOF
udevadm trigger

reboot
modprobe efivars <-- should not be needed but can run it just in case
grub-probe /test

---

Since "/" is not on zfs at boot time, would it matter if it is efi?

[FransUrbo]

zfs set mountpoint=/test spool/ROOT/debian

That's wrong. It should be 'mountpoint=/'.
Since "/" is not on zfs at boot time, would it matter if it is efi?

No idea, but I know that EFI is somewhat problematic when it comes to grub. I once tried to get a 'normal' system running on EFI but failed...

[azeemism]

That's wrong. It should be 'mountpoint=/'.

Yes you are right. I was running a quick test with grub-probe and only one folder. It should have been
zfs set mountpoint=/test spool/ROOT/debian/test.

No idea, but I know that EFI is somewhat problematic when it comes to grub. I once tried to get a 'normal' system running on EFI but failed...

With the current Debian version of grub-efi-amd64 I can confirm success with the zfs non-daily.

I think more people are having success these days, but there isn't a clear document on the web outlining each step of the process to achieve the goal. To be fair to yourself, in the past it was a lot more difficult and they were many more bugs to work through that perhaps made it impossible/impractical in many situations.

A lot of progress has been made that perhaps now allows for a different perspective other than the horizon approach where the goal is still out of reach.

On a more tangible note, my next comment may have some clues at to why this issue is occurring.

[azeemism]

I created a pool with only one dataset mounted:

zfs create -o mountpoint=/stest spool/ROOT/debian/stest

I then use grub probe's verbose output (version: 2.02~beta2-10)

grub-probe -vvv /stest

For both the,
dailies: where zfs is not detected
non-daily: where zfs is detected

They are some difference between the two outputs that I hope will help to sort out the current issue.

What stood out to me is that at an initial level grub-probe detects zfs on the dailies before there seems to be a failure:

grub-core/fs/zfs/zfs.c:1107: check 10 passed
grub-core/fs/zfs/zfs.c:1123: str=com.delphix:hole_birth
grub-core/fs/zfs/zfs.c:1126: feature missing in check_pool_label:com.delphix:hole_birth
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1187: label ok 2
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1187: label ok 3
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/kern/fs.c:78: zfs detection failed.

_Is there a mismatch in the order or sequence of features (between the dailies and non-daily) that is causing grub-probe to fail?_

---

---

Full Output of Dailies v0.6.3-246466b6jessie

grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde1' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde9' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde9'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde9'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf1' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf1'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf9' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf9'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf9'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde,gpt1'...
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/fs.c:56: Detecting zfs...
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde1' in open_device()
grub-core/fs/zfs/zfs.c:1187: label ok 0
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1003: check 2 passed
grub-core/fs/zfs/zfs.c:1014: check 3 passed
grub-core/fs/zfs/zfs.c:1021: check 4 passed
grub-core/fs/zfs/zfs.c:1031: check 6 passed
grub-core/fs/zfs/zfs.c:1039: check 7 passed
grub-core/fs/zfs/zfs.c:1050: check 8 passed
grub-core/fs/zfs/zfs.c:1060: check 9 passed
grub-core/fs/zfs/zfs.c:1082: check 11 passed
grub-core/fs/zfs/zfs.c:1107: check 10 passed
grub-core/fs/zfs/zfs.c:1123: str=com.delphix:hole_birth
grub-core/fs/zfs/zfs.c:1126: feature missing in check_pool_label:com.delphix:hole_birth
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1187: label ok 1
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1003: check 2 passed
grub-core/fs/zfs/zfs.c:1014: check 3 passed
grub-core/fs/zfs/zfs.c:1021: check 4 passed
grub-core/fs/zfs/zfs.c:1031: check 6 passed
grub-core/fs/zfs/zfs.c:1039: check 7 passed
grub-core/fs/zfs/zfs.c:1050: check 8 passed
grub-core/fs/zfs/zfs.c:1060: check 9 passed
grub-core/fs/zfs/zfs.c:1082: check 11 passed
grub-core/fs/zfs/zfs.c:1107: check 10 passed
grub-core/fs/zfs/zfs.c:1123: str=com.delphix:hole_birth
grub-core/fs/zfs/zfs.c:1126: feature missing in check_pool_label:com.delphix:hole_birth
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1187: label ok 2
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1187: label ok 3
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/kern/fs.c:78: zfs detection failed.
grub-core/kern/fs.c:56: Detecting xfs...
grub-core/kern/fs.c:78: xfs detection failed.
grub-core/kern/fs.c:56: Detecting ufs2...
grub-core/kern/fs.c:78: ufs2 detection failed.
grub-core/kern/fs.c:56: Detecting ufs1_be...
grub-core/kern/fs.c:78: ufs1_be detection failed.
grub-core/kern/fs.c:56: Detecting ufs1...
grub-core/kern/fs.c:78: ufs1 detection failed.
grub-core/kern/fs.c:56: Detecting udf...
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/kern/fs.c:78: udf detection failed.
grub-core/kern/fs.c:56: Detecting tarfs...
grub-core/kern/fs.c:78: tarfs detection failed.
grub-core/kern/fs.c:56: Detecting squash4...
grub-core/kern/fs.c:78: squash4 detection failed.
grub-core/kern/fs.c:56: Detecting sfs...
grub-core/kern/fs.c:78: sfs detection failed.
grub-core/kern/fs.c:56: Detecting romfs...
grub-core/kern/fs.c:78: romfs detection failed.
grub-core/kern/fs.c:56: Detecting reiserfs...
grub-core/kern/fs.c:78: reiserfs detection failed.
grub-core/kern/fs.c:56: Detecting procfs...
grub-core/kern/fs.c:78: procfs detection failed.
grub-core/kern/fs.c:56: Detecting odc...
grub-core/kern/fs.c:78: odc detection failed.
grub-core/kern/fs.c:56: Detecting ntfs...
grub-core/kern/fs.c:78: ntfs detection failed.
grub-core/kern/fs.c:56: Detecting nilfs2...
grub-core/kern/fs.c:78: nilfs2 detection failed.
grub-core/kern/fs.c:56: Detecting newc...
grub-core/kern/fs.c:78: newc detection failed.
grub-core/kern/fs.c:56: Detecting minix_be...
grub-core/kern/fs.c:78: minix_be detection failed.
grub-core/kern/fs.c:56: Detecting minix3_be...
grub-core/kern/fs.c:78: minix3_be detection failed.
grub-core/kern/fs.c:56: Detecting minix3...
grub-core/kern/fs.c:78: minix3 detection failed.
grub-core/kern/fs.c:56: Detecting minix2_be...
grub-core/kern/fs.c:78: minix2_be detection failed.
grub-core/kern/fs.c:56: Detecting minix2...
grub-core/kern/fs.c:78: minix2 detection failed.
grub-core/kern/fs.c:56: Detecting minix...
grub-core/kern/fs.c:78: minix detection failed.
grub-core/kern/fs.c:56: Detecting jfs...
grub-core/kern/fs.c:78: jfs detection failed.
grub-core/kern/fs.c:56: Detecting iso9660...
grub-core/kern/fs.c:78: iso9660 detection failed.
grub-core/kern/fs.c:56: Detecting hfsplus...
grub-core/kern/fs.c:78: hfsplus detection failed.
grub-core/kern/fs.c:56: Detecting hfs...
grub-core/kern/fs.c:78: hfs detection failed.
grub-core/kern/fs.c:56: Detecting fat...
grub-core/kern/fs.c:78: fat detection failed.
grub-core/kern/fs.c:56: Detecting ext2...
grub-core/kern/fs.c:78: ext2 detection failed.
grub-core/kern/fs.c:56: Detecting exfat...
grub-core/kern/fs.c:78: exfat detection failed.
grub-core/kern/fs.c:56: Detecting cpiofs_be...
grub-core/kern/fs.c:78: cpiofs_be detection failed.
grub-core/kern/fs.c:56: Detecting cpiofs...
grub-core/kern/fs.c:78: cpiofs detection failed.
grub-core/kern/fs.c:56: Detecting cbfs...
grub-core/kern/disk.c:421: Read out of range: sector 0x100217ebe (attempt to read or write outside of partition).
grub-core/kern/fs.c:78: cbfs detection failed.
grub-core/kern/fs.c:56: Detecting btrfs...
grub-core/kern/fs.c:78: btrfs detection failed.
grub-core/kern/fs.c:56: Detecting bfs...
grub-core/kern/fs.c:78: bfs detection failed.
grub-core/kern/fs.c:56: Detecting afs...
grub-core/kern/fs.c:78: afs detection failed.
grub-core/kern/fs.c:56: Detecting affs...
grub-core/kern/fs.c:78: affs detection failed.

---

Full output of Non-Daily v0.6.3-766_gfde0d6d

grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde1' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde9' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde9'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde9'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf1' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf1'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf1'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf9' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf9'
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf9'
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sde
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sdf'...
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sdf' in open_device()
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sdf'
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/gpt.c:114: GPT entry 8: start=4294946816, length=16384
grub-core/disk/diskfilter.c:135: Scanning for DISKFILTER devices on disk hostdisk//dev/sdf
grub-core/partmap/dfly.c:72: bad magic (found 0x0; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/partmap/dfly.c:72: bad magic (found 0x20494645; wanted 0xc4464c59)
grub-core/partmap/apple.c:123: bad magic (found 0x0; wanted 0x4552)
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sdf'.
grub-core/kern/disk.c:196: Opening `hostdisk//dev/sde,gpt1'...
grub-core/partmap/gpt.c:90: Read a valid GPT header
grub-core/partmap/gpt.c:114: GPT entry 0: start=2048, length=4294944768
grub-core/kern/fs.c:56: Detecting zfs...
grub-core/osdep/hostdisk.c:415: opening the device `/dev/sde1' in open_device()
grub-core/fs/zfs/zfs.c:1187: label ok 0
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1003: check 2 passed
grub-core/fs/zfs/zfs.c:1014: check 3 passed
grub-core/fs/zfs/zfs.c:1021: check 4 passed
grub-core/fs/zfs/zfs.c:1031: check 6 passed
grub-core/fs/zfs/zfs.c:1039: check 7 passed
grub-core/fs/zfs/zfs.c:1050: check 8 passed
grub-core/fs/zfs/zfs.c:1060: check 9 passed
grub-core/fs/zfs/zfs.c:1082: check 11 passed
grub-core/fs/zfs/zfs.c:1107: check 10 passed
grub-core/fs/zfs/zfs.c:1132: check 12 passed (feature flags)
grub-core/fs/zfs/zfs.c:1846: endian = -1
grub-core/fs/zfs/zfs.c:591: dva=8, 190
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:2616: endian = -1, blkid=0
grub-core/fs/zfs/zfs.c:1960: endian = -1
grub-core/fs/zfs/zfs.c:1986: endian = -1
grub-core/fs/zfs/zfs.c:1846: endian = -1
grub-core/fs/zfs/zfs.c:591: dva=8, 188
grub-core/fs/zfs/zfs.c:2620: alive
grub-core/fs/zfs/zfs.c:2431: looking for 'features_for_read'
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1986: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 838
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:2441: zap read
grub-core/fs/zfs/zfs.c:2445: micro zap
grub-core/fs/zfs/zfs.c:2448: returned 0
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1986: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 588
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:2047: zap: name = org.illumos:lz4_compress, value = 1, cd = 0
grub-core/fs/zfs/zfs.c:2047: zap: name = , value = 0, cd = 0
grub-core/fs/zfs/zfs.c:2047: zap: name = , value = 0, cd = 0
grub-core/fs/zfs/zfs.c:2047: zap: name = , value = 0, cd = 0
grub-core/fs/zfs/zfs.c:2047: zap: name = , value = 0, cd = 0
grub-core/fs/zfs/zfs.c:2047: zap: name = , value = 0, cd = 0
grub-core/fs/zfs/zfs.c:2047: zap: name = , value = 0, cd = 0
grub-core/fs/zfs/zfs.c:3188: alive
grub-core/fs/zfs/zfs.c:3000: endian = 1
grub-core/fs/zfs/zfs.c:2616: endian = 1, blkid=0
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1986: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 188
grub-core/fs/zfs/zfs.c:2620: alive
grub-core/fs/zfs/zfs.c:3007: alive
grub-core/fs/zfs/zfs.c:2431: looking for 'root_dataset'
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1986: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 838
grub-core/fs/zfs/zfs.c:2441: zap read
grub-core/fs/zfs/zfs.c:2445: micro zap
grub-core/fs/zfs/zfs.c:2448: returned 0
grub-core/fs/zfs/zfs.c:3013: alive
grub-core/fs/zfs/zfs.c:3019: alive
grub-core/fs/zfs/zfs.c:3197: alive
grub-core/fs/zfs/zfs.c:3201: endian = 0
grub-core/fs/zfs/zfs.c:3211: endian = 1
grub-core/fs/zfs/zfs.c:3065: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 368
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:3291: endian = 1
grub-core/fs/zfs/zfs.c:3065: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 368
grub-core/fs/zfs/zfs.c:2616: endian = 1, blkid=0
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1991: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 348
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1991: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 340
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1991: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 338
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1991: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 330
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1991: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 328
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1991: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 320
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1986: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 318
grub-core/fs/zfs/zfs.c:2620: alive
grub-core/fs/zfs/zfs.c:2431: looking for 'ROOT'
grub-core/fs/zfs/zfs.c:1960: endian = 1
grub-core/fs/zfs/zfs.c:1986: endian = 1
grub-core/fs/zfs/zfs.c:1846: endian = 1
grub-core/fs/zfs/zfs.c:591: dva=8, 0
grub-core/osdep/hostdisk.c:394: reusing open device `/dev/sde1'
grub-core/fs/zfs/zfs.c:2441: zap read
grub-core/fs/zfs/zfs.c:2445: micro zap
grub-core/fs/zfs/zfs.c:2448: returned 0
zfs
grub-core/kern/disk.c:295: Closing `hostdisk//dev/sde'.

---

End Remarks

I hope this helps shed some light that can lead to a fix.

There was a post for Ubuntu

zfsonlinux/pkg-zfs#75

That suggested creating a pool as follows,

zpool create -o version=28 -o ashift=9 tank ...

But this is not the case with Debian Jessie, as the latest version 5000 and either of ashift=12 or ashift=13 do work with the non-daily version.

[FransUrbo]

I create a pool with only one dataset mounted:
zfs create -o mountpoint=/stest spool/ROOT/debian/stest

[…]

Could you edit that post, and use the 'triple back ticks markdown' to distinguish the code segments. The post is very long and very difficult to read/overview as it is now.

See https://help.github.com/articles/github-flavored-markdown/#syntax-highlighting

[wallzero]

I believe I have the same issue. I have been running a ZFS root installation with Debian Jessie for months with no issue. Then, I installed the nightly builds, and now I am unable to upgrade the kernel. I receive the following error:

dpkg: error processing package linux-image-3.16.0-4-amd64 (--configure):
 subprocess installed post-installation script returned error exit status 2
Setting up grub-efi-amd64 (2.02~beta2-20) ...
/usr/sbin/grub-probe: error: cannot find a device for / (is /dev mounted?).

[azeemism]

@FransUrbo I couple days again, I created bug reports with Debian as I had mentioned I would.

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=776676
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=777191

This also addresses:
#18
openzfs/zfs#3047

Debian Bug 777191 requests that they look into applying the following patches to upstream grub-efi-amd64:

LIST OF PATCHES:

https://github.com/zfsonlinux/grub/tree/snapshot/debian/wheezy/2.02_beta2%2Bgitbac5d-9.ZOL1/debian/patches

    blacklist_1440x900x32.patch
    core_in_fs.patch
    default_grub_d.patch
    disable_floppies.patch
    dpkg_version_comparison.patch
    elf_bi_endian.patch
    feature_flags.patch
    first_device.patch
    fix_variable_redeclarations.patch
    gettext_quiet.patch
    gfxpayload_dynamic.patch
    gfxpayload_keep_default.patch
    grub-shell-no-pad.patch
    grub-tester-zfs.patch
    grub.cfg_400.patch
    grub_legacy_0_based_partitions.patch
    ignore_grub_func_test_failures.patch
    install_efi_fallback.patch
    install_locale_langpack.patch
    install_powerpc_machtypes.patch
    install_stage2_confusion.patch
    linuxefi.patch
    linuxefi_amd64_only.patch
    linuxefi_debug.patch
    linuxefi_non_sb_fallback.patch
    linuxefi_require_shim.patch
    maybe_quiet.patch
    mkconfig_loopback.patch
    mkconfig_mid_upgrade.patch
    mkconfig_nonexistent_loopback.patch
    mkconfig_recovery_title.patch
    mkconfig_signed_kernel.patch
    mkconfig_ubuntu_distributor.patch
    mkconfig_ubuntu_recovery.patch
    multiple-raidz-device-detection.txt
    no_insmod_on_sb.patch
    no_redefine_MIN-MAX.patch
    probe_fusionio.patch
    quick_boot.patch
    restore_mkdevicemap.patch
    series  * Add support for spacemap_histogram, enabled_txg, extensible_dataset.
    skip_gettext_strings_test.patch
    sleep_shift.patch
    uefi_firmware_setup.patch
    vt_handoff.patch
    wubi_no_windows.patch

[toobuntu]

See Debian Bug#775395 - partman-zfs in d-i jessie image does not create grub-compatible /boot ZFS mirror

Workaround:

What I ended up doing is recreating everything again, this time
interrupting and adding the "-d" flag to the pool creation command (done
manually) to leave all the feature@* options disabled for building the
system.

This worked. Installation of Grub as the boot loader was successful and
the system booted using /boot (and /lib/modules) as volumes on the "b"
pool, which is a simple ZFS mirror.

Please consider adding the "-d" flag in partman-zfs for Jessie, i.e.,

# zpool create -d "pool" <dev-spec>

And then perhaps turning on feature@ flags that are known to work with
grub for booting.

[azeemism]

@toobuntu I was able to install with no issues using,

ZoL version v0.6.3-766_gfde0d6d (non-dailies)
Debian Jessie weekly build:
http://cdimage.debian.org/cdimage/unofficial/non-free/cd-including-firmware/weekly-builds/amd64/iso-cd/

grub-efi-amd64 version: 2.02~beta2-19 amd64, or 2.02~beta2-20 amd64

Even had /boot under ZFS.

Pool was created with,

zpool create -m none -o ashift=13 -o feature@lz4_compress=enabled -o autoreplace=on -o autoexpand=on spool mirror /dev/disk/by-id/scsi-SATA_disk1-part2 /dev/disk/by-id/scsi-SATA_disk2-part2 mirror /dev/disk/by-id/scsi-SATA_disk3-part2 /dev/disk/by-id/scsi-SATA_disk4-part2

The same success was not achieved with the ZoL dailies version where I simplified pool creation to

zpool create -m none spool mirror /dev/disk/by-id/scsi-SATA_disk1-part2 /dev/disk/by-id/scsi-SATA_disk2-part2 mirror /dev/disk/by-id/scsi-SATA_disk3-part2 /dev/disk/by-id/scsi-SATA_disk4-part2

I have not tested with the -d option.

But installing Grub failed with "unknown filesystem". In troubleshooting the issue, it seems grub2 (version currently is 2.02~beta2-19) does not recognize the "feature@lz4_compress" option

I agree there is an issue with grub, but there seems to be more to it? as i got it working with LZ4 and the non-daily ZoL code.

Please consider adding the "-d" flag in partman-zfs for Jessie

I would rather a fix be implemented so grub2 and ZoL can work with all the features. I certainly don't want to lose out on LZ4.

Thanks for pointing out your findings. I will link it to my Debian Bug Report.

[wallzero]

A recent upgrade caused an unsuccessful boot. I chrooted into my system and I upgraded to a grub version from the experimental branch. Within the chroot, initramfs completed successfully. I then tried to boot again but I was stalled in busybox. I use the following commands to continue:

zpool import rpool -R /root
exit
exit

The first exit returns an error the original error but the second proceeds to boot successfully. I can now update initramfs within my install, but still get stuck in busybox. This is my /etc/default/grub file:

# If you change this file, run 'update-grub' afterwards to update
# /boot/grub/grub.cfg.
# For full documentation of the options in this file, see:
#   info -f grub -n 'Simple configuration'

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet splash init=/bin/systemd"
GRUB_CMDLINE_LINUX="boot=zfs rpool=rpool rcutree.rcu_idle_gp_delay=1"

# Uncomment to enable BadRAM filtering, modify to suit your needs
# This works with Linux (no patch required) and with any kernel that obtains
# the memory map information from GRUB (GNU Mach, kernel of FreeBSD ...)
#GRUB_BADRAM="0x01234567,0xfefefefe,0x89abcdef,0xefefefef"

# Uncomment to disable graphical terminal (grub-pc only)
#GRUB_TERMINAL=console

# The resolution used on graphical terminal
# note that you can use only modes which your graphic card supports via VBE
# you can see them in real GRUB with the command `vbeinfo'
GRUB_GFXMODE=1600x900

# Uncomment if you don't want GRUB to pass "root=UUID=xxx" parameter to Linux
#GRUB_DISABLE_LINUX_UUID=true

# Uncomment to disable generation of recovery mode menu entries
#GRUB_DISABLE_RECOVERY="true"

# Uncomment to get a beep at grub start
#GRUB_INIT_TUNE="480 440 1"

[FransUrbo]

A recent upgrade caused an unsuccessful boot. I chrooted into my system and I upgraded to a grub version from the experimental branch. Within the chroot, initramfs completed successfully. I then tried to boot again but I was stalled in busybox. I use the following commands to continue:

This sounds like a problem with the initrd script, not grub.

[Popyllol]

So... is this the right place to ask when com.delphix:hole_birth will be supported by grub?
I am booting another Linux partition until it will be supported, but... would be nice to boot my real-Linux soon again!
:-)
My problem is this, too:
grub-core/fs/zfs/zfs.c:1126: feature missing in check_pool_label:com.delphix:hole_birth
Greetings,
Lars

[FransUrbo]

So... is this the right place to ask when com.delphix:hole_birth will be supported by grub?

In the Debian GNU/Linux packages, they have for the last two-three months.

Regarding 'all other' distributions, somewhere between 'in a year or two' to 'never'…

The 'problem' is that no-one (except me) is willing to carry the patch(es) that @tsoome did for Illumos. They're CDDL and Grub2 is GPL and they 'clash'. Or at least that's the general opinion. I'm not a lawyer, so I can't say for sure but there you are…

@tsoome is currently in the process of rewriting the patch(es) and pushing it to Grub upstream. But your guess is as good as mine when that will be accepted. Until then, no-one is willing to do the work.