General Protection Fault with ZFS

e100

Renowned Member
Nov 6, 2010
1,268
45
88
Columbus, Ohio
ulbuilder.wordpress.com
This is reported upstream already by someone else, I added my info there too.
https://github.com/zfsonlinux/zfs/issues/6781

I setup DRBD on top of a ZVOL.
When making heavy sequential writes on the primary, the secondary node throws a General Protection Fault error from zfs.
The IO was from a Move Disk operation I started from the GUI.

# pveversion -v
Code:
proxmox-ve: 5.1-30 (running kernel: 4.13.8-3-pve)
pve-manager: 5.1-38 (running version: 5.1-38/1e9bc777)
pve-kernel-4.13.4-1-pve: 4.13.4-26
pve-kernel-4.13.8-3-pve: 4.13.8-30
libpve-http-server-perl: 2.0-7
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-17
pve-firmware: 2.0-3
libpve-common-perl: 5.0-22
libpve-guest-common-perl: 2.0-13
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-12
pve-qemu-kvm: 2.9.1-3
pve-container: 2.0-17
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9
Code:
[ 3024.393239] general protection fault: 0000 [#1] SMP
[ 3024.393285] Modules linked in: ip_set ip6table_filter ip6_tables iptable_filter bonding ib_ipoib zram iTCO_wdt iTCO_vendor_support nfnetlink_log nfnetlink intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp ipmi_
ssif coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel mgag200 aes_x86_64 crypto_simd glue_helper cryptd ttm drm_kms_helper snd_pcm snd_timer drm snd intel_cstate soundco
re i2c_algo_bit fb_sys_fops pcspkr syscopyarea sysfillrect intel_rapl_perf joydev input_leds sysimgblt lpc_ich mei_me mei ib_mthca ioatdma dca shpchp ipmi_si ipmi_devintf ipmi_msghandler mac_hid vhost_net vhost tap ib_is
er rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi drbd sunrpc lru_cache libcrc32c ip_tables x_tables autofs4 zfs(PO)
[ 3024.393734]  zunicode(PO) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) hid_generic usbkbd usbmouse usbhid hid btrfs xor raid6_pq ahci e1000e(O) i2c_i801 libahci isci ptp pps_core libsas arcmsr scsi_transport_sas
[ 3024.393865] CPU: 26 PID: 24805 Comm: vgs Tainted: P           O    4.13.8-3-pve #1
[ 3024.393910] Hardware name: Supermicro X9DRL-3F/iF/X9DRL-3F/iF, BIOS 1.0b 08/21/2012
[ 3024.393958] task: ffff974a4e342e80 task.stack: ffffb0fcde6e4000
[ 3024.394061] RIP: 0010:zfs_range_compare+0x5/0x30 [zfs]
[ 3024.394094] RSP: 0018:ffffb0fcde6e7990 EFLAGS: 00010202
[ 3024.394130] RAX: 0000000000000000 RBX: 11e8c48949df8940 RCX: 0000000000001000
[ 3024.394173] RDX: 0000000000000000 RSI: 11e8c48949df8940 RDI: ffff973c0e58b600
[ 3024.394218] RBP: ffffb0fcde6e79c8 R08: ffff974e7f49f500 R09: ffff973e7f407180
[ 3024.394262] R10: ffff973c0e58b600 R11: ffff973e76a25b88 R12: ffff974e76e20d60
[ 3024.394306] R13: ffff973c0e58b600 R14: 11e8c48949df8948 R15: 11e8c48949df8948
[ 3024.394352] FS:  00007f9d723e1880(0000) GS:ffff974e7f480000(0000) knlGS:0000000000000000
[ 3024.394400] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 3024.394436] CR2: 00000000024f4b78 CR3: 00000019e7484000 CR4: 00000000000426e0
[ 3024.394481] Call Trace:
[ 3024.394505]  ? avl_add+0x59/0x90 [zavl]
[ 3024.396105]  zfs_range_lock+0x3cc/0x5c0 [zfs]
[ 3024.397673]  zvol_request+0x16e/0x300 [zfs]
[ 3024.399197]  generic_make_request+0x125/0x300
[ 3024.400688]  ? iov_iter_get_pages+0xbd/0x2f0
[ 3024.402161]  submit_bio+0x73/0x150
[ 3024.403617]  ? submit_bio+0x73/0x150
[ 3024.405077]  ? bio_iov_iter_get_pages+0xd7/0x120
[ 3024.406544]  __blkdev_direct_IO_simple+0x193/0x320
[ 3024.408033]  ? bd_set_size+0xd5/0xe0
[ 3024.409088]  ? __blkdev_get+0x1ea/0x430
[ 3024.410531]  ? bdget+0x120/0x120
[ 3024.411989]  blkdev_direct_IO+0x3e1/0x3f0
[ 3024.413438]  ? blkdev_direct_IO+0x3e1/0x3f0
[ 3024.414897]  ? dput+0x34/0x1f0
[ 3024.416309]  ? mntput+0x24/0x40
[ 3024.417736]  ? terminate_walk+0xe0/0xf0
[ 3024.419078]  ? path_openat+0x6f4/0x1490
[ 3024.420461]  ? putname+0x54/0x60
[ 3024.421871]  generic_file_read_iter+0xcb/0x9e0
[ 3024.423286]  ? generic_file_read_iter+0xcb/0x9e0
[ 3024.424684]  ? do_filp_open+0xad/0x110
[ 3024.426014]  ? _copy_to_user+0x2a/0x40
[ 3024.426965]  ? cp_new_stat+0x152/0x180
[ 3024.428227]  blkdev_read_iter+0x35/0x40
[ 3024.429309]  new_sync_read+0xde/0x130
[ 3024.430077]  __vfs_read+0x26/0x40
[ 3024.430891]  vfs_read+0x96/0x130
[ 3024.431696]  SyS_read+0x55/0xc0
[ 3024.432410]  entry_SYSCALL_64_fastpath+0x1e/0xa9
[ 3024.433108] RIP: 0033:0x7f9d71242700
[ 3024.433732] RSP: 002b:00007ffe66a9b6f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 3024.434363] RAX: ffffffffffffffda RBX: 0000561b170ed6e8 RCX: 00007f9d71242700
[ 3024.434966] RDX: 0000000000001000 RSI: 0000561b170d9000 RDI: 0000000000000003
[ 3024.435557] RBP: 0000000000000001 R08: 00007f9d715011f8 R09: 0000000000001000
[ 3024.436138] R10: 00007f9d7198bf20 R11: 0000000000000246 R12: 0000000000000000
[ 3024.436709] R13: 0000000000000000 R14: 0000000000000000 R15: 00007ffe66a9bba0
[ 3024.437277] Code: 48 c7 c7 88 c1 73 c0 41 bf 5f 00 00 00 e8 24 cf fe ff e9 59 fd ff ff e8 0a 60 40 c5 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 <48> 8b 56 20 48 8b 4f 20 31 c0 55 48 39 d1 48 89 e5 0f 92 c2 0f
[ 3024.438549] RIP: zfs_range_compare+0x5/0x30 [zfs] RSP: ffffb0fcde6e7990
[ 3024.439190] ---[ end trace 0fdb8beaee634420 ]---

Any thoughts?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!