Fiber Channel storage problems

xPakrikx

Active Member
Jan 15, 2019
35
2
28
32
inanis.xyz
Hi

We have strange problem with Proxmox VE 5.3.8 + Dell SCv2020 over FC.
HDDs in storage have 512n sector size but fdisk reports physical sector size 4096 and also I/O size is very high.
On top of that we use multipathd.

Code:
Disk /dev/sdd: 3 TiB, 3298534883328 bytes, 6442450944 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 2097152 bytes / 2097152 bytes

Disk /dev/sdg: 3 TiB, 3298534883328 bytes, 6442450944 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 2097152 bytes / 2097152 bytes

Code:
devices {
    device {
        vendor COMPELNT
        product "Compellent Vol"
        path_checker tur
        prio alua
        path_selector "service-time 0"
        path_grouping_policy group_by_prio
        no_path_retry 24
        hardware_handler "1 alua"
        failback immediate
        rr_weight priorities
        user_friendly_names yes
    }
}
blacklist {
        wwid .*
}

blacklist_exceptions {
        wwid "36000d310032c88000000000000000018"
}
multipaths {
  multipath {
        wwid "3600144f028f88a0000005037a95d0001"
        alias storage01-vol004
  }
}

Code:
hdparm -I /dev/sdg

/dev/sdg:
SG_IO: bad/missing sense data, sb[]:  70 00 05 00 00 00 00 0a 00 00 00 00 20 00 00 80 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

ATA device, with non-removable media
Standards:
    Likely used: 1
Configuration:
    Logical        max    current
    cylinders    0    0
    heads        0    0
    sectors/track    0    0
    --
    Logical/Physical Sector size:           512 bytes
    device size with M = 1024*1024:           0 MBytes
    device size with M = 1000*1000:           0 MBytes
    cache/buffer size  = unknown
Capabilities:
    IORDY not likely
    Cannot perform double-word IO
    R/W multiple sector transfer: not supported
    DMA: not supported
    PIO: pio0

After i create VM on this volume and install OS i get this error:

Code:
Disk /dev/mapper/storage01--vol004-vm--100--disk--0: 32 GiB, 34359738368 bytes, 67108864 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 2097152 bytes / 2097152 bytes
Disklabel type: dos
Disk identifier: 0x000c018f

Device                                               Boot   Start      End  Sectors Size Id Type
/dev/mapper/storage01--vol004-vm--100--disk--0-part1 *       2048  2099199  2097152   1G 83 Linux
/dev/mapper/storage01--vol004-vm--100--disk--0-part2      2099200 67108863 65009664  31G 8e Linux LVM

Partition 1 does not start on physical sector boundary.
Partition 2 does not start on physical sector boundary.

VM works but there no problem like this Dell Eqallogic over iSCSI.

Code:
Disk /dev/sdi: 3 TiB, 3254554460160 bytes, 6356551680 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

Code:
Disk /dev/mapper/storage02--vol003-vm--101--disk--0: 32 GiB, 34359738368 bytes, 67108864 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x000c018f

Device                                               Boot   Start      End  Sectors Size Id Type
/dev/mapper/storage02--vol003-vm--101--disk--0-part1 *       2048  2099199  2097152   1G 83 Linux
/dev/mapper/storage02--vol003-vm--101--disk--0-part2      2099200 67108863 65009664  31G 8e Linux L

Thanks for advice :)