Fiber Channel storage problems

xPakrikx

Active Member
Jan 15, 2019
35
2
28
30
inanis.xyz
Hi

We have strange problem with Proxmox VE 5.3.8 + Dell SCv2020 over FC.
HDDs in storage have 512n sector size but fdisk reports physical sector size 4096 and also I/O size is very high.
On top of that we use multipathd.

Code:
Disk /dev/sdd: 3 TiB, 3298534883328 bytes, 6442450944 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 2097152 bytes / 2097152 bytes

Disk /dev/sdg: 3 TiB, 3298534883328 bytes, 6442450944 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 2097152 bytes / 2097152 bytes

Code:
devices {
    device {
        vendor COMPELNT
        product "Compellent Vol"
        path_checker tur
        prio alua
        path_selector "service-time 0"
        path_grouping_policy group_by_prio
        no_path_retry 24
        hardware_handler "1 alua"
        failback immediate
        rr_weight priorities
        user_friendly_names yes
    }
}
blacklist {
        wwid .*
}

blacklist_exceptions {
        wwid "36000d310032c88000000000000000018"
}
multipaths {
  multipath {
        wwid "3600144f028f88a0000005037a95d0001"
        alias storage01-vol004
  }
}

Code:
hdparm -I /dev/sdg

/dev/sdg:
SG_IO: bad/missing sense data, sb[]:  70 00 05 00 00 00 00 0a 00 00 00 00 20 00 00 80 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

ATA device, with non-removable media
Standards:
    Likely used: 1
Configuration:
    Logical        max    current
    cylinders    0    0
    heads        0    0
    sectors/track    0    0
    --
    Logical/Physical Sector size:           512 bytes
    device size with M = 1024*1024:           0 MBytes
    device size with M = 1000*1000:           0 MBytes
    cache/buffer size  = unknown
Capabilities:
    IORDY not likely
    Cannot perform double-word IO
    R/W multiple sector transfer: not supported
    DMA: not supported
    PIO: pio0

After i create VM on this volume and install OS i get this error:

Code:
Disk /dev/mapper/storage01--vol004-vm--100--disk--0: 32 GiB, 34359738368 bytes, 67108864 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 2097152 bytes / 2097152 bytes
Disklabel type: dos
Disk identifier: 0x000c018f

Device                                               Boot   Start      End  Sectors Size Id Type
/dev/mapper/storage01--vol004-vm--100--disk--0-part1 *       2048  2099199  2097152   1G 83 Linux
/dev/mapper/storage01--vol004-vm--100--disk--0-part2      2099200 67108863 65009664  31G 8e Linux LVM

Partition 1 does not start on physical sector boundary.
Partition 2 does not start on physical sector boundary.

VM works but there no problem like this Dell Eqallogic over iSCSI.

Code:
Disk /dev/sdi: 3 TiB, 3254554460160 bytes, 6356551680 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

Code:
Disk /dev/mapper/storage02--vol003-vm--101--disk--0: 32 GiB, 34359738368 bytes, 67108864 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x000c018f

Device                                               Boot   Start      End  Sectors Size Id Type
/dev/mapper/storage02--vol003-vm--101--disk--0-part1 *       2048  2099199  2097152   1G 83 Linux
/dev/mapper/storage02--vol003-vm--101--disk--0-part2      2099200 67108863 65009664  31G 8e Linux L

Thanks for advice :)
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!