In my Intel SSDPE2KX080T8 NVMe disks I see two LBA format:As Ceph uses a 4M "block size" I would rather test around changing the NVMe's blocksize from 512K to 4M.
LBA Format 0 : Metadata Size: 0 bytes - Data Size: 512 bytes - Relative Performance: 0x2 Good
LBA Format 1 : Metadata Size: 0 bytes - Data Size: 4096 bytes - Relative Performance: 0 Best (in use)
You have wrote 512K to 4M, is that correct or did you mean 512B to 4KB? I can't find anything about 4M LBA Format.