cross-cluster migrate with ISO on cephfs

R

RocketSam

Member
Proxmox Subscriber
Feb 20, 2024
44
6
13
Hello pals.
I'm searching for a universal solution for the following case:
I want to cross-migrate a VM with an ISO attached, which is located on the CephFS storage.
Bash: 
qm remote-migrate 553 553 apitoken='PVEAPIToken=root@pam!migration=<token>,fingerprint=<fingerprint>,host=host.target.local,port=8006' --delete 1 --online 1 --target-bridge 'vmbr0:VLAN495,vmbr1:VLAN495' --target-storage 'local-ZFS-SSD:local-ZFS-HDD'
Unfortunately, when I start the process, it fails with the following error:
Establishing API connection with remote at 'target.domain.local'
VM isn't running. Doing offline migration instead.
2026-05-08 12:08:28 ERROR: migration aborted (duration 00:00:00): 500 storage 'cephfs' does not support vm images
migration aborted
Click to expand...
CephFS does not support VM image type, which is fine. Why then do I get this error?
The only images lying on the CephFS are ISO.

Storage config on both hosts:
cephfs: cephfs
path /mnt/pve/cephfs
content iso,vztmpl,snippets
fs-name cephfs
Click to expand...

VM config:
/etc/pve/qemu-server/553.conf
bios: ovmf
boot: order=scsi0;ide0;ide2;net0
cores: 2
cpu: host
efidisk0: local-ZFS-SSD:vm-553-disk-0,efitype=4m,pre-enrolled-keys=1,size=1M
ide0: cephfs:iso/virtio-win-0.1.262.iso,media=cdrom,size=708140K
ide2: cephfs:iso/en-us_windows_server_2022_updated_aug_2024_x64_dvd_17b2bb17.iso,media=cdrom,size=5826296K
machine: pc-q35-9.0
memory: 8096
meta: creation-qemu=9.0.2,ctime=1730727557
name: PHWin2022TemplConsole2
net0: virtio=BC:24:11:56:D8:FA,bridge=vmbr1,firewall=1
numa: 0
ostype: win11
parent: point
runningcpu: host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt
runningmachine: pc-q35-9.0+pve0
scsi0: local-ZFS-SSD:vm-553-disk-1,iothread=1,size=80G
scsihw: virtio-scsi-single
smbios1: uuid=f7a8d488-5ad8-4204-97ec-d2797a962aae,manufacturer=Vk13YXJlLCBJbmMu,product=TXdhcmUgVmlydHVhbCBQbGF0Zm9ybQ==,base64=1
sockets: 2
tags: migration2026withsnap
tpmstate0: local-ZFS-SSD:vm-553-disk-2,size=4M,version=v2.0
vmgenid: ef0febec-2851-43ab-8461-35e4f60a9b60
vmstate: local-ZFS-SSD:vm-553-state-suspend-2025-08-30

[point]
bios: ovmf
boot: order=scsi0;ide0;ide2;net0
cores: 2
cpu: host
efidisk0: local-ZFS-SSD:vm-553-disk-0,efitype=4m,pre-enrolled-keys=1,size=1M
ide0: cephfs:iso/virtio-win-0.1.262.iso,media=cdrom,size=708140K
ide2: cephfs:iso/en-us_windows_server_2022_updated_aug_2024_x64_dvd_17b2bb17.iso,media=cdrom,size=5826296K
machine: pc-q35-9.0
memory: 8096
meta: creation-qemu=9.0.2,ctime=1730727557
name: PHWin2022TemplConsole2
net0: virtio=BC:24:11:56:D8:FA,bridge=vmbr1,firewall=1
numa: 0
ostype: win11
runningcpu: host,hv_ipi,hv_relaxed,hv_reset,hv_runtime,hv_spinlocks=0x1fff,hv_stimer,hv_synic,hv_time,hv_vapic,hv_vpindex,+kvm_pv_eoi,+kvm_pv_unhalt
runningmachine: pc-q35-9.0+pve0
scsi0: local-ZFS-SSD:vm-553-disk-1,iothread=1,size=80G
scsihw: virtio-scsi-single
smbios1: uuid=f7a8d488-5ad8-4204-97ec-d2797a962aae
snaptime: 1744359117
sockets: 2
tpmstate0: local-ZFS-SSD:vm-553-disk-2,size=4M,version=v2.0
vmgenid: a2557dcb-424d-470e-89db-cf02352094c0
vmstate: local-ZFS-SSD:vm-553-state-point
Click to expand...
 
bbgeek17 said:
There might be an overzealous check in there. An easy immediate resolution is to detach the ISO. It would also be a good test result.

Out of curiousity - do you have "cephfs" on the remote side?

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
Click to expand...
Sure, I do the CephFS on the target cluster with the same contents.
It's a solution, but it takes additional processing.
 
You must log in or register to reply here.
Top Bottom
Back