[SOLVED] [Bug?] Cluster - Cant use template accross datacenter from one host

[hasechris92]

Hi,

What i want to do now is:
- manage and maintain the hottemplate vms on node mgtsrv001
- create a second vm from hottemplate and convert to template (still on mgtsrv001)
- use the template to deploy new vms to both cluster nodes

What is my problem:
Proxmox does not let me clone a template to vm to another node. I tested and found that the vm template can only be used on the same node.

---

More Info regarding my overall setup:

Two Nodes (mgtsrv001 & wgpve)
- mgtsrv001 is a NAS build, 1TB Samsung 860 EVO and 8x WD Gold 1TB. Mainboard is a Supermicro A2SDi-8C+-HLN4F with 64 GB RAM, Storage is managed with ZFS.
- wgpve is a normal host, 256 GB Samsung 970 Pro NVMe, Intel NUC 12th Gen. I will use this host for the network services which dont need much storage (like "homeassistant", "Unifi Controller", "Univention LDAP Server")

The two nodes each use a local SSD for the datastore cluster-shared-vms. here the /etc/pve/storage.cfg
zfspool: cluster-shared-vms
pool cluster-shared/vms
blocksize 128k
content images
sparse 1

I can migrate vms to an from the nodes, also in live mode with the vm running; so all working good here. The HA Cluster is also working, vms from crashed hosts are restarted automatically and if i setup replication that is also working.

If i missed anything please just ask me

Greetings
hasechris92

 

[fabian]

yeah, the source and target VM need to be on the same node for local storage using VMs. if the VM is completely on shared storage(s), then the clone will happen on the node of the source VM, and then moved to the target node once the clone is done..

 

[hasechris92]

yeah, the source and target VM need to be on the same node for local storage using VMs. if the VM is completely on shared storage(s), then the clone will happen on the node of the source VM, and then moved to the target node once the clone is done..

hm ok.
So if I understand you correctly all Cluster functions i used so far are capable to work without a central storage via NFS or SMB.
That would be
- Replication
- Offline Migration
- Live Migration

All of these are working with local(!) ZFS Storage.

Then (afaik) the only function which does not work with this local storage setup is the template cloning. Sadly this just does not make any sense to me. I could totally understandif this limitation would exist for the Replication or Migration or the Linked-Clone VM (from Template).

So if I understood you correctly I would need a NFS/SMB Storage for this one function "Template Cloning"?

Best regards
hasechris92

 

[fabian]

no, template cloning works fine with ZFS. it just doesn't work across node boundaries for local storages, as that requires a shared storage. you can clone locally, and then migrate.

 

[hasechris92]

no, template cloning works fine with ZFS. it just doesn't work across node boundaries for local storages, as that requires a shared storage. you can clone locally, and then migrate.

woops my bad; i spelled the last question badly. I meant "Cluster-wide Template Cloning" instead of "Template Cloning".

OK, so i can clone locally and then migrate the new vm. Will use this method, thanks

Could you maybe trigger an update to the Documentation? There is no distinction for local and shared storage and which functionality has a limitation in a cluster without shared storage.

Thanks
hasechris92

 

[albertpruis]

Hi,

What i want to do now is:
- manage and maintain the hottemplate vms on node mgtsrv001
- create a second vm from hottemplate and convert to template (still on mgtsrv001)
- use the template to deploy new vms to both cluster nodes

What is my problem:
Proxmox does not let me clone a template to vm to another node. I tested and found that the vm template can only be used on the same node.
View attachment 53662

---

More Info regarding my overall setup:
View attachment 53661
Two Nodes (mgtsrv001 & wgpve)
- mgtsrv001 is a NAS build, 1TB Samsung 860 EVO and 8x WD Gold 1TB. Mainboard is a Supermicro A2SDi-8C+-HLN4F with 64 GB RAM, Storage is managed with ZFS.
- wgpve is a normal host, 256 GB Samsung 970 Pro NVMe, Intel NUC 12th Gen. I will use this host for the network services which dont need much storage (like "homeassistant", "Unifi Controller", "Univention LDAP Server")

The two nodes each use a local SSD for the datastore cluster-shared-vms. here the /etc/pve/storage.cfg
zfspool: cluster-shared-vms
pool cluster-shared/vms
blocksize 128k
content images
sparse 1

I can migrate vms to an from the nodes, also in live mode with the vm running; so all working good here. The HA Cluster is also working, vms from crashed hosts are restarted automatically and if i setup replication that is also working.

If i missed anything please just ask me

Greetings
hasechris92

How is the Intel NUC working for you? If it works like a charm, can you please provide the specifications?

 

[hasechris92]

How is the Intel NUC working for you? If it works like a charm, can you please provide the specifications?

I replied in pm, please dont re-use threads.

 

[albertpruis]

Ok, I will do that, thanks