UserKnownHostsFile=/etc/pve/nodes/pve/ssh_known_hosts' -o 'GlobalKnownHostsFile

[deanfourie]

Hi, I seem to be having issues with replication failing. The error seems to be some issue with SSH.

Anyone have any idea what this can be? Theres not much info out there on this error.

Thanks

2024-05-07 23:13:02 103-0: start replication job
2024-05-07 23:13:02 103-0: guest => CT 103, running => 1
2024-05-07 23:13:02 103-0: volumes => Replication:subvol-103-disk-0
2024-05-07 23:13:03 103-0: (remote_prepare_local_job) storage 'Replication' is not available on node 'pve'
2024-05-07 23:13:03 103-0: end replication job with error: command '/usr/bin/ssh -e none -o 'BatchMode=yes' -o 'HostKeyAlias=pve' -o 'UserKnownHostsFile=/etc/pve/nodes/pve/ssh_known_hosts' -o 'GlobalKnownHostsFile=none' root@172.16.103.2 -- pvesr prepare-local-job 103-0 Replication:subvol-103-disk-0 --last_sync 0' failed: exit code 255

 

[cheiss]

Hi,

2024-05-07 23:13:03 103-0: (remote_prepare_local_job) storage 'Replication' is not available on node 'pve'

for replication, the storage must be named the exact same on both nodes, which does not seem to be the case in your setup, see also Possible Issues in our documentation.

Can you please post the output of /etc/pve/storage.cfg?

 

[deanfourie]

Thanks for the reply. I am pretty sure I named both ZFS storages exactly the same.

See the output from both nodes, only 2 in the cluster.

Node1

lvmthin: local-lvm
        disable
        thinpool data
        vgname pve
        content rootdir,images


pbs: pbs
        datastore Backup
        server 172.16.103.13
        content backup
        fingerprint **
        prune-backups keep-all=1
        username backup@pbs


dir: local
        path /var/lib/vz
        content vztmpl,iso,rootdir,images,backup,snippets
        prune-backups keep-all=1


zfspool: Replication
        pool Replication
        content images,rootdir
        mountpoint /Replication
        nodes vm

Node2

lvmthin: local-lvm
        disable
        thinpool data
        vgname pve
        content rootdir,images


pbs: pbs
        datastore Backup
        server 172.16.103.13
        content backup
        fingerprint **
        prune-backups keep-all=1
        username backup@pbs


dir: local
        path /var/lib/vz
        content vztmpl,iso,rootdir,images,backup,snippets
        prune-backups keep-all=1


zfspool: Replication
        pool Replication
        content images,rootdir
        mountpoint /Replication
        nodes vm

 

[cheiss]

Hi,

first of, the storage.cfg is synced on all nodes, so it's enough normally to post the output from any node.

zfspool: Replication
        pool Replication
        content images,rootdir
        mountpoint /Replication
        nodes vm

Note the nodes property, which describes where this storage is available. Thus, it is not available on the node pve.
Did you create a Replication ZFS pool on the target pool?

Can you post the output of zfs list from both nodes?

 

[deanfourie]

Hi,

first of, the storage.cfg is synced on all nodes, so it's enough normally to post the output from any node.


Note the nodes property, which describes where this storage is available. Thus, it is not available on the node pve.
Did you create a Replication ZFS pool on the target pool?

Can you post the output of zfs list from both nodes?

Ok so, when I created the ZFS pool on Node 2 i did not click "Add Storage". I redid it and it started syncing instantly.