Hi there...
I have 2 PVE nodes and 5 servers as CEPH Storage, also building under PVE Servers.
So I have two cluster:
1 cluster with 2 PVE nodes, named PROXMOX01 and PROXMOX02.
* PROXMOX01 runs proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve) pve-manager: 5.3-11 (running version: 5.3-11/d4907f84)
* PROXMOX02 runs proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve) pve-manager: 5.3-11 (running version: 5.3-11/d4907f84), as well!
1 cluster with 5 PVE nodes (previously 6 PVE nodes), which is a CEPH Storage.
I have lost one of the nodes on Cluster CEPH Storage.
Now, in PROXMOX01 web gui, I was able to browser ceph storage, just accessing NODE -> ceph-storage
(ceph-storage is the ID in storage.cfg)
But, when try do this in PROXMOX02, in web gui, I get communication failure(0).
But, yet, inside PROXMOX02 shell, the command:
pvesm list ceph-storage
works, it's took a while but give the list of VM's images...
I already try:
- Update the PROXMOX02 node
- Updacerts in PROXMOX02 - pvecm updatecerts -f
That's the storage.cfg file:
rbd: ceph-storage
content images
krbd 0
monhost 10.10.10.100;10.10.10.110;10.10.10.120;10.10.10.130;10.10.10.150
pool VMPOOL1
username admin
rbd: ceph-ct
content rootdir
krbd 1
monhost 10.10.10.100;10.10.10.110;10.10.10.120;10.10.10.30;10.10.10.150
pool VMPOOL1
username admin
The command above works fine:
/usr/bin/rados -p VMPOOL1 -m 10.10.10.100,10.10.10.110,10.10.10.120,10.10.10.130,10.10.10.150 -n client.admin --keyring /etc/pve/priv/ceph/ceph-storage.keyring --auth_supported cephx df
2019-03-14 12:19:21.715687 7f029277fb40 -1 did not load config file, using default settings.
pool name KB objects clones degraded unfound rd rd KB wr wr KB
VMPOOL1 3479854438 881754 79493 0 0 496037325 106874159875 281179328 8343005130
total used 10646467520 881754
total avail 33305886720
total space 43952354240
Is there something else I could try to solve this issue?
Thanks
I have 2 PVE nodes and 5 servers as CEPH Storage, also building under PVE Servers.
So I have two cluster:
1 cluster with 2 PVE nodes, named PROXMOX01 and PROXMOX02.
* PROXMOX01 runs proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve) pve-manager: 5.3-11 (running version: 5.3-11/d4907f84)
* PROXMOX02 runs proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve) pve-manager: 5.3-11 (running version: 5.3-11/d4907f84), as well!
1 cluster with 5 PVE nodes (previously 6 PVE nodes), which is a CEPH Storage.
I have lost one of the nodes on Cluster CEPH Storage.
Now, in PROXMOX01 web gui, I was able to browser ceph storage, just accessing NODE -> ceph-storage
(ceph-storage is the ID in storage.cfg)
But, when try do this in PROXMOX02, in web gui, I get communication failure(0).
But, yet, inside PROXMOX02 shell, the command:
pvesm list ceph-storage
works, it's took a while but give the list of VM's images...
I already try:
- Update the PROXMOX02 node
- Updacerts in PROXMOX02 - pvecm updatecerts -f
That's the storage.cfg file:
rbd: ceph-storage
content images
krbd 0
monhost 10.10.10.100;10.10.10.110;10.10.10.120;10.10.10.130;10.10.10.150
pool VMPOOL1
username admin
rbd: ceph-ct
content rootdir
krbd 1
monhost 10.10.10.100;10.10.10.110;10.10.10.120;10.10.10.30;10.10.10.150
pool VMPOOL1
username admin
The command above works fine:
/usr/bin/rados -p VMPOOL1 -m 10.10.10.100,10.10.10.110,10.10.10.120,10.10.10.130,10.10.10.150 -n client.admin --keyring /etc/pve/priv/ceph/ceph-storage.keyring --auth_supported cephx df
2019-03-14 12:19:21.715687 7f029277fb40 -1 did not load config file, using default settings.
pool name KB objects clones degraded unfound rd rd KB wr wr KB
VMPOOL1 3479854438 881754 79493 0 0 496037325 106874159875 281179328 8343005130
total used 10646467520 881754
total avail 33305886720
total space 43952354240
Is there something else I could try to solve this issue?
Thanks