Struggling with pools, storages...

fibo_fr

Member
Apr 21, 2014
40
2
8
Remoulins, France
English is not my mother tongue, so I'm probably missing some evident subtleties between several word meanings.
(My final goal: using ceph storage on my 3 nodes cluster for containers and VMs)

I feel somewhat confused at how are related
- ceph storage
- ceph pools
- proxmox storage
- proxmox pools

Probably clearly defined together somewhere... but did not find it

Thx for your help
 
If this is evident for everyone, could someone give me the answer?

What is the question? If you ask short and clear questions, you will get also a clear answer here.

If you want to learn more about ceph, check http:://ceph.com

Proxmox VE wiki is on http://pve.proxmox.com
 
My problem:
When creating a CT or a VM with the GUI, I cannot access the storage: the storage list stays empty, see capture below.​

What should be done to be able to select one of my storage spaces?

Background info: I had some problems to set up my proxmox cluster and my ceph server, sonce my nodes cluster runs with unicast.
With some trial and errors I managed to get it somehow working... but visibly something is incorrect.
I presume I am making confusion between (ceph and proxmox) pools as well as storage... hence my initial question.
upload_2016-6-13_17-41-16.png
 
you do not have a storage enabled for container. do this via "Datacenter/Storage" and add as "Content" containers.

and/or post your storage.cfg:

> cat /etc/pve/storage.cfg
 
proxmox-datacenter-storage.PNG
B-) Seems there is a discrepancy between GUI (above) and the file...
Code:
root@myserv3:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        content backup,iso,images,rootdir,vztmpl
        maxfiles 0

rbd: Machines
        monhost myserv4,myserv3
        username admin
        krbd
        content rootdir,images
        pool rbd

rbd: Containers
        monhost myserv0,myserv3,myserv4
        username admin
        krbd
        content rootdir,images
        pool rbd

rbd: monceph
        monhost myserv3,myserv4
        username admin
        krbd
        content images,rootdir
        pool internes

rbd: nouveaux
        monhost myserv3,myserv4,myserv0
        krbd

root@myserv3:~#
 
Last edited:
maybe you do not have the right permission? do you use the "root" user for creation your container?
 
do you use the "root" user for creation your container?
I believe so: the CT or VM creation is attempted after logging as root on the GUI.

Storage cfg displays admin as a username for the ceph/rbd cluster. Is that OK?

What puzzles me if that my storage list does not show at least the local storage...
 
does your ceph storage work correctly (does it load the summary of the storage? show something in the content? can you create a vm there?)
i saw this once, where i had a misconfigured ceph storage, the listing of the storages timed out and i could not choose any

also the output of
Code:
pvesm status

could be helpful
 
does your ceph storage work correctly
Not sure if I look at pveceph status (attached txt file)
(does it load the summary of the storage?
As I stated in my initial question, not sure what storage means in your sentence... which command would give me that? pveceph lspools gives me
Code:
Name                       size     pg_num            used
internes                      3        172                    0
rbd                              3        128                    0
but this is not what you ask, right?
show something in the content? can you create a vm there?)
I do not know how to put content in there, that is the goal I want to achieve...
I gave the problem of creating a CT to illustrate the "strorage list problem", but it also present when creating VMs
(except that I can create manually a CT from a command line, but I fail doing so for a VM, more precisely for creating its disk space)


So yes, as stated earlier I surely have a misconfigured ceph storage

Pvesm status gives me after a looooong time
Code:
pvesm status -storage local
Containers    rbd 1               0               0               0 100.00%
Machines      rbd 1               0               0               0 100.00%
local         dir 1       490365048         8681352       456751552 2.37%
monceph       rbd 1               0               0               0 100.00%
nouveaux      rbd 1               0               0               0 100.00%
 

Attachments

  • ceph-status.txt
    4.8 KB · Views: 2
As I stated in my initial question, not sure what storage means in your sentence...

to clarify:
pve uses a "storage" to store vm/container images for details see https://pve.proxmox.com/wiki/Storage_Model
you have for instance: "Containers", "Machines", "local", "monceph", "nouveaux" defined as storages (each one is a different)
a pve pool has nothing to do with storage at all (it is mostly a permission thing) see https://pve.proxmox.com/wiki/User_Management#Pools_2

if i refer to "ceph storage" i mean specific storage of the type ceph

ceph pools are groups of space in a ceph storage see http://docs.ceph.com/docs/master/ for details and general information about ceph

to your problem,
did you follow https://pve.proxmox.com/wiki/Ceph_Server ?
especially the part of https://pve.proxmox.com/wiki/Ceph_Server#Ceph_Client
where it says to copy the keyring?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!