Search results

  1. G

    vmbr0 suddenly stopped working on 2 nodes out of 3 Urgent request for help

    We have a productive cluster suddenly networking on vmbr0 stopped on 2 member nodes node 1 is ok. how to get this back to work ? any hints are welcome ! auto lo iface lo inet loopback iface enp69s0f0 inet manual mtu 9000 iface enp204s0f0 inet manual mtu 9000 iface...
  2. G

    cannot migrate vm with local cd/dvd but i have NO local resources

    I have no glue why live migration is NOT possible, vm has NO local resources. any help is appreciated qm config 100 agent: 1 boot: order=scsi0;net0 cores: 2 memory: 16384 name: AD net0: virtio=E2:9D:97:20:F8:8F,bridge=vmbr0,firewall=1 numa: 0 onboot: 1 ostype: win8 parent: voruseranlegen...
  3. G

    Desaster recovery of a ceph storage, urgent help needed

    Sorry for cross posting, but got no response to my original posting... Original post any help would be highly appreciated Gerhard
  4. G

    Crushmap vanished after Networking error

    Hi I have a worst case, osd's in a 3 node cluster each 4 nvme's won't start we had a ip config change in public network, and mon's died so we managed mon's to come back with new ip's. corosync on 2 rings is fine, all 3 mon's are up osd's won't start how to get back to the pool, already...
  5. G

    nvmedisk move to other slot

    Hi Followers, We made a mistake in physically placing nvme disks on our machine. currently 7 nvme per node, but all are tied to cpu#1 I search for a best practice to move half of them to disk-slots tied to cpu#2 my first approach from theory :) on each storage node: move.sh: (param: 1)...
  6. G

    Ceph-iscsi howto ?

    Hi cant find ceph-iscsi for luminous in proxmox repros .... according to: http://docs.ceph.com/docs/master/rbd/iscsi-target-cli/
  7. G

    cluster replication between two locations

    Hi Folks, I plan a proxmox cluster for a customer, he has a dedicated line between two location, but only 10 Mbit/s synchronous. vm's will be (windows ad terminalserver , exchange, m$-sql server) clients connect via rdp on Terminalserver . We want to setup a cluster on both sites , so in case...
  8. G

    Container no Disk stats

    just running a sysbench within a container (debian9) Gui does not graph Disk I/O ! working fine for KVM (linux/windows) guests how to get these Stats ? back
  9. G

    virtio disk driver windows2016 rate limited ?

    Hi Folks, Just migrated ceph totally to bluestore a test with windows2016 Server has good results, but i think limiting component is virtio driver! see also https://forum.proxmox.com/threads/virtio-ethernet-driver-speed-10gbite.35881/ concering Ethernet speed ... I see no "tunables" to...
  10. G

    Migrating to bluestore now ? or later ?

    Hi Folks, shall i migrate from filestore to bluestore following this article ? http://docs.ceph.com/docs/master/rados/operations/bluestore-migration/ or wait for ceph 12.2.x ? currenty pve has 12.1.2 luminous rc ... but how long to wait ? any release plans for 12.2 ? regards
  11. G

    recent update this morning breaks ceph

    Hi I installed v5 beta and then v5 release. i had no problems with updates so far, exept this morning. I scanned for new updates, and alot of ceph updates popped up.... i installed them on all 4 machines .. now i have no active mgr in gui, i suppose i shredded ceph completly.... osds an mons...
  12. G

    proxmox gui datacenter Storage is twice ceph storage ?

    Hi Folks, Datacenter summary view ./. Ceph status view cat /etc/pve/storage.cfg dir: local path /var/lib/vz content iso,backup,vztmpl lvmthin: local-lvm thinpool data vgname pve content rootdir,images rbd: vmstorage monhost 192.168.100.141...
  13. G

    node restart and automatically migrate VM's (HA)

    Hi Folks, I for any reason a Node will perform a (controlled) restart... no one of running VM's are migrated to best effort free node on cluster, even VM is in a HA group ! I think this is not the behavior intended by HA . am I wrong or may I have missed some vital information's ? regards...
  14. G

    Virtio Ethernet Driver speed >10GbitE ?

    Hi Folks We have Mellanox with 56 GbitE , but I only can pass 10GigE to Vm's with virtio driver who to accomplish VFIO with kvm on proxmox 5 ? Driver may have this capability (SR-IOV) Capabilities: [9c] MSI-X: Enable+ Count=128 Masked- Vector table: BAR=0...
  15. G

    template storage on ceph ? howto ?

    Hi Folks, I you have as only shared storage ceph on your cluster, how to accomplish templates on ceph ? I see no solution in documentation .... regards Gerhard
  16. G

    Cluster restart (best practice)

    Hi Folks, I wonder not seeing any posts about this. Scenario: You update/dist-upgrade each node and need a restart because of kernel enhancements... I stop all vm's and containers on all nodes, and restart all nodes with reboot on cli in timely short sequenze ... this always cause some heavy...
  17. G

    Proxmox V5 displays Beta after Upgrading from Beta2 to release!

    in web-gui: Virtual Environment 5.0-23/af4267bf BETA pveversion -v proxmox-ve: 5.0-15 (running kernel: 4.10.15-1-pve) pve-manager: 5.0-23 (running version: 5.0-23/af4267bf) pve-kernel-4.10.15-1-pve: 4.10.15-15 pve-kernel-4.10.11-1-pve: 4.10.11-9 libpve-http-server-perl: 2.0-5 lvm2...
  18. G

    ceph performance 4node all NVMe 56GBit Ethernet

    Hi Folks, Whis performanche shoud i expect for this cluster ? are my settings ok ? 4 nodes: system: Supermicro 2028U-TN24R4T+ 2 port Mellanox connect x3pro 56Gbit 4 port intel 10GigE memory: 768 GBytes CPU DUAL Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz ceph: 28 osds 24 Intel Nvme 2000GB...
  19. G

    unexpected restart of node ?

    Hi Folks, I have a strange problem, Fresh install of 4.4 on 4 nodes all NVMe last morning and today a vm has been stopped automatically and migrated to next node I can't find errors in logs, how to debug this strange behavior ? Worst of all vm has a mysql instance as slave after second...
  20. G

    ceph journaldisk multi partitions on NVMe nightmare

    Hi Folks, Just got my new cluster machines all NVMe I have one Journaldisk Fast NVMe with 1.5 TB you can not partion this on gui so i did this in cli... parted /dev/nvme0n1 mkpart journal01 1 250G mkpart journal02 250G 500G mkpart journal03 500G 750G mkpart journal04 750G 1000G mkpart...