Search results

@martin thank for notifying ! ceph still not runs with rdma enabled

just test first with dados bench example 56 Mbit/s cluster rados bench -p rbd 300 write --no-cleanup -t 256 ... Total time run: 300.048707 Total writes made: 266600 Write size: 4194304 Object size: 4194304 Bandwidth (MB/sec): 3554.09 Stddev Bandwidth...

typical windows server ... workload tons of files in windows filesystem, dedicated sql-server, and exchange server ... so transparent blockdevice replication would be best .... existing line 10mbit/s leased line is now only used for 15 Workstations RDP traffic.. QoS is just not really possible...

@jeffwadsworth Thanks for these directions, but i see no real live solution yet, or have i missed something. also bandwidth calculation and latency demands for rbd-mirror are not known for me ... has anyone implemented this scenario ?

yep i saw this, but we want to build ceph storage and replicate this other this thin-pipe .... this article refers to zfs

Hi Folks, I plan a proxmox cluster for a customer, he has a dedicated line between two location, but only 10 Mbit/s synchronous. vm's will be (windows ad terminalserver , exchange, m$-sql server) clients connect via rdp on Terminalserver . We want to setup a cluster on both sites , so in case...

@fabian Mellanox requested to see Infiniband.cc of your version ... can you please send me this ? Gerhard, can you send me Infiniband.cc which is compiled in in your version? From: Vladimir Koushnir Sent: Friday, October 06, 2017 8:23 PM To: Gerhard W. Recher <gerhard.recher@net4sec.com>...

hi fabian ... this fix does not win the rdma match .... cluster will still not be able to come up rdma enabled :( i dropped mellanox a note and a link to our log files

just running a sysbench within a container (debian9) Gui does not graph Disk I/O ! working fine for KVM (linux/windows) guests how to get these Stats ? back

@fabian any plans to commit this patch in your 12.2.1 instance ?

@fabian any chance to get this incorporated ? rdma will *not* run without this patch :( https://github.com/ceph/ceph/pull/18091

@fabian I'm just in conference with mellanox, we found a bug in 12.2.1 (also present in previous versions) they will push this today to 12.2.1 master. The bug occurs as gid_idx is not initialized in a Port object. offending messages: 2017-10-02 10:56:03.378774 7fb5f27fc700 20...

Fabian, I installed new kernel, but rdma for ceph still does not work. I opened a discussion on ceph-user-list and and a case @ mellanox shall I initiate a new thread "rdma for ceph" or keep updating this thread ?

Fine! Please mark this thread closed...

fabian yes i meant this .... so both repros are identical ? deb https://download.ceph.com/debian-luminous stretch main deb http://download.proxmox.com/debian/ceph-luminous stretch main [\code] ok so i wait for Kernel 4.13.x ... how to get a notification if kernel is pushed ?

fabian may i switch to ceph install from ceph ? before trying new kernel from proxmox ? perhaps proxmox ceph compiling instruction are not complete for utilizing RDMA on Mellanox connect3 pro ? regarding support for RDMA.... I think many customers out there are interested in this ... gaining...

fabian, it's not ib but 56gBit/s Ethernet ..... may i donate a pair of nic's for your lab ? ceph mailing list is also not really helpful.

@fabian i managed to change the systemd files as mentioned earlier in this thread. but ceph won't start.... so i reverted my ceph.conf not to use rdma :( I'm totally stuck -- Reboot -- Sep 26 18:56:10 pve02 systemd[1]: Started Ceph cluster manager daemon. Sep 26 18:56:10 pve02 systemd[1]...

simply install : apt-get install net-tools

follow up my previous post ... cloning ....