PVE and DRBD 8.4.5

C

cesarpk

Well-Known Member
Mar 31, 2012
770
3
58
Hi

Can anybody help me?

I have installed DRBD 8.4.5 in the kernel from the git, and don't have installed drbd-utils-8.9.1. When i try install the "drbd-utils-8.9.1.tar.gz" file, it is installed, but in other not standard directories.

So that my question is how can i install and uninstall drbd-utils-8.9.1 in a correct mode?

This is the message when DRBD 8.4.5 from the git repo is installed and started without drbd-utils-8.9.1:

Starting DRBD resources:DRBD module version: 8.4.5
userland version: 8.3.13
you should upgrade your drbd tools!

Best regards
Cesar
 
Last edited:
Many thanks mir, the problem was resolved... You are the best !!!! :)

Best regards
Cesar
 
cesarpk said:
Many thanks mir, the problem was resolved... You are the best !!!! :)

Best regards
Cesar
Click to expand...

Hi mir

Sorry, I was wrong, the problem of not respecting directories persists (installed in a new PVE host).

What I can do for that drbd-utils-8.9.1 respect the directories structure of Debian?

Best regards
Cesar
 
You need a debian stable with build tools and debhelper et al.
Then clone the drbd-utils repo. This repo contains the needed deb helper build scripts.
1) cd cloned repo
2) git checkout tags/tag_you_which_to_build
3) git checkout -b tag_you_which_to_build
4) ./autogen.sh
5) dpkg-buildpackage -rfakeroot -b -tc
 
Hi Mir

Many thanks for your .deb installers, it install very well.

Now i have another problem:

After configuring DRBD, when I start the DRBD service, I receive these messages in both nodes:

Code: 
<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

.<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

.<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

.<1>received netlink packet for minor 14, while expecting 11

<1>received netlink packet for minor 14, while expecting 21

.<1>netlink: policy violation t:6[6] e:-34

11: reply did not validate - do you need to upgrade your userland tools?
<1>netlink: policy violation t:6[6] e:-34

21: reply did not validate - do you need to upgrade your userland tools?

I have two DRBD resources, named r1 and r2
r1 have only a device DRBD named drbd11
r2 have only a device DRBD named drbd21

This same configuration, i have it in other PVE servers with DRBD 8.4.4 version since much time ago, and never had problems, but with this new version, i get this series of error messages.

Moreover, i use numbers as 11 or 21 due that this numbers tell me the number of "real disk" and "partition", it is only a reference for me, and for some reason, DRBD 8.4.5 version not accept my configuration.

Do you know how fix it?

Any way, many thanks again for your very kind attention

Best regards
Cesar

Re-Edited: With the configuration "minor-count 255;", DRBD accept my configuration, but always i get the error messages.
 
Last edited:
mir said:
The only info I can give you is from the horses mouth itself:cool:
http://www.gossamer-threads.com/lists/drbd/users/26787
Click to expand...

Hi Mir

Thanks for your reply.

With the configuration "minor-count 255;", DRBD accept my configuration, but always i get such error messages.

And from now (with the "minor-count" directive), always that I restarted the DRBD service, i see the resources lifted and synchronized.
version: 8.4.5 (api:1/proto:86-101)
GIT-hash: 1d360bde0e095d495786eaeb2a1ac76888e4db96 build by root@PVE2, 2014-11-22 22:37:11

11: cs:Connected ro:Primary/Primary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0

21: cs:Connected ro:Primary/Primary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:664 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:d oos:0

Moreover, can you tell me what exactly you ran for get the "DRBD-utils 8.4.5 version" installers?. I would like know it, because in a previous post, did not you tell me with clarity, and i have problems for interpret your guide.

Best regards mir, and excuse me please if I do several questions.
Cesar
 
Last edited:
Exact steps, and remember you must build it on Debian Stable - it fails on Testing and Sid:
1) git clone git://git.linbit.com/drbd-utils.git
2) cd drbd-utils
3) git checkout tags/v8.9.1
4) git checkout -b v8.9.1
5) ./autogen.sh
6) dpkg-buildpackage -rfakeroot -b -tc
 
Hi Mir

Thank you very much, again i say, you are the best !!!
Soon I'll try it.

Best regards
Cesar
 
Last edited:
Re-Edited:

Hi to all

Now i have the same problem with drbd 8.4.4, that in other servers always it worked very well, i have to investigate which is the problem.

Maybe the new Hardware ¿? ¿? ¿?
 
Last edited:
Hi to all

Anybody know if DRBD 8.4.4 or 8.4.5 (or any version) have some problems with NICs Intel X520-DA2 or with Intel X520-DA2 + transceivers?

- The servers are Dell R720, the RAID controller is a PERC 8710P (chip LSI with 1 Gb cache + BBU)
- Several hard disks in several arrays configured.
- Maybe DRBD don't works with OpenVswitch <-- I guess that this is the problem, i will do a test

I get these error messages (the same in both versions):

Code: 
service drbd start
Starting DRBD resources:[
     create res: r1 r2
   prepare disk: r1 r2
    adjust disk: r1:failed(apply-al:255) r2
     adjust net: r1 r2
]
<1>received netlink packet for minor 14, while expecting 21
<1>received netlink packet for minor 14, while expecting 11
<1>received netlink packet for minor 14, while expecting 21
<1>received netlink packet for minor 14, while expecting 11
<1>received netlink packet for minor 14, while expecting 21
<1>received netlink packet for minor 14, while expecting 11
<1>netlink: policy violation t:6[6] e:-34

21: reply did not validate - do you need to upgrade your userland tools?
<1>netlink: policy violation t:6[6] e:-34

11: reply did not validate - do you need to upgrade your userland tools?
11: State change failed: (-2) Need access to UpToDate data
Command '/sbin/drbdsetup primary 11' terminated with exit code 17
11: State change failed: (-2) Need access to UpToDate data
Command '/sbin/drbdsetup primary 11' terminated with exit code 17
11: State change failed: (-2) Need access to UpToDate data
Command '/sbin/drbdsetup primary 11' terminated with exit code 17
11: State change failed: (-2) Need access to UpToDate data
Command '/sbin/drbdsetup primary 11' terminated with exit code 17
11: State change failed: (-2) Need access to UpToDate data
Command '/sbin/drbdsetup primary 11' terminated with exit code 17

Any help will be welcome

Best regards
Cesar
 
Last edited:
Hi again

I answer me to myself (I hope someone can help):

Any version of DRBD not must be used (and maybe nor compiled) while the system have installed openvswitch.

In a compilation of DRBD, while openvswitch was installed and configured, i had this error message:
WARNING: /lib/modules/2.6.32-34-pve/kernel/net/openvswitch/brcompat.ko needs unknown symbol ovs_dp_ioctl_hook

Maybe DRBD not will work nor will compile correctly while the server have a "switch software" installed.

Now i have DRBD 8.4.5 working very well, the next week the servers will be in production.

Best regads
Cesar
 
Hi to all

@To Mir or anyone that can help me

- I have a problem with "drbd-utils 8.9.1" version, it was downloaded from
the git and compiled in my Debian Wheezy, the error messages are these:

root@pve1:/# pvcreate /dev/drbd21
File descriptor 3 (/usr/share/bash-completion/completions) leaked on pvcreate invocation. Parent PID 5335: -bash
File descriptor 4 (/usr/share/bash-completion/completions) leaked on pvcreate invocation. Parent PID 5335: -bash
Physical volume "/dev/drbd21" successfully created

root@pve1:/# ll /dev/drbd* -d (i don't see the "drbd" directory)
/dev/drbd11
/dev/drbd21

root@pve1:/# pvscan
File descriptor 3 (/usr/share/bash-completion/completions) leaked on pvscan invocation. Parent PID 5335: -bash
File descriptor 4 (/usr/share/bash-completion/completions) leaked on pvscan invocation. Parent PID 5335: -bash
PV /dev/sda3 VG pve lvm2 [199.50 GiB / 16.00 GiB free]
PV /dev/drbd21 lvm2 [20.00 GiB]
Total: 2 [219.50 GiB] / in use: 1 [199.50 GiB] / in no VG: 1 [20.00 GiB]

- At difference of DRBD 8.4.4 version (that was installed in other servers), I don't have these files, directories and links:
/etc/udev/rules.d/65-drbd.rules
/dev/drbd/
/dev/drbd/by-disk
/dev/drbd/by-disk/(the links that must be within.)
/dev/drbd/by-res
/dev/drbd/by-res/(the links that must be within.)

- Maybe my compilation don't have all the necessary options enabled.

- This was my execution by cli:
shell> mkdir drbd-utils
shell> cd drbd-utils
shell> git clone git://git.linbit.com/drbd-utils.git
shell> cd drbd-utils
shell> git checkout tags/v8.9.1
shell> git checkout -b v8.9.1
shell> ./autogen.sh
shell> dpkg-buildpackage -rfakeroot -b -tc
shell> cd ..
shell> dpkg -iGE *.deb

- And this is the content of the autogen.sh file:
#!/bin/sh

# for those that expect an autogen.sh,
# here it is.

aclocal
autoheader
autoconf

echo "
suggested configure parameters:
# prepare for rpmbuild, only generate spec files
./configure --enable-spec
# or prepare for direct build
./configure --prefix=/usr --localstatedir=/var --sysconfdir=/etc
"

My question:
1) How can i fix it? (please if possible, tell me the commands I have to run by CLI.)
(Maybe only copying the "/etc/udev/rules.d/65-drbd.rules" file of the old server that have the "drbd 8.4.4" version installed to the new server that have the "drbd-utils 8.9.1" version installed?)

Best regards
Cesar

Re-Edited: After of copy the "/etc/udev/rules.d/65-drbd.rules" file of the old server that have the "drbd 8.4.4" version installed to my new server, i run in my new server:
shell> pvscan
PV /dev/sda3 VG pve lvm2 [199.50 GiB / 16.00 GiB free]
PV /dev/drbd21 lvm2 [20.00 GiB]
Total: 2 [219.50 GiB] / in use: 1 [199.50 GiB] / in no VG: 1 [20.00 GiB]

It is great see this, but i am not sure if my solution will be free of problems, i would like to hear a second opinion.
 
Last edited:
mir said:
I can't help you with this. I suggest you ask in the DRBD forum.
Click to expand...

Ok Mir, i will do it, anyway, many thanks, i value much the help you have given me.

If you want to know the results of my question in the drbd forum, only let me know.

Best regards
Cesar
 
Last edited:
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom