DRBD with 2.6.35-6

udo · Oct 24, 2010

Hi,
i have tried the 2.6.35-kernel, but it seems that drbd don't work:

Code:

drbdadm show-gi r0
DRBD module version: 8.3.8
   userland version: 8.3.7
you should upgrade your drbd tools!

Code:

pveversion -v
pve-manager: 1.6-5 (pve-manager/1.6/5261)
running kernel: 2.6.35-1-pve
proxmox-ve-2.6.32: 1.6-24
pve-kernel-2.6.32-4-pve: 2.6.32-24
pve-kernel-2.6.35-1-pve: 2.6.35-6
qemu-server: 1.1-22
pve-firmware: 1.0-9
libpve-storage-perl: 1.0-14
vncterm: 0.9-2
vzctl: 3.0.24-1pve4
vzdump: 1.2-8
vzprocps: 2.0.11-1dso2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.12.5-2
ksm-control-daemon: 1.0-4

with 2.6.32-24 drbd works.

Udo

dietmar · Oct 24, 2010

I though that is just a warning?

tom · Oct 24, 2010

can you try this one?
http://packages.debian.org/experimental/drbd8-utils

udo · Oct 24, 2010

tom said:
can you try this one?
http://packages.debian.org/experimental/drbd8-utils

Hi,
@dietmar: no it's not only a warning - the drbd-resources aren't show.

@tom: Thanks - it works (first testing):

Code:

drbdadm show-gi r0

       +--<  Current data generation UUID  >-
       |               +--<  Bitmap's base data generation UUID  >-
       |               |                 +--<  younger history UUID  >-
       |               |                 |         +-<  older history  >-
       V               V                 V         V
FBB06BAC38231AF7:0000000000000000:8C9220896CF8B4ED:0BAA91A6BC463A75:1:1:1:1:0:0:0
                                                                    ^ ^ ^ ^ ^ ^ ^
                                      -<  Data consistency flag  >--+ | | | | | |
                             -<  Data was/is currently up-to-date  >--+ | | | | |
                                  -<  Node was/is currently primary  >--+ | | | |
                                  -<  Node was/is currently connected  >--+ | | |
         -<  Node was in the progress of setting all bits in the bitmap  >--+ | |
                        -<  The peer's disk was out-dated or inconsistent  >--+ |
      -<  This node was a crashed primary, and has not seen its peer since   >--+

flags: Primary, Connected, UpToDate

Udo

udo · Nov 26, 2010

Hi,
unfortunalty DRBD isn't very stable with this configuration - after resync the drbd-device unconnected after a short time (make a speed-test to a LV on the drbd-device).

My version:

Code:

pveversion -v
pve-manager: 1.6-5 (pve-manager/1.6/5261)
running kernel: 2.6.35-1-pve
proxmox-ve-2.6.32: 1.6-24
pve-kernel-2.6.32-4-pve: 2.6.32-24
pve-kernel-2.6.35-1-pve: 2.6.35-6
qemu-server: 1.1-22
pve-firmware: 1.0-9
libpve-storage-perl: 1.0-14
vncterm: 0.9-2
vzctl: 3.0.24-1pve4
vzdump: 1.2-8
vzprocps: 2.0.11-1dso2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.12.5-2
ksm-control-daemon: 1.0-4

Code:

apt-cache policy drbd8-utils
drbd8-utils:
  Installed: 2:8.3.8.1-1
  Candidate: 2:8.3.8.1-1
  Version table:
 *** 2:8.3.8.1-1 0
        100 /var/lib/dpkg/status
     2:8.3.7-1~bpo50+1 0
        500 http://download.proxmox.com lenny/pve Packages
     2:8.0.14-2+lenny1 0
        500 http://ftp.de.debian.org lenny/main Packages
        500 http://security.debian.org lenny/updates/main Packages
modinfo drbd
filename:       /lib/modules/2.6.35-1-pve/kernel/drivers/block/drbd/drbd.ko
alias:          block-major-147-*
license:        GPL
version:        8.3.8
description:    drbd - Distributed Replicated Block Device v8.3.8
author:         Philipp Reisner <phil@linbit.com>, Lars Ellenberg <lars@linbit.com>
srcversion:     299AFE04D7AFD98B3CA0AF9
depends:        lru_cache
vermagic:       2.6.35-1-pve SMP mod_unload modversions 
parm:           minor_count:Maximum number of drbd devices (1-255) (uint)
parm:           disable_sendpage:bool
parm:           allow_oos:DONT USE! (bool)
parm:           cn_idx:uint
parm:           proc_details:int
parm:           usermode_helper:string

/var/log/messages:

Code:

.... shorte because 10000 characters-limit
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa043b55e>] ? _ack_id_to_req+0x0/0xf7 [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffff8113d178>] bio_endio+0x2f/0x31
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa0445cd6>] complete_master_bio+0x1f/0x2b [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa043c3a9>] validate_req_change_req_state+0xd1/0xe5 [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa043c747>] got_BlockAck+0x2ec/0x2f9 [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa0443015>] drbd_asender+0x556/0x669 [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffff8104aa59>] ? finish_task_switch+0x4a/0xc4
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa04517f6>] drbd_thread_setup+0x33/0x119 [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffffa04517c3>] ? drbd_thread_setup+0x0/0x119 [drbd]
Nov 26 10:05:49 proxmox1 kernel: [<ffffffff8106a268>] kthread+0x82/0x8a
Nov 26 10:05:49 proxmox1 kernel: [<ffffffff8100ab24>] kernel_thread_helper+0x4/0x10
Nov 26 10:05:49 proxmox1 kernel: [<ffffffff8106a1e6>] ? kthread+0x0/0x8a
Nov 26 10:05:49 proxmox1 kernel: [<ffffffff8100ab20>] ? kernel_thread_helper+0x0/0x10
Nov 26 10:05:49 proxmox1 kernel: Mem-Info:
Nov 26 10:05:49 proxmox1 kernel: Node 0 DMA per-cpu:
Nov 26 10:05:49 proxmox1 kernel: CPU    0: hi:    0, btch:   1 usd:   0
Nov 26 10:05:49 proxmox1 kernel: CPU    1: hi:    0, btch:   1 usd:   0
Nov 26 10:05:49 proxmox1 kernel: CPU    2: hi:    0, btch:   1 usd:   0
Nov 26 10:05:49 proxmox1 kernel: CPU    3: hi:    0, btch:   1 usd:   0
Nov 26 10:05:49 proxmox1 kernel: Node 0 DMA32 per-cpu:
Nov 26 10:05:49 proxmox1 kernel: CPU    0: hi:  186, btch:  31 usd:  31
Nov 26 10:05:49 proxmox1 kernel: CPU    1: hi:  186, btch:  31 usd:  57
Nov 26 10:05:49 proxmox1 kernel: CPU    2: hi:  186, btch:  31 usd: 143
Nov 26 10:05:49 proxmox1 kernel: CPU    3: hi:  186, btch:  31 usd:  46
Nov 26 10:05:49 proxmox1 kernel: Node 0 Normal per-cpu:
Nov 26 10:05:49 proxmox1 kernel: CPU    0: hi:  186, btch:  31 usd: 110
Nov 26 10:05:49 proxmox1 kernel: CPU    1: hi:  186, btch:  31 usd: 158
Nov 26 10:05:49 proxmox1 kernel: CPU    2: hi:  186, btch:  31 usd: 168
Nov 26 10:05:49 proxmox1 kernel: CPU    3: hi:  186, btch:  31 usd: 156
Nov 26 10:05:49 proxmox1 kernel: active_anon:2251109 inactive_anon:341652 isolated_anon:0
Nov 26 10:05:49 proxmox1 kernel: active_file:505099 inactive_file:758761 isolated_file:32
Nov 26 10:05:49 proxmox1 kernel: unevictable:1097 dirty:636904 writeback:1460 unstable:0
Nov 26 10:05:49 proxmox1 kernel: free:20102 slab_reclaimable:48596 slab_unreclaimable:58851
Nov 26 10:05:49 proxmox1 kernel: mapped:2653 shmem:159 pagetables:9092 bounce:0
Nov 26 10:05:49 proxmox1 kernel: Node 0 DMA free:15884kB min:12kB low:12kB high:16kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15672kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Nov 26 10:05:49 proxmox1 kernel: lowmem_reserve[]: 0 3502 16102 16102
Nov 26 10:05:49 proxmox1 kernel: Node 0 DMA32 free:51600kB min:3528kB low:4408kB high:5292kB active_anon:1190288kB inactive_anon:386600kB active_file:581604kB inactive_file:1208972kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3586880kB mlocked:0kB dirty:1096216kB writeback:1980kB mapped:296kB shmem:56kB slab_reclaimable:106588kB slab_unreclaimable:26540kB kernel_stack:192kB pagetables:1528kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:96 all_unreclaimable? no
Nov 26 10:05:49 proxmox1 kernel: lowmem_reserve[]: 0 0 12600 12600
Nov 26 10:05:49 proxmox1 kernel: Node 0 Normal free:12924kB min:12700kB low:15872kB high:19048kB active_anon:7814148kB inactive_anon:980008kB active_file:1438792kB inactive_file:1826072kB unevictable:4388kB isolated(anon):0kB isolated(file):128kB present:12902400kB mlocked:4388kB dirty:1451400kB writeback:3860kB mapped:10316kB shmem:580kB slab_reclaimable:87796kB slab_unreclaimable:208864kB kernel_stack:2032kB pagetables:34840kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Nov 26 10:05:49 proxmox1 kernel: lowmem_reserve[]: 0 0 0 0
Nov 26 10:05:49 proxmox1 kernel: Node 0 DMA: 3*4kB 2*8kB 3*16kB 2*32kB 2*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15884kB
Nov 26 10:05:49 proxmox1 kernel: Node 0 DMA32: 7122*4kB 271*8kB 707*16kB 269*32kB 5*64kB 5*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 51792kB
Nov 26 10:05:49 proxmox1 kernel: Node 0 Normal: 2647*4kB 0*8kB 11*16kB 8*32kB 4*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 13068kB
Nov 26 10:05:49 proxmox1 kernel: 1389170 total pagecache pages
Nov 26 10:05:49 proxmox1 kernel: 124499 pages in swap cache
Nov 26 10:05:49 proxmox1 kernel: Swap cache stats: add 276464, delete 151965, find 7289820/7301378
Nov 26 10:05:49 proxmox1 kernel: Free swap  = 3539812kB
Nov 26 10:05:49 proxmox1 kernel: Total swap = 4194300kB
Nov 26 10:05:49 proxmox1 kernel: 4194288 pages RAM
Nov 26 10:05:49 proxmox1 kernel: 85063 pages reserved
Nov 26 10:05:49 proxmox1 kernel: 1965463 pages shared
Nov 26 10:05:49 proxmox1 kernel: 2724601 pages non-shared
Nov 26 10:06:05 proxmox1 kernel: block drbd0: sock was shut down by peer
Nov 26 10:06:05 proxmox1 kernel: block drbd0: peer( Primary -> Unknown ) conn( Connected -> BrokenPipe ) pdsk( UpToDate -> DUnknown ) 
Nov 26 10:06:05 proxmox1 kernel: block drbd0: Creating new current UUID
Nov 26 10:06:05 proxmox1 kernel: block drbd0: asender terminated
Nov 26 10:06:05 proxmox1 kernel: block drbd0: Terminating drbd0_asender
Nov 26 10:06:05 proxmox1 kernel: block drbd0: Connection closed
Nov 26 10:06:05 proxmox1 kernel: block drbd0: conn( BrokenPipe -> Unconnected ) 
Nov 26 10:06:05 proxmox1 kernel: block drbd0: receiver terminated
Nov 26 10:06:05 proxmox1 kernel: block drbd0: Restarting drbd0_receiver
Nov 26 10:06:05 proxmox1 kernel: block drbd0: receiver (re)started
Nov 26 10:06:05 proxmox1 kernel: block drbd0: conn( Unconnected -> WFConnection ) 
Nov 26 10:06:14 proxmox1 kernel: block drbd0: Handshake successful: Agreed network protocol version 94
Nov 26 10:06:14 proxmox1 kernel: block drbd0: Peer authenticated using 20 bytes of 'sha1' HMAC
Nov 26 10:06:14 proxmox1 kernel: block drbd0: conn( WFConnection -> WFReportParams ) 
Nov 26 10:06:14 proxmox1 kernel: block drbd0: Starting asender thread (from drbd0_receiver [20718])
Nov 26 10:06:14 proxmox1 kernel: block drbd0: data-integrity-alg: <not-used>
Nov 26 10:06:14 proxmox1 kernel: block drbd0: conn( WFReportParams -> NetworkFailure ) 
Nov 26 10:06:14 proxmox1 kernel: block drbd0: asender terminated
Nov 26 10:06:14 proxmox1 kernel: block drbd0: Terminating drbd0_asender
Nov 26 10:06:14 proxmox1 kernel: block drbd0: Connection closed
Nov 26 10:06:14 proxmox1 kernel: block drbd0: conn( NetworkFailure -> Unconnected ) 
Nov 26 10:06:14 proxmox1 kernel: block drbd0: receiver terminated
Nov 26 10:06:14 proxmox1 kernel: block drbd0: Restarting drbd0_receiver
Nov 26 10:06:14 proxmox1 kernel: block drbd0: receiver (re)started
Nov 26 10:06:14 proxmox1 kernel: block drbd0: conn( Unconnected -> WFConnection )

Any hints are welcome!

Udo

Search

Search

DRBD with 2.6.35-6

udo

Distinguished Member

dietmar

Proxmox Staff Member

tom

Proxmox Staff Member

udo

Distinguished Member

udo

Distinguished Member

We value your privacy