Errors from pmgmirror

[janczmok]

After upgrade of the secondary PM node, i now have errors in the journalctl:


Mar 13 11:46:01 mxfilter2 pmgmirror[956]: starting cluster synchronization
Mar 13 11:46:01 mxfilter2 pmgmirror[956]: unable to load rulecache : DBD:g::st execute failed: ERROR: relation "rule_attributes" does not exist
LINE 1: SELECT * FROM Rule_Attributes WHERE Rule_ID = $1 ORDER BY Na...
^ at /usr/share/perl5/PMG/RuleCache.pm line 71.
Mar 13 11:46:01 mxfilter2 pmgmirror[956]: detected rule database changes - starting sync from 'X.X.X.X'
Mar 13 11:46:02 mxfilter2 pmgmirror[956]: database sync 'mxfilter1' failed - unable to fetch column definitions of table 'rule_attributes' : ERROR at /usr/share/perl5/PMG/DBTools.pm line 1083.
Mar 13 11:46:02 mxfilter2 pmgmirror[956]: unable to load rulecache : DBD:g::st execute failed: ERROR: relation "rule_attributes" does not exist
LINE 1: SELECT * FROM Rule_Attributes WHERE Rule_ID = $1 ORDER BY Na...
^ at /usr/share/perl5/PMG/RuleCache.pm line 71.
Mar 13 11:46:03 mxfilter2 pmgmirror[956]: cluster synchronization finished (1 errors, 1.77 seconds (files 0.00, data

besides this error, everything seems to work.
Anybody has a fix?

Master: 7.2.2
Node: 8.1.2 version

I first did:
- install node on new vm
- pmgcm delete <id-oldnode>
- shutdown old vm
- set ip of new vm to old vm
- on new vm - pmgcm join <master_ip>

then everything is working except the error messages above.
is this 7.x <-> 8.1.1 insonsistency, so that i can proceed with promoting the node to master, then delete "old master" and install new VM and do the join.

Please advise

 

[dcsapak]

is this 7.x <-> 8.1.1 insonsistency, so that i can proceed with promoting the node to master, then delete "old master" and install new VM and do the join.

yes this an inconsistency

but if you followed the 7 to 8 upgrade guide: https://pmg.proxmox.com/wiki/index.php/Upgrade_from_7_to_8
the pmgmirror service should have been disabled, so that error should not pop up then

 

[janczmok]

Thanks. However i did not a 7.x to 8 upgrade, i did remove the 7.x node from network and did a reinstall on a new vm with 8.1.1 then rejoined
so does this still apply ?

Would the errors be done when my next steps would be:
- create a new vm to replace mxfilter1
- promote mxfilter2 as the new master
- remove mxfilter1-old from cluster
- give mxfilter1-new the ip of mxfilter-old
- pmgcm join mxfilter2

Thanks again in advance.

 

[dcsapak]

Thanks. However i did not a 7.x to 8 upgrade, i did remove the 7.x node from network and did a reinstall on a new vm with 8.1.1 then rejoined
so does this still apply ?

imho yes, but wouldn't it have been easier to reinstall 2 nodes with 8.1 and then join to a new cluster? instead of joining mixed versions and removing/adding ?

yeah if all nodes in the end are on the same versions, the sync should work again

 

[janczmok]

I agree that the other way would be easier, but mxfilter2 in original state had some dependency issues in the underlying debian. now both systems are based on the never 8.1 version.

 

[janczmok]

btw: mxfilter1 and mxfilter2 are now both updated to latest version.

root@mxfilter2:~# pmgcm status
NAME(CID)--------------IPADDRESS----ROLE-STATE---------UPTIME---LOAD----MEM---DISK
mxfilter1(4) x.x.x.22 node S 00:28 0.04 51% 16%
mxfilter2(3) x.x.x.21 master A 23:51 0.08 51% 17%

However i am still getting:
Mar 14 11:06:42 mxfilter2 pmgpolicy[128592]: unable to load rulecache : DBD:g::st execute failed: ERROR: relation "rule_attributes" does not exist
LINE 1: SELECT * FROM Rule_Attributes WHERE Rule_ID = $1 ORDER BY Na...
^ at /usr/share/perl5/PMG/RuleCache.pm line 71.

and on mxfilter1:
Mar 14 11:09:33 mxfilter1 pmgmirror[700]: starting cluster synchronization
Mar 14 11:09:34 mxfilter1 pmgmirror[700]: detected rule database changes - starting sync from 'x.x.x.21'
Mar 14 11:09:34 mxfilter1 pmgmirror[700]: database sync 'mxfilter2' failed - DBD:g::db do failed: ERROR: relation "rule_attributes" does not exist at /usr/share/perl5/PMG/DBTools.pm line 1085.
Mar 14 11:09:35 mxfilter1 pmgmirror[700]: cluster synchronization finished (1 errors, 1.99 seconds (files 0.00, database 1.37, config 0.62))
Ma
Everything else seems to work fine.
So any thoughts ?

 

[janczmok]

Update: IT seems the whole "Mail Filter" in the gui does not work. How do i get the original attributes back ?
it seems to be some kind of bug if doing it the way i did, however that seemed feasible.

 

[dcsapak]

can you post versions from both hosts please?

pmgversion -v

 

[janczmok]

mxfilter2:
root@mxfilter2:~# pmgversion -v
proxmox-mailgateway: 8.1.0 (API: 8.1.2/c979cfd1d78a, running kernel: 6.5.13-1-pve)
pmg-api: 8.1.2
pmg-gui: 4.1.1
proxmox-kernel-helper: 8.1.0
proxmox-kernel-6.5.13-1-pve-signed: 6.5.13-1
proxmox-kernel-6.5: 6.5.13-1
clamav-daemon: 1.0.3+dfsg-1~deb12u1
ifupdown2: 3.2.0-1+pmx8
libarchive-perl: 3.6.2
libjs-extjs: 7.0.0-4
libjs-framework7: 4.4.7-2
libproxmox-acme-perl: 1.5.0
libproxmox-acme-plugins: 1.5.0
libpve-apiclient-perl: 3.3.0
libpve-common-perl: 8.1.0
libpve-http-server-perl: 5.0.5
libxdgmime-perl: 1.1.0
lvm2: 2.03.16-2
pmg-docs: 8.1.1
pmg-i18n: 3.2.1
pmg-log-tracker: 2.5.0
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.5
proxmox-spamassassin: 4.0.0-5
proxmox-widget-toolkit: 4.1.4
pve-firmware: 3.9-2
pve-xtermjs: 5.3.0-3
zfsutils-linux: 2.2.2-pve2

mxfilter1:
root@mxfilter1:~# pmgversion -v
proxmox-mailgateway: 8.1.0 (API: 8.1.2/c979cfd1d78a, running kernel: 6.5.13-1-pve)
pmg-api: 8.1.2
pmg-gui: 4.1.1
proxmox-kernel-helper: 8.1.0
proxmox-kernel-6.5.13-1-pve-signed: 6.5.13-1
proxmox-kernel-6.5: 6.5.13-1
clamav-daemon: 1.0.3+dfsg-1~deb12u1
ifupdown2: 3.2.0-1+pmx8
libarchive-perl: 3.6.2
libjs-extjs: 7.0.0-4
libjs-framework7: 4.4.7-2
libproxmox-acme-perl: 1.5.0
libproxmox-acme-plugins: 1.5.0
libpve-apiclient-perl: 3.3.0
libpve-common-perl: 8.1.0
libpve-http-server-perl: 5.0.5
libxdgmime-perl: 1.1.0
lvm2: 2.03.16-2
pmg-docs: 8.1.1
pmg-i18n: 3.2.1
pmg-log-tracker: 2.5.0
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.5
proxmox-spamassassin: 4.0.0-5
proxmox-widget-toolkit: 4.1.4
pve-firmware: 3.9-2
pve-xtermjs: 5.3.0-3
zfsutils-linux: 2.2.2-pve2

 

[janczmok]

in the web, i do see the error message: "DBD:g::st execute failed: ERROR: relation "objectgroup_attributes" does not exist (500)"
i checked the postgresql dumps, but cannot find anything obvious.