no data in database (Tracking center and Statistics)

[DerDanilo]

Clean setup systems, 2 node cluster, latest 'no-subscription' updates, cluster status "active"/"active", config seems to sync fine, Dashboard shows same data on both nodes.

Nodes are currently only used to receive mails and forward them to the mailserver after cleaning.

Overall the system seems to work fine. But why doesn't the database contain any tracking data? About XXX+ mails went through the system and still nothing in the database.
The Statistics "Spam Scores", "Hourly Dist.", "Postscreen", "Domain" overview shows something. "Sender", "Receiver" and "Contact" show "no data in database". How can that be?

How can one reset the database so the systems starts with a clean, new database to be build on?

Thanks!

 

[tom]

Clean setup systems, 2 node cluster, latest 'no-subscription' updates, cluster status "active"/"active", config seems to sync fine, Dashboard shows same data on both nodes.

Nodes are currently only used to receive mails and forward them to the mailserver after cleaning.

Overall the system seems to work fine. But why doesn't the database contain any tracking data? About XXX+ mails went through the system and still nothing in the database.
The Statistics "Spam Scores", "Hourly Dist.", "Postscreen", "Domain" overview shows something. "Sender", "Receiver" and "Contact" show "no data in database". How can that be?

Seems you do not use the Mail Gateway for outgoing messages?

How can one reset the database so the systems starts with a clean, new database to be build on?

Thanks!

You can reset the rules configuration, but I assume you want more? Then I suggest a new installation.

 

[DerDanilo]

Seems you do not use the Mail Gateway for outgoing messages?

Currently we are not using it for outgoing messages that is correct. But shouldn't there be tracking data for incoming traffic anyways?
The dashboard shows "Top Receivers", so there is some data somewhere.

It would be really nice to be able to actually track emails that are coming in. This is possible in other mailgateway solutions.

You can reset the rules configuration, but I assume you want more? Then I suggest a new installation.

I just want to reset the database if this does any good. If there is no DB problem this doesn't make sense to me.

 

[tom]

Currently we are not using it for outgoing messages that is correct. But shouldn't there be tracking data for incoming traffic anyways?
The dashboard shows "Top Receivers", so there is some data somewhere.

Maybe deactivation of "Advanced Statitics" can help, see "Configuration/Options: Use advanced statistic filters"

I just want to reset the database if this does any good. If there is no DB problem this doesn't make sense to me.

Which "Database" do you want to reset, and what do you mean with a "reset"? Any why?

 

[DerDanilo]

Maybe deactivation of "Advanced Statitics" can help, see "Configuration/Options: Use advanced statistic filters"

Did that, is a reboot required for this to be applied correctly?

EDIT: Deactivation of this option now at least brought "Receiver (incoming)" to show up.

 

[DerDanilo]

Is there a way to show the headers of emails that were received/sent? They may contain useful information about the reason for blocks and where spam mails do originate from.

Thanks

 

[ChFin]

Is there a way to show the headers of emails that were received/sent? They may contain useful information about the reason for blocks and where spam mails do originate from.

Thanks

Tracking Center: Check Out the Spam Assassin "hits" / reject reason / ...

 

[dietmar]

If you move mails to quarantine, you can view the whole header and raw email data.

 

[ChFin]

But only view your own quarantine or make sure that you have the permission to view emails of other people in quarantine. Maybe one of your clients is really interested in viagra, p... extension or similar stuff Also think of false positives.

 

[dietmar]

What exactly is the suggestion? If you are concerned about privacy you may not access the headers as well.

 

[DerDanilo]

I want to be able to check whatever header I need to check. Even from emails that went through fine.

Only beeing able to see headers of emails that were blocked or sent to quarantine is a limitation.
If the mail admin needs to check mailheaders for any reason he has to go into the mail server and check there.

The tracking center should give the possibility to also search for successfully delivered mails and check their headers. At least for a specified number of days into the past.
This helps to identify spamers that go through filtering or origins of mails to check if there is a gap in the ruleset.
I can think of a few other scenarios.

Mailcleaner.org has a nice way of showing this. I will post a screenshot later.

Privacy is not my concern right now. I am the postmaster / provider so I need to be able to check mail headers if required. I don't care about the content of mails though, that is a totally different story.

 

[ChFin]

Create a notification rule - send the metadata u need to a dedicated mailaddress.

 

[Davide Bozzelli]

Just in "theme"
How much time does the info in the track center holds ?
In other terms how much back in time can I go ?

 

[ChFin]

7 days

 

[Davide Bozzelli]

7 days

Is it fixed ? can't be changed ?

 

[DerDanilo]

Create a notification rule - send the metadata u need to a dedicated mailaddress.

I don't want all mails to be sent somewhere. This would be overhead. The tracking center should just give access to all mail tracking within the specified range.

 

[Davide Bozzelli]

I don't want all mails to be sent somewhere. This would be overhead. The tracking center should just give access to all mail tracking within the specified range.

What you are requesting is to log ALL metadata (eg: headers) of mails that coming tru pmg .
This will give a HUGE overhead to the system because each messages has to be parsed ad its data stored somewhere (eg: postgres ? fs ?).
One thing that i'm agree is to provide more useful detail on the reason why a message is blocked in tracking center (simply: rule name as additional column)

 

[DerDanilo]

I am receiving a "connection error" whenever I try to search something in the tracking center. No matter the daterange that I select. According to the Spam charts there are several hundread spam mails.

Please note that I only send mails that hit 10 to quarantine. All spam mails up to 9 are just marked with a custom header so the target mail server can identify and sort those mails into the spam folder. X-Spam or (Spam-X) level is not enough since users usually don't really see the headers and will click anyways on the spam mails. \o/

 

[tom]

I am receiving a "connection error" whenever I try to search something in the tracking center. No matter the daterange that I select. According to the Spam charts there are several hundread spam mails.

connection errors are pointing to a browser plugin (ublock).

 

[DerDanilo]

Mailcleaner.org has a nice way of showing this. I will post a screenshot later.

What you are requesting is to log ALL metadata (eg: headers) of mails that coming tru pmg .
This will give a HUGE overhead to the system because each messages has to be parsed ad its data stored somewhere (eg: postgres ? fs ?).
One thing that i'm agree is to provide more useful detail on the reason why a message is blocked in tracking center (simply: rule name as additional column)

I don't really think that this is an issue if we are just speaking about headers. PMG offers cluster capabilities and I don't see why this should be a problem. Others can and do it why can't PMG?