Customize Tracking Center

[koby]

Hello All ,
Is there any option to add more field to the Tracking Center - like Subject ?
Is there any option to set the default search to 00:00 of the current date ?

Thank you all for any answer
Koby Peleg Hen

 

[Stoiko Ivanov]

Hello All ,
Is there any option to add more field to the Tracking Center - like Subject ?

No - the Tracking Center parses the mail.logs to display the information and those don't contain the subjects.

Is there any option to set the default search to 00:00 of the current date ?

This is currently not possible since PMG does not store such information per client - and the benefit does seem comparatively small

I hope this helps!

 

[heutger]

No - the Tracking Center parses the mail.logs to display the information and those don't contain the subjects.

How about my feature request to add subject information (as been able to be added to the mail.log by adjusting postfix a bit). Same for the envelope from (instead of the technical from) for e.g. newsletters or mails originating from ESP like Amazon SES, Sendgrid and others.

 

[Stoiko Ivanov]

How about my feature request to add subject information (as been able to be added to the mail.log by adjusting postfix a bit)

As said before - subjects are seldomly needed for debugging mail-flow but do contain rather sensitive information which I really would not log for privacy reasons.

Same for the envelope from (instead of the technical from)

for me the envelope from is the from used during the SMTP session (MAIL FROM command) - instead of the From Header.

 

[heutger]

As said before - subjects are seldomly needed for debugging mail-flow but do contain rather sensitive information which I really would not log for privacy reasons.

for me the envelope from is the from used during the SMTP session (MAIL FROM command) - instead of the From Header.

OK, then I mean the Header From. And for sure, subject logging could be an option to be enabled or not. For sure, there are privacy reasons, however, if looking at other stages e.g. secure mail gateways or mail archiving solutions, an administrator would also be able to get access to such information. For checking and adjusting the filter, it's somehow required information, so if it's optional to activate, it's on administrators choice to do so or not. However, I have it enabled on my own private installation, which I'm the only one using it, but I also need to look into the details and would be much easier to have a subject column.

 

[moihuguesjoyal]

You could add into the postfix log the subject using this technique.

Open and edit postfix configuration file

vi /etc/postfix/main.cf

Add the following :

header_checks = regexp:/etc/postfix/header_checks

Open the file /etc/postfix/header_checks

vi /etc/postfix/header_checks

Add the following line :

/^Subject:/     WARN

Run postmap to apply new config

postmap /etc/postfix/header_checks

Restart postfix service

service postfix restart

Now in the tracking center you will see something like this :

 

[tinhnd]

You could add into the postfix log the subject using this technique.

Open and edit postfix configuration file

vi /etc/postfix/main.cf

Add the following :

header_checks = regexp:/etc/postfix/header_checks

Open the file /etc/postfix/header_checks

vi /etc/postfix/header_checks

Add the following line :

/^Subject:/     WARN

Run postmap to apply new config

postmap /etc/postfix/header_checks

Restart postfix service

service postfix restart

Now in the tracking center you will see something like this :
View attachment 38021

Thanks for your help. I'm following your sugguestion and it shown the header Subject, but it was encrypted. like this:
Jun 16 11:28:15 esg02 postfix/cleanup[12749]: 0F87110043C: warning: header Subject: =?UTF-8?B?UmU6IFThuqFpIHNhbyBraMO0bmcgZ+G7rWkgdGjGsCB04bubaSBHbWFpbCDEkcaw4bujYw==?=??=?UTF-8?B?Pw==?= from mail-io1-f51.google.com[209.85.166.51]; from=<user@xxx.com> to=<user@abc.com> proto=ESMTP helo=<mail-io1-f51.google.com>
Please help

 

[moihuguesjoyal]

Thanks for your help. I'm following your sugguestion and it shown the header Subject, but it was encrypted. like this:
Jun 16 11:28:15 esg02 postfix/cleanup[12749]: 0F87110043C: warning: header Subject: =?UTF-8?B?UmU6IFThuqFpIHNhbyBraMO0bmcgZ+G7rWkgdGjGsCB04bubaSBHbWFpbCDEkcaw4bujYw==?=??=?UTF-8?B?Pw==?= from mail-io1-f51.google.com[209.85.166.51]; from=<tinhnd04@gmail.com> to=<tinhnd@emailgateway.online> proto=ESMTP helo=<mail-io1-f51.google.com>
Please help

I'm not sure how we can log decoded mime subject, you could use tools like online MIME headers decoder :

https://dogmamix.com/MimeHeadersDecoder/

Or you can create a script :

#!/usr/bin/env perl
use open qw(:std :utf8);
use Encode qw(decode);

while (my $line = <STDIN>) {
        print decode("MIME-Header", $line);
}

And execute like :

echo 'Subject: =?UTF-8?B?UmU6IFThuqFpIHNhbyBraMO0bmcgZ+G7rWkgdGjGsCB04bubaSBHbWFpbCDEkcaw4bujYw==?=??=?UTF-8?B?Pw==?= ' | ./decodeutf8.pl

 

[tinhnd]

I'm not sure how we can log decoded mime subject, you could use tools like online MIME headers decoder :

https://dogmamix.com/MimeHeadersDecoder/

Or you can create a script :

#!/usr/bin/env perl
use open qw(:std :utf8);
use Encode qw(decode);

while (my $line = <STDIN>) {
        print decode("MIME-Header", $line);
}

And execute like :

echo 'Subject: =?UTF-8?B?UmU6IFThuqFpIHNhbyBraMO0bmcgZ+G7rWkgdGjGsCB04bubaSBHbWFpbCDEkcaw4bujYw==?=??=?UTF-8?B?Pw==?= ' | ./decodeutf8.pl

Thanks for you help, so much. I've give it a try.

 

[spamcopbr]

In version 7.1-3 it doesn't work.
Any tips?

 

[hoanv9]

To capture the email subject, you can do
1. Edit /usr/bin/pmg-smtp-filter
2. Add to second line

use PVE::Tools;

3. Find

$self->log (3, "$queue->{logid}: new mail message-id=%s", $queue->{msgid});

Add bellow

$self->log (3, "$queue->{logid}: Subject: %s", PMG::Utils::decode_rfc1522(PVE::Tools::trim($entity->head->get('subject'))) || 'No Subject');
my @fromarray = split('\s*,\s*', $entity->head->get('from') || $msginfo->{sender});
$self->log (3, "$queue->{logid}: From: %s", PMG::Utils::decode_rfc1522(PVE::Tools::trim($fromarray[0])) );

4. Restart pmg-smtp-filter

 

[spamcopbr]

To capture the email subject, you can do
1. Edit /usr/bin/pmg-smtp-filter
2. Add to second line

use PVE::Tools;

3. Find

$self->log (3, "$queue->{logid}: new mail message-id=%s", $queue->{msgid});

Add bellow

$self->log (3, "$queue->{logid}: Subject: %s", PMG::Utils::decode_rfc1522(PVE::Tools::trim($entity->head->get('subject'))) || 'No Subject');
my @fromarray = split('\s*,\s*', $entity->head->get('from') || $msginfo->{sender});
$self->log (3, "$queue->{logid}: From: %s", PMG::Utils::decode_rfc1522(PVE::Tools::trim($fromarray[0])) );

4. Restart pmg-smtp-filter

Thanks man !

Would it be possible for attachments too? It is very useful to be able to search by .zip extension, etc.

This feature had in another antispam..

 

[hoanv9]

Thanks man !

Would it be possible for attachments too? It is very useful to be able to search by .zip extension, etc.

This feature had in another antispam..

No we can not

 

[Robbus]

Thanks hoanv9! That worked for me, too, adding subject line to be searchable via the "Filter" field.

 

[andreasallee3]

Now since version 7.3-3 it is not working anymore

Any help?

 

[heutger]

Now since version 7.3-3 it is not working anymore

Any help?

As of my last very time consuming thread on optimizing PMG I started a new philosophie with a fresh installation with somehow only adjustments via GUI or shell, which don’t change/touch the system itself, as all such changes like here break any time. So if you’re (also) looking for such feature (I also as well like to see the given from as the envelope often is just a technical sender for bounce handling, especially at service providers for mail like mailchimp, amazonses etc.) vote up for e.g. my feature request on adding this feature to the product itself, may be optional to activate or not, but may be added to the product, so adjustments won’t break. I also had another way to ads subjects and given senders, however, it’s an adjustment which always requires to confirm new configuration files on PMG updates and don’t want to use that anymore.

 

[vigggen]

As of my last very time consuming thread on optimizing PMG I started a new philosophie with a fresh installation with somehow only adjustments via GUI or shell, which don’t change/touch the system itself, as all such changes like here break any time. So if you’re (also) looking for such feature (I also as well like to see the given from as the envelope often is just a technical sender for bounce handling, especially at service providers for mail like mailchimp, amazonses etc.) vote up for e.g. my feature request on adding this feature to the product itself, may be optional to activate or not, but may be added to the product, so adjustments won’t break. I also had another way to ads subjects and given senders, however, it’s an adjustment which always requires to confirm new configuration files on PMG updates and don’t want to use that anymore.

Do you have a link for where I can "vote" up the feature request ? I do think the subject feature is really important it take less time trouble shooting with the end user.

 

[heutger]

Do you have a link for where I can "vote" up the feature request ? I do think the subject feature is really important it take less time trouble shooting with the end user.

I saw, you found it?

 

[Neobin]

For reference:
https://bugzilla.proxmox.com/show_bug.cgi?id=3543

 

[vigggen]

Yeps I got it