need to add custom header parameter/value to postfix logging.

Guidarini, Robert

unread,

Aug 12, 2009, 9:10:00 AM8/12/09

to

--_000_9E21DB8A5EE791489819E235DB949C0E61846FFF5EUSMAILusnptvg_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I was hoping someone would have experience in what I need to do. Our server=
s send emails to our postfix servers and include a custom header that the v=
alue is referenced in one of our databases. This concerns outgoing email on=
ly.

Example of custom header inserted into the emails:
X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg

I need to get the postfix servers to add that custom header info into the p=
ostfix log when an email is sent.

What I would like to see in the logs is something like (dream scenario):

Aug 11 16:35:37 MTA9 postfix/cleanup[1123]: E472A137E2: message-id=3D<20090=
811213537....@MTA9.somedomain.net>
Aug 11 16:35:37 MTA9 postfix/qmgr[3885]: E472A137E2: from=3D<noreply@somedo=
main.net>, size=3D3034, nrcpt=3D1 (queue active), X-Info-MessageID: l6oL1rH=
PRUyklkQzdkW3kg

Is this functionality possible and if so, how?

Robert

--_000_9E21DB8A5EE791489819E235DB949C0E61846FFF5EUSMAILusnptvg_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<o:p> </o:p>

I was hoping someone would have experience in what I n=
eed to
do. Our servers send emails to our postfix servers and include a custom hea=
der
that the value is referenced in one of our databases. This concerns outgoin=
g
email only.  <o:p></o:p>

<o:p> </o:p>

Example of custom header inserted into the emails:<o:p=
></o:p>

X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg<o:p></o:p></p=
>

<o:p> </o:p>

I need to get the postfix servers to add that custom h=
eader
info into the postfix log when an email is sent. <o:p></o:p>

<o:p> </o:p>

What I would like to see in the logs is something like
(dream scenario):<o:p></o:p>

<o:p> </o:p>

Aug 11 16:35:37 MTA9 postfix/cleanup[1123]: E472A137E2=
:
message-id=3D<200908112135...@MTA9.somedomain.net><o:p></o:=
p>

Aug 11 16:35:37 MTA9 postfix/qmgr[3885]: E472A137E2:
from=3D<nor...@somedomain.net>, size=3D3034, nrcpt=3D1 (queue active=
),
X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg<o:p></o:p>

<o:p> </o:p>

Is this functionality possible and if so, how? <o:p></=
o:p>

<o:p> </o:p>

Robert <o:p></o:p></spa=
n>

<o:p> </o:p>

</div>

</body>

</html>

--_000_9E21DB8A5EE791489819E235DB949C0E61846FFF5EUSMAILusnptvg_--

Justin Piszcz

unread,

Aug 12, 2009, 9:20:39 AM8/12/09

to

Hi,

You want: PREPEND

http://www.postfix.org/header_checks.5.html

PREPEND text...
Prepend one line with the specified text, and
inspect the next input line.

Notes:

o The prepended text is output on a separate
line, immediately before the input that
triggered the PREPEND action.

o The prepended text is not considered part of
the input stream: it is not subject to
header/body checks or address rewriting, and
it does not affect the way that Postfix adds
missing message headers.

o When prepending text before a message header
line, the prepended text must begin with a
valid message header label.

o This action cannot be used to prepend multi-
line text.

This feature is available in Postfix 2.1 and later.

On Wed, 12 Aug 2009, Guidarini, Robert wrote:

>
> I was hoping someone would have experience in what I need to do. Our servers send emails to our postfix servers and include a custom header that the value is referenced in one of our databases. This concerns outgoing email only.

>
> Example of custom header inserted into the emails:
> X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg
>

> I need to get the postfix servers to add that custom header info into the postfix log when an email is sent.

>
> What I would like to see in the logs is something like (dream scenario):
>

> Aug 11 16:35:37 MTA9 postfix/cleanup[1123]: E472A137E2: message-id=<200908112135...@MTA9.somedomain.net>
> Aug 11 16:35:37 MTA9 postfix/qmgr[3885]: E472A137E2: from=<nor...@somedomain.net>, size=3034, nrcpt=1 (queue active), X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg

Thomas Gelf

unread,

Aug 12, 2009, 10:40:30 AM8/12/09

to

Thomas Gelf schrieb:
> If I didn't missunderstand him he already has those X-Info-MessageID
> headers in his mail headers, what he wants is Postfix to do is writing
> them to syslog.

That's what happens if you're at phone while writing :-/
It should read: "...already has those X-Info-MessageID headers in his
mail, what he wants Postfix to do is..."

Sorry.

> While this would probably be pretty easy with Amavis, I have no idea if
> and how he could do so using Postfix only.
>
> Best regards,
> Thomas Gelf

Wietse Venema

unread,

Aug 12, 2009, 10:43:15 AM8/12/09

to

Justin Piszcz:

> Hi,
>
> You want: PREPEND
>
> http://www.postfix.org/header_checks.5.html

Please note that you don't have to use regexp tables for this.
It should be possible to do header PREPEND actions from MySQL etc.
too, as long as you can formulate the right query.

Wietse

Thomas Gelf

unread,

Aug 12, 2009, 11:01:08 AM8/12/09

to

Wietse Venema wrote:
> Justin Piszcz:
>> You want: PREPEND

>
> Please note that you don't have to use regexp tables for this.
> It should be possible to do header PREPEND actions from MySQL etc.
> too, as long as you can formulate the right query.

>>> What I would like to see in the logs is something like (dream scenario):

>>> Aug 11 16:35:37 MTA9 postfix/qmgr[3885]: E472A137E2: from=<nor...@somedomain.net>, size=3034, nrcpt=1 (queue active), X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg

If I didn't missunderstand him he already has those X-Info-MessageID

headers in his mail headers, what he wants is Postfix to do is writing
them to syslog.

While this would probably be pretty easy with Amavis, I have no idea if

Noel Jones

unread,

Aug 12, 2009, 11:44:04 AM8/12/09

to

Thomas Gelf wrote:
> Thomas Gelf schrieb:

>> If I didn't missunderstand him he already has those X-Info-MessageID
>> headers in his mail headers, what he wants is Postfix to do is writing
>> them to syslog.
>

> That's what happens if you're at phone while writing :-/
> It should read: "...already has those X-Info-MessageID headers in his
> mail, what he wants Postfix to do is..."
>

To log an existing header, use the header_checks WARN action.
http://www.postfix.org/header_checks.5.html

The log entry would look something like:
Aug 12 10:29:59 mgate2 postfix/cleanup[29258]: 7C773797ADF:
warning: header X-Info-Messageid: l6oL1rHPRUyklkQzdkW3kg from
client.example.com[192.168.1.123]; from=<us...@example.com>
to=<reci...@example.org> proto=ESMTP helo=<[192.168.1.123]>

-- Noel Jones

Thomas Gelf

unread,

Aug 12, 2009, 11:54:48 AM8/12/09

to

Noel Jones wrote:
> To log an existing header, use the header_checks WARN action.
> http://www.postfix.org/header_checks.5.html

Thank you!

> The log entry would look something like:
> Aug 12 10:29:59 mgate2 postfix/cleanup[29258]: 7C773797ADF: warning:
> header X-Info-Messageid: l6oL1rHPRUyklkQzdkW3kg from
> client.example.com[192.168.1.123]; from=<us...@example.com>
> to=<reci...@example.org> proto=ESMTP helo=<[192.168.1.123]>

Does it automagically log the whole matching header? Or do I need to
add some backreference to "WARN optional text..."?

Regards,
Thomas

Guidarini, Robert

unread,

Aug 12, 2009, 12:10:02 PM8/12/09

to

Our application already inserts the custom header into the email. If we can=
get postfix to log the custom private ID, then the goal is to schedule ano=
ther application once a day to grab the archived mail log and parse the inf=
ormation out so we can match up our private msg ID with postfix's msg ID.=20

Thomas, you are correct: If I didn't misunderstand him he already has those=
X-Info-MessageID headers in his mail headers, what he wants is Postfix to =

do is writing them to syslog.

I'll try the WARN action and see if I can get it to work. Thanks for everyo=
ne's input.=20

Robert=20

-----Original Message-----
From: owner-pos...@postfix.org [mailto:owner-postfix-users@postfix.o=
rg] On Behalf Of Thomas Gelf
Sent: Wednesday, August 12, 2009 10:54 AM
To: postfi...@postfix.org
Subject: Re: need to add custom header parameter/value to postfix logging.

Noel Jones wrote:
> To log an existing header, use the header_checks WARN action.
> http://www.postfix.org/header_checks.5.html

Thank you!

> The log entry would look something like:
> Aug 12 10:29:59 mgate2 postfix/cleanup[29258]: 7C773797ADF: warning:
> header X-Info-Messageid: l6oL1rHPRUyklkQzdkW3kg from

> client.example.com[192.168.1.123]; from=3D<us...@example.com>
> to=3D<reci...@example.org> proto=3DESMTP helo=3D<[192.168.1.123]>

Noel Jones

unread,

Aug 12, 2009, 12:14:35 PM8/12/09

to

Thomas Gelf wrote:
> Noel Jones wrote:
>> To log an existing header, use the header_checks WARN action.
>> http://www.postfix.org/header_checks.5.html
>
> Thank you!
>
>> The log entry would look something like:
>> Aug 12 10:29:59 mgate2 postfix/cleanup[29258]: 7C773797ADF: warning:
>> header X-Info-Messageid: l6oL1rHPRUyklkQzdkW3kg from

>> client.example.com[192.168.1.123]; from=<us...@example.com>
>> to=<reci...@example.org> proto=ESMTP helo=<[192.168.1.123]>

>
> Does it automagically log the whole matching header? Or do I need to
> add some backreference to "WARN optional text..."?
>
> Regards,
> Thomas
>

The entire header (up to a sanity limit) is logged; no further
action is necessary.

-- Noel Jones

Thomas Gelf

unread,

Aug 12, 2009, 12:25:26 PM8/12/09

to

Noel Jones wrote:
> The entire header (up to a sanity limit) is logged; no further action is
> necessary.

Great, thanks again!

Bastian Blank

unread,

Aug 12, 2009, 12:32:23 PM8/12/09

to

On Wed, Aug 12, 2009 at 08:09:32AM -0500, Guidarini, Robert wrote:
> Example of custom header inserted into the emails:
> X-Info-MessageID: l6oL1rHPRUyklkQzdkW3kg

Why don't you add this to the message-id, which is mandatory and
already logged?

Bastian

--
He's dead, Jim.
-- McCoy, "The Devil in the Dark", stardate 3196.1