Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

additional log tracking - patch request

2 views
Skip to first unread message

kirk

unread,
May 22, 2011, 1:12:53 PM5/22/11
to
hello all, i've made this request before, a few years back, and of
course i haven't been able to find the simple patch. i'm not a real
programmer, i only deal with simple perl scripts, otherwise i'd just do
it myself, my apologies.
i need the ability, within the qmail log files, to track emails that are
sent out in batch. we have outbound email going to subscribed customers
every day (not a huge number, mostly under a few thousand a day, and we
add an "X-MailerID" to the header for tracking. we'd like to be able to
see how the email performs on a per X-MailerID via the standard log
file. we have qmailanalog and qms-analog tools as well as many custom
scripts parsing and monitoring the log files. so we just need qmail to
recognize the additional header field and inject it into the log files
so we can properly group the performance of each outbound batch mailers.
has anyone done this before and willing to share the patch? not sure if
this has been asked before (other than myself sometime ago), and i don't
recall nor have i found anything in the configurations to enable logging
in this fashion.
thanks in advance, and i appreciate any help.

kirk

--
Posted automagically by a mail2news gateway at muc.de e.V.
Please direct questions, flames, donations, etc. to news-...@muc.de

kirk

unread,
May 22, 2011, 2:00:13 PM5/22/11
to
hi Erwin,
someone wrote this patch before, i tried desperately to find the
original thread, as i dont think the i can do a full match on all the
log files required to display all the statistics without some code
tweaking. i believe the original patch added the X-MailingID in ALL the
log entries, which is i think the issue. that way the matchup and
associated qms tools were then capable of grouping the additional field.
i apologize if this isn't the case, i'll spend a little more time with
the matchup tool and qms-alalog scripts and look closer at the sender
info. but at first blush, i dont think it will work.

i wish i had done a better job of maintaining our code repository, my
bad. just trying to recover now.

thx for the quick response, i appreciate the help.
kirk

On 5/22/2011 10:44 AM, Erwin Hoffmann wrote:
> Hi Kirk
>
> in short, I'm not aware of any tool satisfying your needs.


>
> On Sun, 22 May 2011 10:12:53 -0700
> kirk<ki...@icapsolutions.com> wrote:
>
>> hello all, i've made this request before, a few years back, and of
>> course i haven't been able to find the simple patch. i'm not a real
>> programmer, i only deal with simple perl scripts, otherwise i'd just do
>> it myself, my apologies.
>> i need the ability, within the qmail log files, to track emails that are
>> sent out in batch. we have outbound email going to subscribed customers
>> every day (not a huge number, mostly under a few thousand a day, and we
>> add an "X-MailerID" to the header for tracking. we'd like to be able to
>> see how the email performs on a per X-MailerID via the standard log
>> file.

> I don't think it will work that way. Qmail separates the SMTP envelope from the body. The logs use just the envelope information.


>
>> we have qmailanalog and qms-analog tools as well as many custom
>> scripts parsing and monitoring the log files. so we just need qmail to
>> recognize the additional header field and inject it into the log files
>> so we can properly group the performance of each outbound batch mailers.
>> has anyone done this before and willing to share the patch? not sure if
>> this has been asked before (other than myself sometime ago), and i don't
>> recall nor have i found anything in the configurations to enable logging
>> in this fashion.

> Is it feasable to do the analysis on a per-sender SMTP envelope address ?
> If you use a per-compaign return-address, you can handle this.
> Since you already have added the "X-MailerID", you probably can control the return-address as well.
>
> regards.
> --eh.

Manvendra Bhangui

unread,
May 22, 2011, 2:02:48 PM5/22/11
to

On Sun, May 22, 2011 at 10:42 PM, kirk <ki...@icapsolutions.com> wrote:
hello all, i've made this request before, a few years back, and of course i haven't been able to find the simple patch.  i'm not a real programmer, i only deal with simple perl scripts, otherwise i'd just do it myself, my apologies.
i need the ability, within the qmail log files, to track emails that are sent out in batch.  we have outbound email going to subscribed customers every day (not a huge number, mostly under a few thousand a day, and we add an "X-MailerID" to the header for tracking.  we'd like to be able to see how the email performs on a per X-MailerID via the standard log file.  we have qmailanalog and qms-analog tools as well as many custom scripts parsing and monitoring the log files.  so we just need qmail to recognize the additional header field and inject it into the log files so we can properly group the performance of each outbound batch mailers.
has anyone done this before and willing to share the patch?  not sure if this has been asked before (other than myself sometime ago), and i don't recall nor have i found anything in the configurations to enable logging in this fashion.
thanks in advance, and i appreciate any help.


Russ Nelson had written a patch which I find very useful for putting my own custom headers. The qmail queue extra header (qqeh) patch


Not sure if this helps but you might need to make changes to spawn.c to complete the changes. I had completed the changes and made it part of my own version of qmail which I use it for indimail. The patch which includes qqeh can be downloaded below


e.g. If you set the environment variable QQEH="X-Campaign-ID: 1000\n", all emails will have an header X-CampaignID with the value 1000

Erwin Hoffmann

unread,
May 22, 2011, 1:44:18 PM5/22/11
to
Hi Kirk

in short, I'm not aware of any tool satisfying your needs.

On Sun, 22 May 2011 10:12:53 -0700
kirk <ki...@icapsolutions.com> wrote:

> hello all, i've made this request before, a few years back, and of
> course i haven't been able to find the simple patch. i'm not a real
> programmer, i only deal with simple perl scripts, otherwise i'd just do
> it myself, my apologies.

> i need the ability, within the qmail log files, to track emails that are
> sent out in batch. we have outbound email going to subscribed customers
> every day (not a huge number, mostly under a few thousand a day, and we
> add an "X-MailerID" to the header for tracking. we'd like to be able to
> see how the email performs on a per X-MailerID via the standard log
> file.

I don't think it will work that way. Qmail separates the SMTP envelope from the body. The logs use just the envelope information.

> we have qmailanalog and qms-analog tools as well as many custom

> scripts parsing and monitoring the log files. so we just need qmail to
> recognize the additional header field and inject it into the log files
> so we can properly group the performance of each outbound batch mailers.
> has anyone done this before and willing to share the patch? not sure if
> this has been asked before (other than myself sometime ago), and i don't
> recall nor have i found anything in the configurations to enable logging
> in this fashion.

Is it feasable to do the analysis on a per-sender SMTP envelope address ?


If you use a per-compaign return-address, you can handle this.
Since you already have added the "X-MailerID", you probably can control the return-address as well.

regards.
--eh.


> thanks in advance, and i appreciate any help.
>
> kirk
>
>
>


--
Dr. Erwin Hoffmann | FEHCom | http://www.fehcom.de

Erwin Hoffmann

unread,
May 22, 2011, 2:48:54 PM5/22/11
to
Hi,

I checked my qmail archive (since 1998) and found this one:

----

Mailing-List: contact qmail...@list.cr.yp.to; run by ezmlm
Precedence: bulk
Delivered-To: mailing list qm...@list.cr.yp.to
Received: (qmail 9885 invoked from network); 15 Aug 2006 19:49:50 -0000
Received: from bay0-omc1-s24.bay0.hotmail.com (65.54.246.96)
by stoneport.math.uic.edu with SMTP; 15 Aug 2006 19:49:50 -0000
Received: from hotmail.com ([65.54.175.43]) by bay0-omc1-s24.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.1830);
Tue, 15 Aug 2006 12:48:54 -0700
Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC;
Tue, 15 Aug 2006 12:48:53 -0700
Message-ID: <BAY104-F33A2FD6ED...@phx.gbl>
Received: from 65.54.175.200 by by104fd.bay104.hotmail.msn.com with HTTP;
Tue, 15 Aug 2006 19:48:51 GMT
X-Originating-IP: [71.254.156.3]
X-Originating-Email: [trin...@hotmail.com]
X-Sender: trin...@hotmail.com
From: "Derek Trindel" <trin...@hotmail.com>
To: qm...@list.cr.yp.to
Bcc:
Subject: using qmailanalog
Date: Tue, 15 Aug 2006 12:48:51 -0700
Mime-Version: 1.0
Content-Type: text/plain; format=flowed
X-OriginalArrivalTime: 15 Aug 2006 19:48:53.0812 (UTC) FILETIME=[D688A740:01C6C0A3]

i have a mail system that sends mailers about 2 - 3 times per week to approx
5K users using qmail. i also loaded qmailanalog and am trying to create
reports based on an idividual and unique "mailingid". we have a perl
program that gathers the data and sends the mailings via qmail-inject so we
can adjust just about any header atttribute or anything for that matter.

im looking for some way to produce reports based on the batch mailingid and
haven't found any filters or switches using "matchup" or anything within the
qmailanalog build that can produce reports based on a mailingid or similar.

has anyone used qmailanalog in a similar manner or perhaps have some tweak
to grab a header attribute and have qmailanaolg tools include this in it's
output?

thx
t

----

On Sun, 22 May 2011 11:00:13 -0700
kirk <ki...@icapsolutions.com> wrote:

> hi Erwin,
> someone wrote this patch before, i tried desperately to find the
> original thread, as i dont think the i can do a full match on all the
> log files required to display all the statistics without some code
> tweaking. i believe the original patch added the X-MailingID in ALL the
> log entries, which is i think the issue. that way the matchup and
> associated qms tools were then capable of grouping the additional field.
> i apologize if this isn't the case, i'll spend a little more time with
> the matchup tool and qms-alalog scripts and look closer at the sender
> info. but at first blush, i dont think it will work.

The only who answered was me ;-)

Have a look at my 'Newanalyse' tool. It does some reporting out-of-the-box.
But again: The email body (+header) is not visible in any system I know.


regards.
--eh.


>
> i wish i had done a better job of maintaining our code repository, my
> bad. just trying to recover now.
>
> thx for the quick response, i appreciate the help.
> kirk
>
>
>
> On 5/22/2011 10:44 AM, Erwin Hoffmann wrote:
> > Hi Kirk
> >
> > in short, I'm not aware of any tool satisfying your needs.
> >
> > On Sun, 22 May 2011 10:12:53 -0700
> > kirk<ki...@icapsolutions.com> wrote:
> >

> >> hello all, i've made this request before, a few years back, and of
> >> course i haven't been able to find the simple patch. i'm not a real
> >> programmer, i only deal with simple perl scripts, otherwise i'd just do
> >> it myself, my apologies.
> >> i need the ability, within the qmail log files, to track emails that are
> >> sent out in batch. we have outbound email going to subscribed customers
> >> every day (not a huge number, mostly under a few thousand a day, and we
> >> add an "X-MailerID" to the header for tracking. we'd like to be able to
> >> see how the email performs on a per X-MailerID via the standard log
> >> file.

> > I don't think it will work that way. Qmail separates the SMTP envelope from the body. The logs use just the envelope information.
> >

> >> we have qmailanalog and qms-analog tools as well as many custom
> >> scripts parsing and monitoring the log files. so we just need qmail to
> >> recognize the additional header field and inject it into the log files
> >> so we can properly group the performance of each outbound batch mailers.
> >> has anyone done this before and willing to share the patch? not sure if
> >> this has been asked before (other than myself sometime ago), and i don't
> >> recall nor have i found anything in the configurations to enable logging
> >> in this fashion.

> > Is it feasable to do the analysis on a per-sender SMTP envelope address ?
> > If you use a per-compaign return-address, you can handle this.
> > Since you already have added the "X-MailerID", you probably can control the return-address as well.
> >
> > regards.
> > --eh.
> >
> >

> >> thanks in advance, and i appreciate any help.
> >>
> >> kirk
> >>
> >>
> >>
> >
>
>


--

Dr. Erwin Hoffmann | FEHCom | http://www.fehcom.de

--

0 new messages