Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Poll: How big is your training.dat?

28 views
Skip to first unread message

Chris Ilias

unread,
Aug 1, 2006, 8:06:25 PM8/1/06
to
Thunderbird developers are looking into adding code which prunes the
Junk Mail Control training filter when it gets over a certain size; and
need to get an idea of how big the average training file is.

The file is called training.dat, and it resides in your profile folder.
See <http://www.mozilla.org/support/thunderbird/profile>

If you still don't know how to find it, don't worry. :-)
--
Chris Ilias
mozilla.test.multimedia moderator
Mozilla links <http://ilias.ca>
(Please do not email me tech support questions)

clay

unread,
Aug 1, 2006, 8:13:52 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

596 KB

--
100% money back guarantee!
If at any time you are dissatisfied with the performance of your Mozilla
product, feel free to return it for a complete refund of what you paid
for it...

Graham Coward

unread,
Aug 1, 2006, 8:17:08 PM8/1/06
to
On 2/08/2006 10:13 AM, clay wrote:
> Chris Ilias wrote:
>> Thunderbird developers are looking into adding code which prunes the
>> Junk Mail Control training filter when it gets over a certain size; and
>> need to get an idea of how big the average training file is.
>>
>> The file is called training.dat, and it resides in your profile folder.
>> See <http://www.mozilla.org/support/thunderbird/profile>
>>
>> If you still don't know how to find it, don't worry. :-)
>
> 596 KB
>
833 KB

--
Please reply to group or
reply "off-group" by removing the two "z"s from my e-mail address.

Graham Coward
Melbourne, Australia
=====================
Coward Family History Web Site
http://www.alphalink.com.au/~coward/

gwtc

unread,
Aug 1, 2006, 8:24:24 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
in all 30 accounts I have each one is 0 kb!

--
Maxims for the Internet Age: In Gates we trust.

ALan Holley

unread,
Aug 1, 2006, 8:51:03 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
452k

Brian J. Graham

unread,
Aug 1, 2006, 9:18:10 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

2.54MB ...and it works flawlessly. :)

--
Brian

. http://www.mozilla.org | http://ilias.ca/mozilla/ | http://ilias.ca/

. No keyboard found. Press F1 to continue.

. Internet "Help" Desk: http://www.deadtroll.com/video/helldeskcable.html

Large Allen

unread,
Aug 1, 2006, 9:36:39 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

HMMMmmm... no such file.
Could this be why I keep getting lots of junk mail??

Ken Wagner

unread,
Aug 1, 2006, 9:59:29 PM8/1/06
to
Chris Ilias wrote, on 8/1/2006 7:06 PM:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

475K

Paul Nourie

unread,
Aug 1, 2006, 10:09:01 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

76K ... 4 weeks old checking (2) accounts.

Ron K.

unread,
Aug 1, 2006, 10:14:15 PM8/1/06
to
T-bird Leader Chris Ilias radioed the tower On 8/1/2006 8:06 PM:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

8.44 MB since TB had it's first Junk filter.

--
Ron K.
Don't be a fonted, it's just type casting.

Tonya Marshall

unread,
Aug 1, 2006, 10:20:15 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
715kb here.

Skree

unread,
Aug 1, 2006, 10:23:53 PM8/1/06
to
Paul Nourie Spoke Thus and So about This and That:

Apparently I have two profile folders - both named the same but in
different locations.

One is where I moved it two following instructions on the mozilla page
that talks about moving profiles. This one contains all my current mail
and stuff but no training.dat file.

on my C:\ drive under userdocs apps data thunderbird, there exists
another profile folder of the same name in contains different files -
including the training.dat. It is only 5Kb.


--
from the bottom of the Rockpile

Snorkelson MacBurp

unread,
Aug 1, 2006, 11:13:33 PM8/1/06
to
Chris Ilias said the following on 01/08/06 20:06:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

1.9MB

FWIW, JMC it hasn't worked worth a pinch of shit since I upgraded to
1.5. It used to work essentially flawlessly, (well over 99%) but since
the upgrade, it catches maybe 66%. Kind of sucky, to say the least.

PS. Belak will save the Leafs.

The Real Bev

unread,
Aug 1, 2006, 11:20:46 PM8/1/06
to
Chris Ilias wrote:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

2.36 meg.

--
Cheers, Bev (Happy Linux User #85683, Slackware 10.2)
=========================================================
"Life is actually fair. It just doesn't seem to be common
knowledge that 'fair' sometimes sucks." -- Jim Cook

Chuck Anderson

unread,
Aug 1, 2006, 11:33:22 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
>
171k


--
*****************************
Chuck Anderson • Boulder, CO
http://www.CycleTourist.com
*****************************

Mumia W.

unread,
Aug 1, 2006, 10:09:43 PM8/1/06
to
On 08/01/2006 07:06 PM, Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

For TB, which I only used for about one week: 7k.

For SM, which I've used for about a month: 26k.

Basil Chupin

unread,
Aug 1, 2006, 11:38:21 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

3,073,148 bytes big - and growing.

Cheers.

--
This computer is environment-friendly and is running on OpenSuSE 10.1

Moz Champion (Dan)

unread,
Aug 1, 2006, 11:49:23 PM8/1/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

84K with a catch ration of 98.7%
false positives >1% (last month)

You dont need a big training.dat

Bernie

unread,
Aug 2, 2006, 12:42:56 AM8/2/06
to
On 8/1/2006 7:06 PM, Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

7,193KB

tim

unread,
Aug 2, 2006, 1:37:31 AM8/2/06
to
Chris Ilias schrieb am 02.08.2006 02:06:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
44KB

clay

unread,
Aug 2, 2006, 2:01:24 AM8/2/06
to
clay wrote:
> Chris Ilias wrote:
>> Thunderbird developers are looking into adding code which prunes the
>> Junk Mail Control training filter when it gets over a certain size;
>> and need to get an idea of how big the average training file is.
>>
>> The file is called training.dat, and it resides in your profile folder.
>> See <http://www.mozilla.org/support/thunderbird/profile>
>>
>> If you still don't know how to find it, don't worry. :-)
>
> 596 KB
>

can't find it on my Linux box.
12 KB on 2k box (seldom used)
n/a on 2k box (not activated)
760 KB on XPP box

Bob Henson

unread,
Aug 2, 2006, 2:06:46 AM8/2/06
to
Chris Ilias wrote

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

994 Kb


Regards,

Bob


--
Remove "x" from address to reply by email.

Basil Chupin

unread,
Aug 2, 2006, 2:37:44 AM8/2/06
to

In linux it's in your /home/<your-logon-name>/.thunderbird/xxxx.default
directory.

goodwin

unread,
Aug 2, 2006, 2:53:28 AM8/2/06
to
On 8/1/2006 5:06 PM Chris Ilias opined:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

826 mg

goodwin

unread,
Aug 2, 2006, 2:57:28 AM8/2/06
to
On 8/1/2006 11:53 PM goodwin opined:

oops - 826 kb (807 really)

Roland de Ruiter

unread,
Aug 2, 2006, 3:54:42 AM8/2/06
to
On 2-8-2006 2:06, Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
20K
--
Regards,

Roland

Alex

unread,
Aug 2, 2006, 4:46:46 AM8/2/06
to

137 KB

However, I use gmail's junk filter & so actually receive very few junk
mails in TB.

--
Alex

Melchert Fruitema

unread,
Aug 2, 2006, 4:54:34 AM8/2/06
to
On 02-08-2006 02:24 CET, gwtc composed this enchanting statement:

> in all 30 accounts I have each one is 0 kb!
Big spender, hey. ;-)

--
Kind regards,

Melchert

MacOS 10.3.9/Firefox 1.5/Thunderbird 1.5

Melchert Fruitema

unread,
Aug 2, 2006, 5:16:47 AM8/2/06
to
On 02-08-2006 02:06 CET, Chris Ilias composed this enchanting statement:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size;
> and need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
At the moment 692 KB, created in October 2004, last modified August 1, 2006.

Mnenhy Junk Filter Statistics indicates that the filter was trained by
761 messages, of which 15% were non-junk. (Note that block lists are
used by ISP to filter spam in my main account mail box.)

I understand pruning to mean trimming. Do you know if the development is
also aimed at cleaning the training data from attempts of contamination
by spammers ? There were javascripts around to accomplish that in the
past. Will have to dig to find them.

Herb

unread,
Aug 2, 2006, 5:36:50 AM8/2/06
to
On 02.08.2006 01:06 UK Time, Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

1.4 MB

--
Herbert Eppel
www.HETranslation.co.uk

NA

unread,
Aug 2, 2006, 6:27:16 AM8/2/06
to
Chris Ilias <n...@ilias.ca> wrote on Tuesday, August 01, 2006 8:06:25 PM EDT:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

231 KB

Peter

unread,
Aug 2, 2006, 6:32:29 AM8/2/06
to
NA skrev:

2472 KB

David Pyles

unread,
Aug 2, 2006, 8:36:28 AM8/2/06
to
On 8/1/2006 8:06 PM, Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
10.67 megs. It's been growing since the first public Thunderbird release.
Dave Pyles

J.B. Nicholson-Owens

unread,
Aug 2, 2006, 8:42:04 AM8/2/06
to
Basil Chupin wrote:
> In linux it's in your /home/<your-logon-name>/.thunderbird/xxxx.default
> directory.

On Ubuntu GNU/Linux (perhaps any Debian GNU/Linux derivative?) the Thunderbird
directory is in ~/.mozilla-thunderbird.

Mine is 6.6MB right now.

RAV

unread,
Aug 2, 2006, 10:10:21 AM8/2/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

7,634 bytes in my office installation, where I almost never use it for
E-mail and almost always for newsgroups. Will have to check at my home
installation where I use it for E-mail. p

rohrmann

unread,
Aug 2, 2006, 11:30:35 AM8/2/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

259 KB

John McWilliams

unread,
Aug 2, 2006, 11:42:01 AM8/2/06
to
24 Kb

But, how the heck does it work? Heres a few lines from mine.

they

Tim Bushell

unread,
Aug 2, 2006, 11:52:21 AM8/2/06
to

Mine ranks in at 84 KB. Although, I have to admit that I just recently
started using the Junk Mail controls more in Thunderbird.

Jan Steffen

unread,
Aug 2, 2006, 11:53:39 AM8/2/06
to
Chris Ilias schrieb:

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.

556 KB now and 404 KB in an 3 month old backup I found.
I use the junk filter with 3 mail accounts and it works very good.

HTH, Jan

Ulrich Boche

unread,
Aug 2, 2006, 4:28:35 PM8/2/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size;
> and need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
580 KB
--
Ulrich

Ulrich Boche

unread,
Aug 2, 2006, 4:42:19 PM8/2/06
to
Large Allen wrote:
> HMMMmmm... no such file.
> Could this be why I keep getting lots of junk mail??
Probably. Look at "Tools -> Junk Mail Controls", select the tab
"Adaptive Filter" and put a check mark in the box "Enable adaptive junk
mail detection".

This won't relieve you of all junk mail right away. You need to train
the adaptive filter by marking all junk mail that gets into your inbox
as Junk. Over time, the filter will get better and more of the unwanted
junk will land in the Junk folder right away.
--
Ulrich

The Real Bev

unread,
Aug 2, 2006, 8:16:25 PM8/2/06
to
Moz Champion (Dan) wrote:

Why would we want to delete one and start over? Is there any point in
trying to control its size? Why? I would guess that its size is
dependent on how long it's been running and how much spam you get. Mine
has been running since I started using firefox (maybe a year) and I get
something like 300 pieces of junk in 4 accounts every day, the bulk of
it in one account that I'm thinking of killing.

--
Cheers, Bev (Happy Linux User #85683, Slackware 10.2)
===================================================================
Teamwork: A bunch of people running around doing what I tell them.

Moz Champion (Dan)

unread,
Aug 3, 2006, 5:52:51 AM8/3/06
to
The Real Bev wrote:
> Moz Champion (Dan) wrote:
>
>> Chris Ilias wrote:
>>> Thunderbird developers are looking into adding code which prunes the
>>> Junk Mail Control training filter when it gets over a certain size;
>>> and need to get an idea of how big the average training file is.
>>>
>>> The file is called training.dat, and it resides in your profile folder.
>>> See <http://www.mozilla.org/support/thunderbird/profile>
>>>
>>> If you still don't know how to find it, don't worry. :-)
>>
>> 84K with a catch ration of 98.7%
>> false positives >1% (last month)
>>
>> You dont need a big training.dat
>
> Why would we want to delete one and start over? Is there any point in
> trying to control its size? Why? I would guess that its size is
> dependent on how long it's been running and how much spam you get. Mine
> has been running since I started using firefox (maybe a year) and I get
> something like 300 pieces of junk in 4 accounts every day, the bulk of
> it in one account that I'm thinking of killing.
>


Did I say that? No, I didnt. I simply said you dont need a big
training.dat for JMC to be successful.
If you start having problems perhaps you might consider starting over,
but if JMC is working fine, why bother? My experience is that JMC takes
but a couple of weeks to get up to speed anyway

Arne Hamre

unread,
Aug 3, 2006, 12:34:00 PM8/3/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
Mine is 456 kb, but then I use Mailwasher before I will let any spam
come close to my inbox.
--
Arne

The Real Bev

unread,
Aug 3, 2006, 2:43:26 PM8/3/06
to
Moz Champion (Dan) wrote:

> The Real Bev wrote:
>> Moz Champion (Dan) wrote:
>>> You dont need a big training.dat
>>
>> Why would we want to delete one and start over? Is there any point in
>> trying to control its size? Why? I would guess that its size is
>> dependent on how long it's been running and how much spam you get. Mine
>> has been running since I started using firefox (maybe a year) and I get
>> something like 300 pieces of junk in 4 accounts every day, the bulk of
>> it in one account that I'm thinking of killing.
>
> Did I say that? No, I didnt. I simply said you dont need a big
> training.dat for JMC to be successful.

To me, that implied that we have some control over the size and that
there was no point in having a large one. Never mind.

> If you start having problems perhaps you might consider starting over,
> but if JMC is working fine, why bother? My experience is that JMC takes
> but a couple of weeks to get up to speed anyway

--

Cheers, Bev (Happy Linux User #85683, Slackware 10.2)

---------------------------------------
That's my opinion. Ought to be yours.

clay

unread,
Aug 5, 2006, 5:32:36 PM8/5/06
to

so it is...
wonder why gnome-search-tool didn't find it (but locate did?)
I ran updatedb before searching.
60 KB

clay

unread,
Aug 5, 2006, 5:36:04 PM8/5/06
to

indeed it is. I found it anyway. thanks

Alain

unread,
Aug 8, 2006, 5:18:49 PM8/8/06
to
Arne Hamre nous apporta ses lumieres en ce 03/08/2006 12:34:
718 K
I receive a prety large variety of SPAM, in at least 4 languages beside English
and French. (Rusian, Greek/Cyrilic, Japanese/Chinese, German,...)

Alain

Anne Hollingshead

unread,
Aug 8, 2006, 9:56:22 PM8/8/06
to Mozilla Thunderbird end-user help
Mine is 1782 KB do I need to do soething about this ??

Anne

Alain wrote:

> _______________________________________________
> support-thunderbird mailing list
> support-t...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/support-thunderbird
>
>

Moz Champion (Dan)

unread,
Aug 8, 2006, 11:14:31 PM8/8/06
to

Please bottom-post in these newsgroups if you will, that is, quote
previous messages (or portions thereof) then write your reply, such as I
have done, thank you for your consideration in this matter
http://www.mozilla.org/community/etiquette.html refers

No, you dont have to do anything unless you are experiencing problems
with Junk Mail Controls
There are other here with training.dat files in the megabyte range

Anne Hollingshead

unread,
Aug 9, 2006, 1:11:30 AM8/9/06
to Mozilla Thunderbird end-user help
Thanks

Anne

Ron Hunter

unread,
Aug 9, 2006, 4:16:53 AM8/9/06
to

Wow, mine is only 577k! But then I filter most spam before TB ever sees it.

Moz Champion (Dan)

unread,
Aug 9, 2006, 5:12:14 AM8/9/06
to

Only 124K here, still catching 99.8 percent of spam, and I dont filter

gwtc

unread,
Aug 9, 2006, 11:42:27 AM8/9/06
to
Moz Champion (Dan) wrote:

> Only 124K here, still catching 99.8 percent of spam, and I dont filter

sure you do. You're using the jmc aren't you? Well, thats a filter.

--
EVERYTHING HAS A GENDER

You may not know this but many nonliving things have a gender...

Ziploc Bags are Male, because they hold everything in, but you can see
right through them.

Moz Champion (Dan)

unread,
Aug 9, 2006, 3:54:38 PM8/9/06
to
gwtc wrote:
> Moz Champion (Dan) wrote:
>
>> Only 124K here, still catching 99.8 percent of spam, and I dont filter
> sure you do. You're using the jmc aren't you? Well, thats a filter.
>


The "I dont filter' was with regard to the previous post
which said

"Wow, mine is only 577k! But then I filter most spam before TB ever
sees it."

So my 'I dont filter' comment was obviously intended as I dont filter
spam before TB sees it.

Taken in context, it makes sense.

Ron Hunter

unread,
Aug 9, 2006, 4:09:26 PM8/9/06
to
gwtc wrote:
> Moz Champion (Dan) wrote:
>
>> Only 124K here, still catching 99.8 percent of spam, and I dont filter
> sure you do. You're using the jmc aren't you? Well, thats a filter.
>

He only gets 'generic' junk. Keeps the junk definition file small. Grin.

Moz Champion (Dan)

unread,
Aug 9, 2006, 4:55:30 PM8/9/06
to

And JMC is catching 98% and better of it!

Atari

unread,
Aug 9, 2006, 5:32:11 PM8/9/06
to

joe...@gmail.com

unread,
Aug 10, 2006, 7:52:05 PM8/10/06
to
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
> --
> Chris Ilias
> mozilla.test.multimedia moderator
> Mozilla links <http://ilias.ca>
> (Please do not email me tech support questions)

1.4 megs. I trained it on an account that had been mostly collecting
spam before my school implemented effective junk mail controls.
Unfortunately, it seems spam content has shifted a bit since then, and
so TB as a second-layer defense isn't quite as good.

--Joel

Wilf

unread,
Aug 11, 2006, 2:48:45 AM8/11/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)
I don't know why it is, but I just find the TB junk mail filter to be
pretty ineffectual for some reason - I've used it for a long time yet it
still comes up with many false negatives (fewer false positives). I use
K9 which is a Bayesian filter and it is brilliant, hardly ever coming up
with a false positive or negative. I know that TB is supposed to work
in more or less the same way as K9 does so why it is ineffective for me
when K9 is good I have never been able to figure out.

Anyway, FWIW, my training.dat, just before I turned off TB's spam
filter, was 3921KB

--
Wilf

Moz Champion (Dan)

unread,
Aug 11, 2006, 2:57:25 AM8/11/06
to


Well, my JMC is catching over 98% of spam sent my way, and previous
incarnations of JMC were quite similar in their catch ratios as well. My
training.dat is now 128K (thats up from 84K on the first of August)

All I do is mark those that are Junk as Junk and unmark those that are
caught but arent of course.

JMC should do as well as your K9

Wilf

unread,
Aug 11, 2006, 3:00:30 AM8/11/06
to
Yes, I know, but for some reason it just doesn't :-(

--
Wilf

Wilf

unread,
Aug 11, 2006, 3:30:02 AM8/11/06
to
Example right now. I re-downloaded 1000 emails which my Yahoo account
had held back as Spam (and all *are* spam). K9 detected all but 2. JMC
detected all but 31. You can still argue that JMC has detected almost
97% which looks pretty good. But K9 has detected 99.8%.

--
Wilf

Phil Randal

unread,
Aug 11, 2006, 3:34:38 AM8/11/06
to
Wilf wrote:
> Moz Champion (Dan) wrote:

>> JMC should do as well as your K9
>>
> Yes, I know, but for some reason it just doesn't :-(

I'll second that.

About half the jumk mail goes straight into my inbox, even though I
rigorously train.

My traning.dat is now 9MB.

Phil

Moz Champion (Dan)

unread,
Aug 11, 2006, 3:43:41 AM8/11/06
to

Perceptions are always difficult. I base my percentages on actual
receipts - comparing how many are actually caught by JMC and how many
are missed. Is your assessment of JMC's performance based on perception
or hard data?

If based on hard data, then I would suggest that perhaps it time to
ditch your training.dat file (which is THIRTY times the size of mine)
and start anew. While this may result in a 65% catch ration temporarily
(JMC starts out at about a 65% ratio 'out of the box' for me), this
should improve rapidly to 95 percent or better with two to three weeks.

Once more, all I do is mark those that are Junk as Junk, and unmark any
JMC catches that are not. I recommend keeping a 'holding' folder (Junk
will do just fine for that), so you can monitor your catch ratio, as
well as watch for false positives.

I use the Personal Address Book exemption rule (if sender is in my
Personal Address Book JMC wont check the message)

Moz Champion (Dan)

unread,
Aug 11, 2006, 8:11:27 AM8/11/06
to

You are complaining about a 97% catch rate?

Moz Champion (Dan)

unread,
Aug 11, 2006, 8:13:19 AM8/11/06
to


Well, his catch rate is 97%, so I really dont know what he is
complaining about. If yours is 50%, and your training.dat is 9mb, then I
suggest you are a prime candidate to throw it out and start over again.
What do you have to lose except your spam?

Wilf

unread,
Aug 11, 2006, 8:14:04 AM8/11/06
to

Well, maybe I'll give that a go, but it's still the case that K9 traps
nearly 100% and JMC about 97%. There aren't many false negatives,
though, so the PAB rule is unlikely to help much if at all.
--
Wilf

Moz Champion (Dan)

unread,
Aug 11, 2006, 9:28:54 AM8/11/06
to

You are complaining about a 97% catch ratio?
The difference between k9 and JMC is 1.3 percent! Statiscally speaking
thats a normal varience and can be expected between even instances of K9
to K9 or JMC to JMC.

Wilf

unread,
Aug 11, 2006, 9:48:42 AM8/11/06
to
Moz Champion (Dan) wrote:

>
> You are complaining about a 97% catch ratio?
> The difference between k9 and JMC is 1.3 percent! Statiscally speaking
> thats a normal varience and can be expected between even instances of K9
> to K9 or JMC to JMC.

No, all I'm saying is why settle for what JMC can do when K9 can do
better? And it's almost 3% - 96.9% and 99.8%. In any case my question
was why, if JMC and K9 do more or less the same thing, does K9 appear to
be better. And however often I compare these facilities, K9 *always*
seems to come out better. And in 1000 spam emails, 30 false negatives
seems a lot even if it is only 3%. If I were asked by someone which
facility to choose which should I say? Only, the TB junk mail filter
is easier to set up initially admittedly because K9 requires a manual
configuration to its pop3 proxy. Also, K9 can't handle SSL pop3 emails
so if you use gmail, TB would be more useful.
--
Wilf

Moz Champion (Dan)

unread,
Aug 11, 2006, 9:56:20 AM8/11/06
to

Even a 3% variance is within the norms. Even k9 to k9 could show that
difference and more. And with spam samples it could mean one message not
caught.

I am still amazed that you complain about a 97% catch ratio.

Wilf

unread,
Aug 11, 2006, 10:01:34 AM8/11/06
to
I'm not complaining. 97% is pretty good. I'm looking for someone to
tell me why I should change over from a facility that's currently giving
me 99.8 percent, though.

--
Wilf

Moz Champion (Dan)

unread,
Aug 11, 2006, 10:59:57 AM8/11/06
to


No one said you should. But remember, next year, you may find the
percentages reversed - doesnt mean one is better than the other, just
that for that particular sample, one performed marginally better. Since
you seem to prefer K9, perhaps you are more consistent with its training
than you are with JMC training. Your difference in the two could be a
difference of two spams - you trained K9 with them, but didnt in JMC?
A variance of 3 % is not statiscally important enough to claim any
distinct difference in the two products. Your version of K9 might be
better 'trained' than someone elses version of K9 and show the same
variance as you show with JMC. Variances of up to 5 to 8% are possible
even between versions of JMC - it all depends on the training.

And as this poll would tend to show (imho) size of training.dat doesnt
necessarily indicate performance

Regardless, no one said you have to stick with JMC if K9 is working as
well (or better) - but even you yourself said JMC is easier to set up.

Wilf

unread,
Aug 11, 2006, 11:18:54 AM8/11/06
to
Well, I have now reset training.dat and am starting again although still
running K9 as well. I flag those messages which K9 thinks are spam but
let JMC decide what it thinks is spam so that I can compare the two
visually. We shall see.

--
Wilf

gwtc

unread,
Aug 11, 2006, 12:42:43 PM8/11/06
to
no, he's complaining about 2.8%

--
EVERYTHING HAS A GENDER

You may not know this but many nonliving things have a gender...

A Tire is Male, because it goes bald and it's often over-inflated.

Thanos

unread,
Aug 11, 2006, 1:27:50 PM8/11/06
to
Chris Ilias wrote:

> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>

People in this thread mention that the JMC catch ratio is 97%, 96.7% or
whatever. How do you determine the catch ratio?

By the way... my training.dat is 29 KB. :-)

gwtc

unread,
Aug 11, 2006, 1:41:46 PM8/11/06
to
they take the equation, multiply it by the thing-ma-bobber, subtract
it from the jigger, then divide by the do-hicky, and add on a few
yoctoseconds and you get your answer.

sorry, I couldn't resist.

Thanos

unread,
Aug 11, 2006, 1:49:51 PM8/11/06
to
gwtc wrote:

> Thanos wrote:
>> People in this thread mention that the JMC catch ratio is 97%, 96.7% or
>> whatever. How do you determine the catch ratio?
>>
>> By the way... my training.dat is 29 KB. :-)
> they take the equation, multiply it by the thing-ma-bobber, subtract
> it from the jigger, then divide by the do-hicky, and add on a few
> yoctoseconds and you get your answer.
>
> sorry, I couldn't resist.

Probably i'm missing something really obvious...

gwtc

unread,
Aug 11, 2006, 2:03:37 PM8/11/06
to
yes, it is. You take the number of messages that were not caught as
spam [lets say 30], divide that by the total number of messages
received [lets say 1,000], then multiply by 100

SO: 30/1000 = 0.03 x 100 = 3%

or take the total number of caught messages 970/1000 x 100 = 97%
success rate.

Thanos

unread,
Aug 11, 2006, 2:18:59 PM8/11/06
to
gwtc wrote:
> Thanos wrote:
>> gwtc wrote:
>>> Thanos wrote:
>>>> People in this thread mention that the JMC catch ratio is 97%, 96.7%
>>>> or whatever. How do you determine the catch ratio?
>>>>
>>>> By the way... my training.dat is 29 KB. :-)
>>> they take the equation, multiply it by the thing-ma-bobber, subtract
>>> it from the jigger, then divide by the do-hicky, and add on a few
>>> yoctoseconds and you get your answer.
>>>
>>> sorry, I couldn't resist.
>> Probably i'm missing something really obvious...
> yes, it is. You take the number of messages that were not caught as
> spam [lets say 30], divide that by the total number of messages
> received [lets say 1,000], then multiply by 100
>
> SO: 30/1000 = 0.03 x 100 = 3%
>
> or take the total number of caught messages 970/1000 x 100 = 97%
> success rate.

All right gwtc! Now i see your point! I certainly don't count the total
messages nor the junk mails I received since starting using JMC. I
thought that somehow JMC had a way of calculating the catch ratio and i
was actually asking how to tell JMC to display these values.

gwtc

unread,
Aug 11, 2006, 3:46:39 PM8/11/06
to
it doesn't

Bob Williams

unread,
Aug 11, 2006, 4:54:46 PM8/11/06
to
ALan Holley wrote:
> Chris Ilias wrote:
>> Thunderbird developers are looking into adding code which prunes the
>> Junk Mail Control training filter when it gets over a certain size;
>> and need to get an idea of how big the average training file is.
>>
>> The file is called training.dat, and it resides in your profile folder.
>> See <http://www.mozilla.org/support/thunderbird/profile>
>>
>> If you still don't know how to find it, don't worry. :-)
> 452k
110.1kb

--
Bob

Ekko Dieleman

unread,
Aug 11, 2006, 5:00:00 PM8/11/06
to
Wilf wrote:

I use K9 also and my overall accuracy is only 91 % over 100 days (33 mails
a day). Am I doing something wrong or is it just bad luck ?

Ekko
--

The Real Bev

unread,
Aug 11, 2006, 11:27:17 PM8/11/06
to
Phil Randal wrote:

I get ~350 spam/day, of which perhaps 30-50 get past JMC into my inbox.
I mark every single one as spam. My training.dat is 2.5 meg and is
perhaps a year old. I see the same messages (something about Viktoria
comes to mind...) over and over again and can only get rid of them by
adding another entry to my 'spam' filter for that account.

Would I benefit from starting over?

--
Cheers, Bev (Happy Linux User #85683, Slackware 10.2)
--------------------------------------------------------------
"Never keep up with the Joneses. Drag them down to your level.
It's cheaper." -- Quentin Crisp 1908 - 1999

gwtc

unread,
Aug 11, 2006, 11:36:06 PM8/11/06
to
The Real Bev wrote:
> Phil Randal wrote:
>
>> Wilf wrote:
>>> Moz Champion (Dan) wrote:
>>
>>>> JMC should do as well as your K9
>>>>
>>> Yes, I know, but for some reason it just doesn't :-(
>>
>> I'll second that.
>>
>> About half the jumk mail goes straight into my inbox, even though I
>> rigorously train.
>>
>> My traning.dat is now 9MB.
>
> I get ~350 spam/day, of which perhaps 30-50 get past JMC into my inbox.
> I mark every single one as spam. My training.dat is 2.5 meg and is
> perhaps a year old. I see the same messages (something about Viktoria
> comes to mind...) over and over again and can only get rid of them by
> adding another entry to my 'spam' filter for that account.
>
> Would I benefit from starting over?
>
why don't you create a Message Filter instead?

Jay Garcia

unread,
Aug 11, 2006, 11:44:33 PM8/11/06
to
On 11.08.2006 22:27, The Real Bev wrote:

--- Original Message ---

> Phil Randal wrote:
>
>> Wilf wrote:
>>> Moz Champion (Dan) wrote:
>>
>>>> JMC should do as well as your K9
>>>>
>>> Yes, I know, but for some reason it just doesn't :-(
>>
>> I'll second that.
>>
>> About half the jumk mail goes straight into my inbox, even though I
>> rigorously train.
>>
>> My traning.dat is now 9MB.
>
> I get ~350 spam/day, of which perhaps 30-50 get past JMC into my inbox.
> I mark every single one as spam. My training.dat is 2.5 meg and is
> perhaps a year old. I see the same messages (something about Viktoria
> comes to mind...) over and over again and can only get rid of them by
> adding another entry to my 'spam' filter for that account.
>
> Would I benefit from starting over?
>

Sounds like you need to interest your ISP to install SpamAssassin and
configure RBL's for incoming mail. My mail server rejects over 8,000 per
day for a little over 100 customers.

--
Jay Garcia Netscape/Mozilla Champion
UFAQ - http://www.UFAQ.org

Wilf

unread,
Aug 12, 2006, 3:12:00 AM8/12/06
to
It must be just like suggested elsewhere - depends on the installation.
I have always been "lucky" with K9, I guess.

--
Wilf

Ekko Dieleman

unread,
Aug 12, 2006, 11:35:09 AM8/12/06
to
Wilf wrote:

OK. So bad luck after all. For the record: I use TB 1.5.0.5 on XP Home
SP2. My training.dat is 1433 KB. My provider also has a spam filter in
place so I don't get that much spam. The last time I looked in my spam
mailbox it catched 100 spam messages a day. K9 catches 5 spam mails per
day on average. JMC catches 1 spam mail per day on average.

Ekko
--

Moz Champion (Dan)

unread,
Aug 12, 2006, 2:02:08 PM8/12/06
to

You dont have to count the total messsages since you started using JMC.
Simply decide on a 'time frame' to use. I suggest a week. Compare the
number of spam messages receieved in the week, to the number caught by JMC.
You can do it on a daily basis, but those results can vary dramatically
day by day, a weekly period averages things out a little

The Real Bev

unread,
Aug 12, 2006, 3:24:25 PM8/12/06
to
Jay Garcia wrote:

This is from my myrealbox.com account, which I used to post for a long
time and which is just a sort of testbed for Novell and we're lucky we
can set up filters at the website. My gmail accounts are relatively
spam-free thanks to google's tender ministrations, and the
really-private account on my son's server gets NO spam.

I retrained the filter right after I posted this last night. For some
reason spammers seem to take the weekend off ("Hey, we got families
too!"), but the percentage of spam making it into the inbox seems to
have dropped considerably. We'll see...

I'd already created a 60-entry spam filter which sees whatever hasn't
been previously siphoned off.

--
Cheers, Bev (Happy Linux User #85683, Slackware 10.2)

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
As the shopper placed her groceries on the checkout stand, the
bagger asked "Paper or plastic?" "Doesn't matter," she replied,
"I'm bisackual."

Thanos

unread,
Aug 12, 2006, 4:43:39 PM8/12/06
to

As you say, it won't be 100% accurate result, since the results may vary
even between weeks.

Anyway, as i mentioned i thought that JMC did that calculation and i was
asking how to dig those results. I never intended to count the junk
messages! Thanks anyway...

RAV

unread,
Aug 12, 2006, 4:43:18 PM8/12/06
to
Chris Ilias wrote:
> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size; and
> need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)

1.6 megs on my home PC where I use it for E-mail (is 7,634 bytes on my
office PC, where I almost never use it for E-mail and almost always for
newsgroups).

Pete Holsberg

unread,
Aug 13, 2006, 1:16:39 PM8/13/06
to Mozilla Thunderbird end-user help
RAV wrote:

6,134,756 bytes

--
Pete Holsberg
Columbus, NJ

To be able under all circumstances to practice five things
constitutes perfect virtue; these five things are gravity,
generosity of soul, sincerity, earnestness and kindness....
--Confucius

squaredancer

unread,
Aug 13, 2006, 3:11:08 PM8/13/06
to
On 02.08.2006 02:06 am, CET - what odd quirk of fate caused Chris Ilias
to generate the following:? :

> Thunderbird developers are looking into adding code which prunes the
> Junk Mail Control training filter when it gets over a certain size;
> and need to get an idea of how big the average training file is.
>
> The file is called training.dat, and it resides in your profile folder.
> See <http://www.mozilla.org/support/thunderbird/profile>
>
> If you still don't know how to find it, don't worry. :-)


just run out of bandwidth on this (useless??) thread....

reg

0 new messages