Mark for retrieval not retrieving messages
Ted Schuerzinger
?-2999 Newsgroups {kooks}
I know the rule is working because
<slrngj64n...@pjr.motzarella.org> ended up in the list of killed
articles. I clicked on it, and selected "Mark for retrieval", and it
disappeared from the list. However, pulling the server again isn't
fetching the article.
I know the article is still on the server (reader.motzarella.org),
because when I pulled the group directly (ie. not through Hamster), the
article was fetched. And I don't have any score rule in my newsreaders
that would result in the article being killed by the newsreader (as
opposed to Hamster).
Any idea what might be going on?
--
Ted S.
fedya at hughes dot net
Now blogging at http://justacineast.blogspot.com
Wolfgang Jäth
>
> ?-2999 Newsgroups {kooks}
>
> I know the rule is working because
> <slrngj64n...@pjr.motzarella.org> ended up in the list of killed
> articles. I clicked on it, and selected "Mark for retrieval", and it
> disappeared from the list.
That means only, that it was copied into the getmids.txt files.
>However, pulling the server again isn't
> fetching the article.
If the requested article is availeable, it will sorted into the newsgroups
according to the Newsgroups: header. If your Hamster doesn't have any of
them, it will be inserted into internal.misc (or whaterver you selected for
articles with unknown groups).
What does that header say, and where did you look for it?
> I know the article is still on the server (reader.motzarella.org),
> because when I pulled the group directly (ie. not through Hamster), the
> article was fetched. And I don't have any score rule in my newsreaders
> that would result in the article being killed by the newsreader (as
> opposed to Hamster).
>
> Any idea what might be going on?
Maybe you've looked for it in the wrong group (or on the wrong server?);
maybe it has been loaded earlier, but is expired meanwhile; maybe ...
What does
| ham.exe locate "<slrngj64n...@pjr.motzarella.org>"
on the command line respond?
Wolfgang
--
Ted Schuerzinger
> "Ted Schuerzinger" <fe...@hughes.spam> schrieb ...
>>
>> ?-2999 Newsgroups {kooks}
>>
>> I know the rule is working because
>> <slrngj64n...@pjr.motzarella.org> ended up in the list of
>> killed articles. I clicked on it, and selected "Mark for
>> retrieval", and it disappeared from the list.
>
> That means only, that it was copied into the getmids.txt files.
>
>> However, pulling the server again isn't fetching the article.
>
> If the requested article is availeable, it will sorted into the
> newsgroups according to the Newsgroups: header. If your Hamster
> doesn't have any of them, it will be inserted into internal.misc (or
> whaterver you selected for articles with unknown groups).
>
> What does that header say, and where did you look for it?
<snip>
Path:
reader.motzarella.org!news.motzarella.org!motzarella.org!news.motzarella.org!not-for-mail
From: Peter J Ross <p...@example.invalid>
Newsgroups: news.software.readers,alt.usenet.kooks
Subject: [OT][AC] Alan/Sid accuses me of sending him kiddy porn! (was:
[leafnode] Ghost Article in
Out.going)
Date: Sun, 30 Nov 2008 22:25:50 +0000
Organization: none
Lines: 138
Message-ID: <slrngj64n...@pjr.motzarella.org>
References: <mej406x...@amma.net>
<slrngj03lp.9...@ID-107770.user.individual.net>
<k86606x...@amma.net>
<slrngj102b.9...@ID-107770.user.individual.net>
<slrngj142...@pjr.motzarella.org> <4a5706x...@amma.net>
<2s5706x...@amma.net> <p07706x...@amma.net>
<ti9706x...@amma.net>
Reply-To: Peter J Ross <peadar...@gmail.com>
Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
X-Trace: news.motzarella.org
U2FsdGVkX198ksqCzgtxg1vWu23o9DVtrGWyaF8r/QnCtqZz9IJ5b6tl+aiIZZzHNtBuoIdSIau16twr8T3+rLkiAZEaq1EoEkly8nB/7dvPYtAjsxe28rDFxxUnZQhlX4C5WhHdmJs=
X-Complaints-To: Please send complaints to ab...@motzarella.org with
full headers
NNTP-Posting-Date: Sun, 30 Nov 2008 22:33:03 +0000 (UTC)
X-Auth-Sender: U2FsdGVkX18hWFzn1CCb7atEOUnF+zTh
Cancel-Lock: sha1:qEQ6IdKqCOSLKLy/xWJoP05eXmI=
User-Agent: slrn/pre1.0.0-2/mm/co/un (Debian Testing)
Xref: reader.motzarella.org
news.software.readers:39973 alt.usenet.kooks:509556
</snip>
(note that none of those lines wraps in the acual headers)
I subscribe to news.software.readers, but when I pull that, the article
doesn't show up.
>> I know the article is still on the server (reader.motzarella.org),
>> because when I pulled the group directly (ie. not through Hamster),
>> the article was fetched. And I don't have any score rule in my
>> newsreaders that would result in the article being killed by the
>> newsreader (as opposed to Hamster).
>>
>> Any idea what might be going on?
>
> Maybe you've looked for it in the wrong group (or on the wrong
> server?); maybe it has been loaded earlier, but is expired meanwhile;
> maybe ...
No, it's not expired; if I try to open the server manually, the article
is there.
> What does
>
>| ham.exe locate "<slrngj64n...@pjr.motzarella.org>"
>
> on the command line respond?
'ham.exe' is not recognized as an internal or external command,
operable program or batch file.
Wolfgang Jäth
>
>>> because when I pulled the group directly (ie. not through Hamster),
>>> the article was fetched. And I don't have any score rule in my
>>> newsreaders that would result in the article being killed by the
>>> newsreader (as opposed to Hamster).
>>>
>>> Any idea what might be going on?
>>
>> Maybe you've looked for it in the wrong group (or on the wrong
>> server?); maybe it has been loaded earlier, but is expired meanwhile;
>> maybe ...
>
> No, it's not expired; if I try to open the server manually, the article
> is there.
In this case I meant within Hamster. But it's dated from the day before
yesterday, so it's quite implausible though.
>> What does
>>
>>| ham.exe locate "<slrngj64n...@pjr.motzarella.org>"
>>
>> on the command line respond?
>
> 'ham.exe' is not recognized as an internal or external command,
> operable program or batch file.
It should have been delivered with hamster.exe; look at your hamster
directory, or into the zip file.
Wolfgang
--
Ted Schuerzinger
Sorry for the late reply, but I'm still having problems. Retrieving
articles still isn't working. The first M-ID below received a score of
-1, when I tried to retrieve it, it never showed up, and I got the first
message. The second half of the message is from an article that got
through without triggering any score rules. Both articles are from the
past 24 hours.
<snip>
C:\unzipped\Hamster.2.1.0.11>ham.exe locate
"<4a9fl4dblaa8q2nee...@4ax.com>"
ERROR: Message-ID "<4a9fl4dblaa8q2nee...@4ax.com>" not
found.
C:\unzipped\Hamster.2.1.0.11>ham.exe locate
"<dc2e0d82-fb4d-4e40...@40g2000prx.googlegroups.com>"
rec.sport.tennis:56846:<dc2e0d82-fb4d-4e40...@40g2000prx.googlegr
oups.com>
</snip>
Wolfgang Jäth
>
> articles still isn't working. The first M-ID below received a score of
> -1, when I tried to retrieve it,
Then, at least one filter rule did match, but not that one you mentioned in
your OP. Any score value below 0 will cause hamster to throw that article
into the killfile (see Configuration => Killfile; there, you also can check
and identify the matching lines with CTRL-T).
>it never showed up, and I got the first message.
Yes; that's the consequence of an article being killfiled.
>The second half of the message is from an article that got
> through without triggering any score rules. Both articles are from the
> past 24 hours.
You should get that article at your newsreader, won't you?
Wolfgang
--
Ted Schuerzinger
> "Ted Schuerzinger" <fe...@hughes.spam> schrieb ...
>>
>> Sorry for the late reply, but I'm still having problems. Retrieving
>> articles still isn't working. The first M-ID below received a score
>> of -1, when I tried to retrieve it,
>
> Then, at least one filter rule did match, but not that one you
> mentioned in your OP. Any score value below 0 will cause hamster to
> throw that article into the killfile (see Configuration => Killfile;
> there, you also can check and identify the matching lines with
> CTRL-T).
Yes; I'm fully aware of that.
What's happening is that I see articles showing up in the killfile when
I hit Ctrl+K, and select some article I would rather actually retrieve
and read. When I select "Mark for Retrieval" (Ctrl+M), the article
disappears from the kill-file list. However, it never shows up in my
newsreader after marking it for retrieval, even after pulling groups
again.
Using the command line and the ham.exe command to try to locate a
supposedly retrieved article by Message-ID gives an error saying the
article could not be found. (Yes, I've tried pulling after marking the
message for retrieval.)
Wolfgang Jäth
>
> I hit Ctrl+K, and select some article I would rather actually retrieve
> and read. When I select "Mark for Retrieval" (Ctrl+M), the article
> disappears from the kill-file list. However, it never shows up in my
> newsreader after marking it for retrieval, even after pulling groups
> again.
'Mark for retrieval' does mean exactly what it says. with other words, it
simply removes the entry from the killfille, and notes it in a file called
getmids.txt (i.e. in any of them; they're located in the server
directories).
Next time you are pulling any of these servers, the related getmids.txt will
be processed (without considering the filter rules). Can you check the
apropriate getmids.txt (news.motzarella.org, isn't it?) whether it contains
the MID in question (if the file doesn't exist, all entries are removed).
And how about any other servers (maybe you have one which is standing idle)?
> Using the command line and the ham.exe command to try to locate a
> supposedly retrieved article by Message-ID gives an error saying the
> article could not be found. (Yes, I've tried pulling after marking the
> message for retrieval.)
Hmm; I'm afraid, at the moment I have only four explanations: You made a
mistake (marked or remembered the wrong MID or simillar), you haven't pulled
the server already, meanwhile the article is expired at[1] the external
server, or you found an unknown bug in Hamster. But frankly, none of them
can persuade me actually. :-(
[1] YFMI: what's the correct english expression here: at, in, on, by, ...?
Wolfgang
--
Ted Schuerzinger
> "Ted Schuerzinger" <fe...@hughes.spam> schrieb ...
>>
>> What's happening is that I see articles showing up in the killfile
>> when I hit Ctrl+K, and select some article I would rather actually
>> retrieve and read. When I select "Mark for Retrieval" (Ctrl+M), the
>> article disappears from the kill-file list. However, it never shows
>> up in my newsreader after marking it for retrieval, even after
>> pulling groups again.
>
> 'Mark for retrieval' does mean exactly what it says. with other
> words, it simply removes the entry from the killfille, and notes it
> in a file called getmids.txt (i.e. in any of them; they're located in
> the server directories).
>
> Next time you are pulling any of these servers, the related
> getmids.txt will be processed (without considering the filter rules).
> Can you check the apropriate getmids.txt (news.motzarella.org, isn't
> it?) whether it contains the MID in question (if the file doesn't
> exist, all entries are removed). And how about any other servers
> (maybe you have one which is standing idle)?
The getmids.txt for reader.motzarella.org has 16 entries, including the
M-IDs I've posted in this thread. The ones from the beginning of
December are still there, too. (And I've pulled every server I've got
configured in Hamster.)
>> Using the command line and the ham.exe command to try to locate a
>> supposedly retrieved article by Message-ID gives an error saying the
>> article could not be found. (Yes, I've tried pulling after marking
>> the message for retrieval.)
>
> Hmm; I'm afraid, at the moment I have only four explanations: You
> made a mistake (marked or remembered the wrong MID or simillar), you
> haven't pulled the server already, meanwhile the article is expired
> at[1] the external server, or you found an unknown bug in Hamster.
> But frankly, none of them can persuade me actually. :-(
None of those explanations persuades me, either. The M-IDs are in
getmids.txt; I've definitely pulled the server (I only pull one server,
unless it's down); and the articles aren't expired on motzarella (I can
use another newsreader not going through Hamster and get the message).
I just got the idea to look through the log-files, and see the following
bit:
<snip>
2008/12/31 08:04:24 I {cdc} {newsjobs reader.motzarella.org} get list
of MIDs
2008/12/31 08:04:24 D {cdc} TClientSocketNNTP > ARTICLE
<qp0q26-...@despair.pu239.ru>
2008/12/31 08:04:25 I {bf0} {pop3 from mail.hughes.net} Disconnecting
...
2008/12/31 08:04:25 D {bf0} TClientSocketPOP3 > QUIT
2008/12/31 08:04:26 D {cdc} TClientSocketNNTP < 502 Read access denied
2008/12/31 08:04:26 I {cdc} {newsjobs reader.motzarella.org} pull
rec.sport.tennis
2008/12/31 08:04:26 D {cdc} {newsjobs reader.motzarella.org} Opening
for pull: rec.sport.tennis
</snip>
<qp0q26-...@despair.pu239.ru> is one of the M-IDs in getmids.txt,
and the only one of the 16 to be mentioned in the log file.
> [1] YFMI: what's the correct english expression here: at, in, on, by,
> ...?
On a server. Your knowledge of English prepositions is greater than my
knowledge of German prepositions. :-)
Ted Schuerzinger
>> The getmids.txt for reader.motzarella.org has 16 entries, including
>> the M-IDs I've posted in this thread. The ones from the beginning
>> of December are still there, too. (And I've pulled every server
>> I've got configured in Hamster.)
>
> If any Message-Id remains in a server's getmids.txt file after
> pulling news from that server, then that article was not available on
> that server. A MID is cleared from the getmids.txt file only if and
> when the article is retrieved from that server. Those 16 articles
> are not being supplied by that server upon request by the command
> "ARTICLE <message-id>".
As you can tell from my headers, I normally use Dialog, with Hamster
between it and the servers. reader.motzarella.org is the normal server
I pull, with news.motzarella.org and/or news.albasani.net being pulled
only when reader.motzarella is down. The "other" reader, reading
straight from reader.motzarella.org, is Xnews, and I've gotten the
articles in question from reader.motzarella.org despite the fact that
those M-IDs are still in the getmids.txt for reader.motzarella.org.
>> None of those explanations persuades me, either. The M-IDs are in
>> getmids.txt; I've definitely pulled the server (I only pull one
>> server, unless it's down); and the articles aren't expired on
>> motzarella (I can use another newsreader not going through Hamster
>> and get the message).
>
> Are you getting that same article by use of the MID using the other
> newsreader or by using the server's article number?
I use the Xnews "Open Special" command, which brings up a dialog box
allowing me to pull a range of articles via the article number. The
articles are still on reader.motzarella.org, since Xnews is pulling them
from there; they don't get retrieved from Hamster even though the M-IDs
are in getmids.txt. (And two of the articles are from December 29, so
there's no way reader.motzarella.org would have gotten rid of them in
three days.)
Wolfgang Jäth
>
>> The getmids.txt for reader.motzarella.org has 16 entries, including the
>> M-IDs I've posted in this thread. The ones from the beginning of
>> December are still there, too. (And I've pulled every server I've got
>> configured in Hamster.)
>
> news from that server, then that article was not available on that server.
NAK. After pulling a server, all entries in the related getmids.txt will be
erased. Check it out by your own: Write some nonsense MID into any
getmids.txt, and then pull the apropriate server.
>A
> MID is cleared from the getmids.txt file only if and when the article is
> retrieved from that server.
NAK. It will be removed, as soon as Hamster /tries/ to download that
article, independent of being successfull or not.
> Those 16 articles are not being supplied by
> that server upon request by the command "ARTICLE <message-id>".
NAK. IMHO that server hasn't been pulled at all.
@Ted: Could you please check, whether your Hamster contains two simmilar
server entries (maybe one with a typo)?
BTW (I've seen only now): The header you posted in
<rexybbdphhpf$.d...@justacineast.motzarella.org> looks like having been
loaded directly from reader.motzarella.org. At least there are no typical
header entries for Hamster listened. Are you sure you're pulling from
Hamster at all? Could you please post a header of an article of that group,
which has been pulled by Hamster? Maybe I could find some hint of what
happens or might go wrong.
What happens, if you directly call Hamster -> Online -> NNTP-Server ->
reader.motzarella.org?
Wolfgang
--
Ted Schuerzinger
>
> @Ted: Could you please check, whether your Hamster contains two
> simmilar server entries (maybe one with a typo)?
I've got an entry for reader.motzarella.org; one for
news.motzarella.org; and one for news.albasani.net.
> BTW (I've seen only now): The header you posted in
> <rexybbdphhpf$.d...@justacineast.motzarella.org> looks like having
> been loaded directly from reader.motzarella.org. At least there are
> no typical header entries for Hamster listened. Are you sure you're
> pulling from Hamster at all? Could you please post a header of an
> article of that group, which has been pulled by Hamster? Maybe I
> could find some hint of what happens or might go wrong.
Here's the headers of your last post:
<snip>
X-Hamster-Info: Score=0 ScoreLoad=0 ScoreSave=0 Received=20090101084302
Xref: justacineast.motzarella.org hamster.en.config:315
Path:
justacineast.motzarella.org!reader.motzarella.org!news.motzarella.org!motzarella.org!feeder.news-service.com!news.astraweb.com!border1.a.newsrouter.astraweb.com!newsfeed-hp3.netcologne.de!news.netcologne.de!newsfeed-hp2.netcologne.de!newsfeed.arcor.de!newsspool2.arcor-online.net!news.arcor.de.POSTED!not-for-mail
Message-ID: <gji1ui...@ID-4636.user.dfncis.de>
Reply-To: Wolfgang Jäth <jawo.usene...@arcor.de>
From: Wolfgang Jäth <jawo.us...@goldmail.de>
Newsgroups: hamster.en.config
References: <c1rzrb4t...@justacineast.motzarella.org>
<gh0b47...@ID-4636.user.dfncis.de>
<rexybbdphhpf$.d...@justacineast.motzarella.org>
<gh351o...@ID-4636.user.dfncis.de>
<1izzekwe...@justacineast.motzarella.org>
<gjbh0...@ID-4636.user.dfncis.de>
<1lcn9r6r...@justacineast.motzarella.org>
<gjfgqp...@ID-4636.user.dfncis.de>
<3ny391i9...@justacineast.motzarella.org>
<hjmnl459fppip8mll...@4ax.com>
Subject: Re: Mark for retrieval not retrieving messages
Date: Thu, 1 Jan 2009 09:20:13 +0100
MIME-Version: 1.0
Content-Type: text/plain; format=flowed; charset="iso-8859-1";
reply-type=original
Content-Transfer-Encoding: 8bit
X-Priority: 3
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5579
Lines: 43
Organization: Arcor
NNTP-Posting-Date: 01 Jan 2009 09:21:34 CET
NNTP-Posting-Host: f3602ebb.newsspool1.arcor-online.net
X-Trace:
DXC=nA6\`7iGZCPf8j24CD<3lPic==]BZ:af^4Fo<]lROoRQ^YC2XCjHcbY4gTFhELHZ]Ubl]dN;C=jUS?CdAVLNBj3T\WMiS4YO\[W
X-Complaints-To: usenet...@arcor.de
X-Old-Xref: justacineast.motzarella.org hamster.en.config:319
</snip>
> What happens, if you directly call Hamster -> Online -> NNTP-Server
> -> reader.motzarella.org?
As a matter of fact, that's the way I normally fetch articles. I
haven't gotten around to re-writing a script to pull the POP servers,
SMTP servers, one NNTP server, and post articles.
Wolfgang Jäth
>
>
This header is proving at least that the article was runing through any
Hamster some time (see below).
> Xref: justacineast.motzarella.org hamster.en.config:315
^^^^^^^^^^^^^^^^^^^^^^^^^
Hmm; is that your entry in Configuration => Local Servers => General => FQDN
for special headers? If so, you are missusing a foreign domain (but that's
nor your primary problem at the moment). The more worse result is I thereby
can't identify wo was writing which information. :-(
In any case, this header shows the name of the last server, which usualy
[tm] is the hamster. I.e. According to this entry your reader got this
article from any server which claimed to be justacineast.motzarella.org.
At me, this header looks like (and of course the onwer of the domain
myfqdn.de did allow me explicitely to use that subdomain):
| Xref: hamster.jawo.myfqdn.de hamster.en.config:4674
> Path:
> justacineast.motzarella.org!reader.motzarella.org!news.motzarella.org!
> [...]
In oposite to above, the Path header starts with the last server /before/
Hamster; Hamster doesn't update it. According to this, the Path: header
here states, that your /Hamster/ got the article from
justacineast.motzarella.org.
/My/ header looks like this:
| Path: newsspool4.arcor-online.net!newsspool1.arcor-online.net! [...]
Lightly you can recognize where I got it from ... :-)
And as to fully confuse me, as a third pronouncement /you/ did say, your
Hamster is polling from /reader/.motzarella.org (which was the second last
server only, according to the Path: header data).
> Reply-To: Wolfgang Jäth <jawo.usene...@arcor.de>
> From: Wolfgang Jäth <jawo.us...@goldmail.de>
BTW: That's not real raw data; umlauts and other special characters are not
allowed in headers, they have to be (and in fact are) encoded. You maybe
should keep in mind, that your reader is seeming to show you deciphered
data, not raw ones.
> X-Old-Xref: justacineast.motzarella.org hamster.en.config:319
This entry displays the content of the Xref: header, as it was delivered
from
the external news server to Hamster. And in fact, it confirms the Path:
header statement. But like this, it somehow contradicts both the XRef:
header declaration and your description. For comparison, this is my entry:
| X-Old-Xref: newsspool4.arcor-online.net hamster.en.config:5241
So - what happens really? I'm afraid I can't tell at the moment. :-(
I first need some more informations to solve above seeming inconsitencies.
Could you please check up again your installation and reconfirm the given
data?
Wolfgang
--