mu4e: multiply displayed messages

[Jacek Generowicz]

Hi,

Does anyone else ever get the same message being displayed multiple
times in mu4e?

For example, here is a portion of my current *mu4e-headers*:

2012-05-16 Wed 20:12 S Dirk-Jan C. Binnema + mu 0.9.8.5 updates
2012-05-16 Wed 20:12 S Dirk-Jan C. Binnema \ mu 0.9.8.5 updates

Looking inside those messages, I cannot find any difference whatsoever
between them: same contents, same date, same maildir etc.

This happens for something in the order of 60-70% of my messages.

It happens in both Emacs 23 and 24. It has happened for all the
different versions of mu4e I have ever tried (I have been rebuilding
from git many times over the last 3 weeks).

Can anyone shed any light on this?

Thanks.

[Jacek Generowicz]

P.S. It seems that the problem originates with mu itself; a command line
mu search finds the same single message twice:

,----[ mu find subject:mu updates ]
| Wed 16 May 2012 08:12:57 PM CEST "Dirk-Jan C. Binnema" <dj...@djcbsoftware.nl> mu 0.9.8.5 updates
| Wed 16 May 2012 08:12:57 PM CEST "Dirk-Jan C. Binnema" <dj...@djcbsoftware.nl> mu 0.9.8.5 updates
`----

[Stephen Eglen]

Sorry, not seen that.  Have you tried deleting your mu index, and recompiling?

[Dirk-Jan C. Binnema]

Hi Jacek,

The ultimate test for this is to see if these dups are actually
different files, i.e..:
mu find subject:mu updates --fields="d f s l" --sortfield="d"

I suspect that the messages are not really the same mail file (path) --
if that is the case, the question is why there are these multiple files.
A good first step would be to see if there are any differences between the
files, i.e.

$ diff -u path1 path2

I sometimes get messages twice (when using gmail/pop); there are subtle
differences between the message headers though. I even have a procmail
rule for them to be moved to trash automatically (when see the same
message-id again).

Best wishes,
Dirk.

--
Dirk-Jan C. Binnema Helsinki, Finland
e:dj...@djcbsoftware.nl w:www.djcbsoftware.nl
pgp: D09C E664 897D 7D39 5047 A178 E96A C7A1 017D DA3C

[Jörn Gersdorf]

Hi Dirk et all,

First letzten me thank you for hat wonderful piece of Software.

Maybe this is a dumb Problem I have. I'm an avid user of gmail's labels and my current setup is to use offlineimap for syncing.

Now my problem is that I"m getting dupes of course if a message has two labels attached, leading to two IMAP folders. As I'm syncing all gmail folders including "all Mail" (since not every mail is tagged) in fact all messages have at least one dupe.

Do you have any Suggestion for this kind of Setup?

Thank you!

Best wishes,
Jörn

[Jacek Generowicz]

Dirk-Jan C. Binnema <dj...@djcbsoftware.nl> writes:

> mu find subject:mu updates --fields="d f s l" --sortfield="d"

This shed a lot of light on the problem.

For historic reasons I have 2 separate Maildir directories, but today
one is just a soft link to the other. After doing

mu index --rebuild

mu finds just one of copy of any message. But as soon as I start mu4e,
mu finds a copy of the message in each of the two directories, until the
next index rebuild. This does *not* happen when I run mu4e in an Emacs
without my init files, but I can't find any reference to either of the
Maildir directories in any of my Emacs config files.

So the questions I'm currently struggling with are:

+ What affects mu's idea of where the maildirs are?

+ How can this be affected by mu4e or other Emacs-related settings?

Is there something in Emacs that allows you to "grep through variable
values"? IOW, find me all variables whose *values* currently match some
pattern?

> I sometimes get messages twice (when using gmail/pop);

Well, I am annoyed by the fact that Gmail likes to stick copies of the
same message in N different mailboxes, and that all copies show up as
separate messages in mu4e. But that is unrelated to the current issue (I
think) and is further down my mu4e-itches-to-scratch list.


Thank you.

[Jacek Generowicz]

Jörn Gersdorf <jo...@gersdorf.info> writes:

> Maybe this is a dumb Problem I have. I'm an avid user of gmail's labels and
> my current setup is to use offlineimap for syncing.
>
> Now my problem is that I"m getting dupes of course if a message has two
> labels attached, leading to two IMAP folders. As I'm syncing all gmail
> folders including "all Mail" (since not every mail is tagged) in fact all
> messages have at least one dupe.
>
> Do you have any Suggestion for this kind of Setup?

Seconded.

The message to which I am now replying appears twice, once for each of

/Googlemail/INBOX
/Googlemail/[Google Mail].All Mail

If I flag it with mu4e's new '+', then I'll get to see a third copy of
the same message for

/Googlemail/[Google Mail].Starred

Ideally *mu4e-headers* would show a single entry for the message and
*mu4e-view* would report all maildirs in which it appears in a/some
Maildir header(s). Not sure what the best way would be to deal with
operations on some-but-not-other copies of the message. For example,
Imagine I want to flag the INBOX copy for deletion, but leave the All
Mail version alone. I suspect that any solution would have to be
integrated with thread collapsing.

[Dirk-Jan C. Binnema]

Hi Jacek,

Jacek Generowicz <jacek.ge...@googlemail.com> writes:

> Dirk-Jan C. Binnema <dj...@djcbsoftware.nl> writes:
>
>> mu find subject:mu updates --fields="d f s l" --sortfield="d"
>
> This shed a lot of light on the problem.
>
> For historic reasons I have 2 separate Maildir directories, but today
> one is just a soft link to the other. After doing
>
> mu index --rebuild
>
> mu finds just one of copy of any message. But as soon as I start mu4e,
> mu finds a copy of the message in each of the two directories, until the
> next index rebuild. This does *not* happen when I run mu4e in an Emacs
> without my init files, but I can't find any reference to either of the
> Maildir directories in any of my Emacs config files.

*scratches head*

> So the questions I'm currently struggling with are:
>
> + What affects mu's idea of where the maildirs are?
>
> + How can this be affected by mu4e or other Emacs-related settings?

So, the first time you run mu4e after rebuilding the index, it shows
many more messages? One possibility is that the indexing from emacs uses
another maildir.

When you run mu index from the command line, it should say something
like:
mu: indexing messages under --your-maildir--

that should be same as what is in mu4e-maildir.

Maybe it gets confused by your symlinked dirs; i.e., if you have

/home/foo/Maildir
and
/home/foo/symlink-to-home-foo-Maildir

mu4e will consider the messages as different.

>> I sometimes get messages twice (when using gmail/pop);
>
> Well, I am annoyed by the fact that Gmail likes to stick copies of the
> same message in N different mailboxes, and that all copies show up as
> separate messages in mu4e. But that is unrelated to the current issue (I
> think) and is further down my mu4e-itches-to-scratch list.

I use Gmail-POP, which gives me fewer headaches with this (but then
again, I only use web-Gmail only very occasionally).

[Stephen Eglen]

Is there something in Emacs that allows you to "grep through variable
values"? IOW, find me all variables whose *values* currently match some
pattern?

Yes; try M-x apropros-value

Stephen 

[Jacek Generowicz]

Perfect. Thank you.

(The mind boggles at how I could have failed to become aware of this
function until today!)

[semente]

I got the same problem here:

  $ mu find subject:SUBJECT  --fields="d f s l" --sortfield="d" 

  Qua 01 Ago 2012 13:17:42 BRT <E-MAIL-HIDDEN> SUBJECT /home/semente/Maildir//cur/1343838020.M482976P23991.magon,S=1320269,W=1337496:2,S

  Qua 01 Ago 2012 13:17:42 BRT <E-MAIL-HIDDEN> SUBJECT /home/semente/Maildir/cur/1343838020.M482976P23991.magon,S=1320269,W=1337496:2,S

Look at the path, one have two slashes.

I index my mails using cron (the command is just "mu index"). Also I use mu4e. Looks like when I perform some operation in mu4e it happens (but not always).

My mu4e-maildir variable contains "~/Maildir".

mu version: 0.9.8.5

Do someone know what is going on?

Thanks guys,

semente

[Dirk-Jan C. Binnema]

Hi,

semente writes:

> On Thursday, May 17, 2012 5:48:59 PM UTC-3, Jacek Generowicz wrote:
>>
>> Hi,
>>
>> Does anyone else ever get the same message being displayed multiple
>> times in mu4e?
>>
>> For example, here is a portion of my current *mu4e-headers*:
>>
>> 2012-05-16 Wed 20:12 S Dirk-Jan C. Binnema + mu
>> 0.9.8.5 updates
>> 2012-05-16 Wed 20:12 S Dirk-Jan C. Binnema \ mu
>> 0.9.8.5 updates
>>
>> Looking inside those messages, I cannot find any difference whatsoever
>> between them: same contents, same date, same maildir etc.
>>
>> This happens for something in the order of 60-70% of my messages.
>>
>> It happens in both Emacs 23 and 24. It has happened for all the
>> different versions of mu4e I have ever tried (I have been rebuilding
>> from git many times over the last 3 weeks).

>>> Can anyone shed any light on this?

Hmm, odd... can you check if it could be the same double-slash things
that semente mentions below?

>
> I got the same problem here:
>
> $ mu find subject:SUBJECT --fields="d f s l" --sortfield="d"
> Qua 01 Ago 2012 13:17:42 BRT <E-MAIL-HIDDEN> SUBJECT
> /home/semente/Maildir//cur/1343838020.M482976P23991.magon,S=1320269,W=1337496:2,S
> Qua 01 Ago 2012 13:17:42 BRT <E-MAIL-HIDDEN>
> SUBJECT /home/semente/Maildir/cur/1343838020.M482976P23991.magon,S=1320269,W=1337496:2,S
>
> Look at the path, one have two slashes.
>
> I index my mails using cron (the command is just "mu index"). Also I use
> mu4e. Looks like when I perform some operation in mu4e it happens (but not
> always).
>
> My mu4e-maildir variable contains "~/Maildir".
>
> mu version: 0.9.8.5
>
> Do someone know what is going on?

Ah, yes, mu/mu4e is quite picky with the file names, even if they are
really the same (such as the double-slash case). Let me see if can make
it a bit less picky...