push email not working since 5.1.1 update. Anybody else?

[David Payne]

Hi all. I thought originally it might have been an issue with my new phone (Huawei Mate S) compared to my last device (Xperia Z2) but after days of testing I'm pretty sure that the issue K9 mail.

When I go into my k9 inbox and refresh I get several emails come through however this seems to be the only way to get them to arrive. I have installed BlueMail and the same account seems to work well so I think its a k9 issue.

I'm running android 5.1.1 on a Huawei Mate S/Xperia Z2 (same problem on both) and running k9 5.006

Any suggestions before I begrudgingly try to get used to BlueMail..?

[Nadir Husain]

5.1.1 working fine on note 4. No issues with k9 push mail. Running two accounts. Gmail and imap for work .maybe you want to try to reduce the time between refresh idle connection.Assuming all other settings are correct.

[David Payne]

It was set to 24 mins to have changed to 12. That doesn't mean that it will check for new mail every 12 mins though does it? Surely that's not push if so..

I also saw background sync was set to "when auto sync is checked" so I've changed that to "always"

Apologies for replying by email if this arrives by email.. First time using Google groups couldn't see how to reply on the group in the email..

[David Payne]

Ah I see my reply posted. Good!

OK more info.. A fresh start of k9 works as it should. Only after its left for a certain amount of time does it stop working. Imap connection is clearly closing.

This is my problem but it appears it was never fixed

https://code.google.com/p/k9mail/issues/detail?id=6225

[Nadir Husain]

no it does not mean it will check every twelve minutes. it just means if the port is disconnected by your 3G or wifi provider it will try to maintain an open connection. i am not really well versed with how or why that happens but i had a similar problem and then i switched the time to 6 minutes and now am getting push emails very reliably which is not the same as k9 syncing every 6 minutes. perhaps someone with more knowledge on this subject can explain the phenomena better. anyhow i would like to know if these changes helped. thanks

[David Payne]

Ok ive set it to 6 will report back.

I also contacted my host asking how long I have until the idle connection closes and they suggested the issue is with k9 not at their end:

Thank you for contacting our Help Desk.

I reviewed your case and checked the list with currently opened processes. This information can be found in yourcPanel -> Left Sidebar -> Process List:

And if you click on the Full Process List you should be able to see that most of the processes there are Dovecot ones. These are the Mail Clients currently connected to your hosting account and if you examine the data there you will notice that some of them are IDLE for a long time: 

Code:

650 dovecot/imap [da...@rideoutfilms.com 52.0.210.163 IDLE] 23904 kB 3900 kB 22506 secs

As you can see the Mail Client connected to the email account da...@rideoutfilms.com for more than 6 and a half hours. Which indicates that such connections are not closed from a server-side software or configuration. Such IDLE settings are usually set up in the Mail Client in question and thus I suggest you to review the settings used in your Mail Client. For more information regarding the settings of the Mail Client you should ask in the appropriate Support Section of the Client's website

[David Payne]

Interestingly when i go to the list of connections in my webhost control panel I see one that has had an extended period of connection but the IP address that I have X'd out can not be linked to any of my devices. My phones and PC's when connected with wifi are all on the 2nd/3rd listed IP and when connecting on 4G it uses an IP thats not listed so I dont have a clue what the IP address thats been connected for 6 hours actually is...

650	dovecot/imap [da...@rideoutfilms.com xx.x.xxx.xxx IDLE]	23904 kB	3908 kB	23256 secs
12361	dovecot/imap [da...@rideoutfilms.com xx.xxx.xxx.xx IDLE]	21356 kB	2232 kB	42 secs
12362	dovecot/imap [da...@rideoutfilms.com xx.xxx.xxx.xx IDLE]	23424 kB	3200 kB	42 secs
14590	dovecot/imap [da...@rideoutfilms.com xx.xxx.xxx.xx]	22064 kB	3204 kB	23 secs

On Mon, Nov 16, 2015 at 7:28 AM, Nadir Husain <husain...@gmail.com> wrote:

no it does not mean it will check every twelve minutes. it just means if the port is disconnected by your 3G or wifi provider it will try to maintain an open connection. i am not really well versed with how or why that happens but i had a similar problem and then i switched the time to 6 minutes and now am getting push emails very reliably which is not the same as k9 syncing  every 6 minutes. perhaps someone with more knowledge on this subject can explain the phenomena better. anyhow i would like to know if these changes helped. thanks

--
--
You received this message because you are subscribed to the K-9 Mail Users List.
To post to this group, send email to k-9-...@googlegroups.com
To unsubscribe, email k-9-mail+u...@googlegroups.com
To report an issue with K-9 Mail, visit http://code.google.com/p/k9mail/issues/list
For more options, visit this group at http://groups.google.com/group/k-9-mail

---
You received this message because you are subscribed to a topic in the Google Groups "K-9 Mail" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/k-9-mail/AnqBB2iunQc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to k-9-mail+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[David Payne]

It appears its definitely a k-9 issue. My web host has urged me to stop using it until the issue is resolved as it appears to be opening an imap connection each time it connects instead of re-opening the same one. BlueMail has no such problems so it looks like I'll need to get used to that until there is a way around this k-9 issue.

Any suggestions welcome. Here are my account settings:

Sunc messages from - any time

Never poll frequency - never

Poll folders - 1st class folders

Push folders - only 1st class folders

poll when connecting for push - ticked

max folders to check with push - 10

refresh idle connection - every 24 mins (setting to 6 didnt solve issue so have put this back to default)

background sync - always

On Mon, Nov 16, 2015 at 7:28 AM, Nadir Husain <husain...@gmail.com> wrote:

no it does not mean it will check every twelve minutes. it just means if the port is disconnected by your 3G or wifi provider it will try to maintain an open connection. i am not really well versed with how or why that happens but i had a similar problem and then i switched the time to 6 minutes and now am getting push emails very reliably which is not the same as k9 syncing  every 6 minutes. perhaps someone with more knowledge on this subject can explain the phenomena better. anyhow i would like to know if these changes helped. thanks

[Nadir Husain]

that is indeed sad. maybe someone , a k9 developer perhaps, can help

[Greg Troxel]

David Payne <davidpa...@gmail.com> writes:

> It appears its definitely a k-9 issue. My web host has urged me to stop
> using it until the issue is resolved as it appears to be opening an imap
> connection each time it connects instead of re-opening the same one.
> BlueMail has no such problems so it looks like I'll need to get used to
> that until there is a way around this k-9 issue.

A few thoughts:

Does the problem only happen when the phone goes into Doze mode? I
wonder if apps are supposed to get some pre-Doze intent and shut down
TCP connections, or if they are supposed to be ok.

In general, your phone will change networks, and that will leave
broken connections. Presumably they will expire and close on the
server side if there is no new IDLE command. I am not clear on the
details, but absent a cleanup mechanism *on the server*, this seems
intractable.

You could try turning off push, and just doing poll every 15 minutes,
either as a workaround, or as a test case.

[Nadir Husain]

due apologies at the outset if i am wrong but doze mode is applicable only starting at android 6, is it not? we are talking about lollipop 5.1.1. what am i missing? or is it just a matter of terminology and you are talking about the phone going into a deep state of sleep. dave could leave it on wifi and keep the phone awake and see if it works if that is the case... i guess....

[Greg Troxel]

Sorry, Doze, as I understand it, is a 6.0 feature.

[Nadir Husain]

David is your issue resolved?

[David Payne]

No, I had to give up and move to bluemail which I don't really like. Any chance you could resolve the k9 push issue?

Sent from BlueMail

On 19 Nov 2015, at 23:15, Nadir Husain <husain...@gmail.com> wrote:

David is your issue resolved?

[Nadir Husain]

sorry i wish i could. cant code worth squat . maybe @cketti or @richard can help

[Craig Yarnold]

I'm having the same problem. Didn't realize I was no longer receiving push notifications for several days because I don't get frequent email at the accounts I have set up in K9.

The only way to get new email is to manually refresh.

Tried changing the background sync to always - will see if that makes a difference.

[Rob]

Anyone having any luck with this?  I am having the issues of push e-mail failing to work after a period of time, multiple IDLE connections being abandoned/left open on the server, etc.

[Greg Troxel]

Rob <r...@nollmail.com> writes:

> Anyone having any luck with this? I am having the issues of push e-mail
> failing to work after a period of time, multiple IDLE connections being
> abandoned/left open on the server, etc.

I am using push with k-9 5.007 from f-droid and CM 12.1 (which is 5.1.1
more or less) and it is working fine.

(However, I have never taken the time to understand the idle timeout
rules and mechanisms, and why there is a 12 minute vs 24 minute notion.)

[Rob]

I fully understand IDLE timeouts and the reason for the timeout adjustment.  The issue I'm having is not related.
For others having this problem, I have created a new bug report along with details of my findings so far, here: https://groups.google.com/forum/#!topic/k-9-mail/5WGGmNNdw8Q

[Greg Troxel]

I think the big question is what is happening at the packet level. I
would run a tcpdump logging to a file on the server and also on a LAN
that that phone is attached to on wifi, and then go over both after the
issue arises and see whether the phone sent data that wasn't received,
or didn't send it, or something else.

Your symptoms appear consistent with a short-timeout firewall someplace.
That doesn't mean I think that's what is happening, but it would be good
to rule it out.

[Robert Noll]

Thanks, it's not a firewall though, other clients on the same networks work ok