hitting a timeout after upgrade to 2.13.4

[euphxenos]

We just upgraded from Gerrit 2.12 to 2.13.4, and we've started seeing the error message below in our error_log on some failed attempts to clone.  It sounds like we're hitting a 30-second timeout, but it's unclear to me which one this is.  Which timeout do I need to increase to get past this?

[2016-12-17 16:12:48,347] [SSH git-upload-pack '/gvhd' (svc-es-ldap)] ERROR com.

google.gerrit.sshd.BaseCommand : Internal server error (user svc-es-ldap account

 7) during git-upload-pack '/gvhd'

org.eclipse.jgit.transport.UploadPackInternalServerErrorException

        at org.eclipse.jgit.transport.UploadPack.sendPack(UploadPack.java:1396)

        at org.eclipse.jgit.transport.UploadPack.service(UploadPack.java:774)

        at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:667)

        at com.google.gerrit.sshd.commands.Upload.runImpl(Upload.java:92)

        at com.google.gerrit.sshd.AbstractGitCommand.service(AbstractGitCommand.

java:101)

        at com.google.gerrit.sshd.AbstractGitCommand.access$000(AbstractGitComma

nd.java:32)

        at com.google.gerrit.sshd.AbstractGitCommand$1.run(AbstractGitCommand.ja

va:70)

        at com.google.gerrit.sshd.BaseCommand$TaskThunk.run(BaseCommand.java:442

)

        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)

        at java.util.concurrent.FutureTask.run(Unknown Source)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)

        at com.google.gerrit.server.git.WorkQueue$Task.run(WorkQueue.java:417)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

        at java.lang.Thread.run(Unknown Source)

Caused by: java.net.SocketTimeoutException: waitForCondition(Window[server/remote](ChannelSession[id=0, recipient=0]-ServerSessionImpl[svc-es-ldap@/10.22.0.146:33017])) timeout exceeded: 30000

        at org.apache.sshd.common.channel.Window.waitForCondition(Window.java:314)

        at org.apache.sshd.common.channel.Window.waitForSpace(Window.java:264)

        at org.apache.sshd.common.channel.ChannelOutputStream.flush(ChannelOutputStream.java:176)

        at org.apache.sshd.common.channel.ChannelOutputStream.write(ChannelOutputStream.java:119)

        at org.eclipse.jgit.transport.SideBandOutputStream.writeBuffer(SideBandOutputStream.java:171)

        at org.eclipse.jgit.transport.SideBandOutputStream.write(SideBandOutputStream.java:151)

        at org.eclipse.jgit.internal.storage.pack.PackOutputStream.write(PackOutputStream.java:126)

        at org.eclipse.jgit.internal.storage.file.PackFile.copyAsIs2(PackFile.java:548)

        at org.eclipse.jgit.internal.storage.file.PackFile.copyAsIs(PackFile.java:363)

        at org.eclipse.jgit.internal.storage.file.WindowCursor.copyObjectAsIs(WindowCursor.java:201)

        at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjectImpl(PackWriter.java:1521)

        at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObject(PackWriter.java:1498)

        at org.eclipse.jgit.internal.storage.pack.PackOutputStream.writeObject(PackOutputStream.java:164)

        at org.eclipse.jgit.internal.storage.file.WindowCursor.writeObjects(WindowCursor.java:207)

        at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjects(PackWriter.java:1486)

        at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjects(PackWriter.java:1474)

        at org.eclipse.jgit.internal.storage.pack.PackWriter.writePack(PackWriter.java:1038)

        at org.eclipse.jgit.transport.UploadPack.sendPack(UploadPack.java:1540)

        at org.eclipse.jgit.transport.UploadPack.sendPack(UploadPack.java:1390)

        ... 15 more

[Emmanuel POT]

I am seeing this error as well. Any idea why?

[jason]

Hi,

I am facing the same issue in 2.16.17, What's the exact cause, is there any  fix available for this issue? 

[José Granha]

Hi

Likely it is this parameter you are stumbling upon

sshd.waitTimeout 

Time in seconds after which the server automatically terminates connections waiting for a server operation to complete, like for instance cloning a very large repo with lots of refs. Values should use common unit suffixes to express their setting:

        s, sec, second, seconds
        m,min, minute, minutes
        h, hr, hour, hours
        d, day, days

By default, 30s.

Regards

José