ERROR com.google.gerrit.sshd.BaseCommand : Internal server error (user shaowei.song account 1001162) during git-upload-pack '/acore'

[bonnie chen]

On Gerrit-3.4.3

There are some errors in gerrit server error log like the following 

[2024-08-14T10:11:16.490+08:00] [SSH git-upload-pack /acore (shaowei.song)] ERROR com.google.gerrit.sshd.BaseCommand : Internal server error (user shaowei.song account 1001162) during git-upload-pack '/acore'
org.eclipse.jgit.transport.UploadPackInternalServerErrorException
at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:775)
at com.google.gerrit.sshd.commands.Upload.runImpl(Upload.java:101)
at com.google.gerrit.sshd.AbstractGitCommand.service(AbstractGitCommand.java:109)
at com.google.gerrit.sshd.AbstractGitCommand$1.run(AbstractGitCommand.java:74)
at com.google.gerrit.sshd.BaseCommand$TaskThunk.run(BaseCommand.java:490)
at com.google.gerrit.server.logging.LoggingContextAwareRunnable.run(LoggingContextAwareRunnable.java:113)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at com.google.gerrit.server.git.WorkQueue$Task.run(WorkQueue.java:612)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.eclipse.jgit.errors.MissingObjectException: Missing unknown 2ec00021328779ef05297a78bfef16ccf4a605d8
at org.eclipse.jgit.internal.storage.file.WindowCursor.open(WindowCursor.java:136)
at org.eclipse.jgit.lib.ObjectReader.open(ObjectReader.java:212)
at org.eclipse.jgit.revwalk.RevWalk.parseAny(RevWalk.java:1075)
at org.eclipse.jgit.internal.storage.file.RefDirectory.doPeel(RefDirectory.java:531)
at org.eclipse.jgit.internal.storage.file.RefDirectory.peel(RefDirectory.java:511)
at com.google.gerrit.server.git.DelegateRefDatabase.peel(DelegateRefDatabase.java:90)
at org.eclipse.jgit.transport.RefAdvertiser.send(RefAdvertiser.java:319)
at org.eclipse.jgit.transport.UploadPack.sendAdvertisedRefs(UploadPack.java:1536)
at org.eclipse.jgit.transport.UploadPack.sendAdvertisedRefs(UploadPack.java:1469)
at org.eclipse.jgit.transport.UploadPack.service(UploadPack.java:1009)
at org.eclipse.jgit.transport.UploadPack.uploadWithExceptionPropagation(UploadPack.java:838)
at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:752)
... 12 more

[2024-08-14T15:58:27.274+08:00] [SSH git-upload-pack /jenkinsfile (ci_build)] ERROR com.google.gerrit.sshd.BaseCommand : Internal server error (user ci_build account 1001031) during git-upload-pack '/jenkinsfile'
org.apache.sshd.common.channel.exception.SshChannelClosedException: write(ChannelOutputStream[ChannelSession[id=0, recipient=0]-ServerSessionImpl[ci_build@/172.16.11.42:45484]] SSH_MSG_CHANNEL_DATA) len=65520 - channel already closed
at org.apache.sshd.common.channel.ChannelOutputStream.write(ChannelOutputStream.java:124)
at org.eclipse.jgit.transport.UploadPack$ResponseBufferedOutputStream.write(UploadPack.java:2397)
at org.eclipse.jgit.transport.SideBandOutputStream.writeBuffer(SideBandOutputStream.java:141)
at org.eclipse.jgit.transport.SideBandOutputStream.write(SideBandOutputStream.java:120)
at org.eclipse.jgit.internal.storage.pack.PackOutputStream.write(PackOutputStream.java:99)
at java.base/java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:253)
at java.base/java.util.zip.DeflaterOutputStream.finish(DeflaterOutputStream.java:226)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeWholeObjectDeflate(PackWriter.java:1781)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjectImpl(PackWriter.java:1757)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeBase(PackWriter.java:1766)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjectImpl(PackWriter.java:1717)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObject(PackWriter.java:1701)
at org.eclipse.jgit.internal.storage.pack.PackOutputStream.writeObject(PackOutputStream.java:138)
at org.eclipse.jgit.internal.storage.file.WindowCursor.writeObjects(WindowCursor.java:196)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjects(PackWriter.java:1689)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writeObjects(PackWriter.java:1677)
at org.eclipse.jgit.internal.storage.pack.PackWriter.writePack(PackWriter.java:1227)
at org.eclipse.jgit.transport.UploadPack.sendPack(UploadPack.java:2338)
at org.eclipse.jgit.transport.UploadPack.sendPack(UploadPack.java:2168)
at org.eclipse.jgit.transport.UploadPack.fetchV2(UploadPack.java:1256)
at org.eclipse.jgit.transport.UploadPack.serveOneCommandV2(UploadPack.java:1293)
at org.eclipse.jgit.transport.UploadPack.serviceV2(UploadPack.java:1333)
at org.eclipse.jgit.transport.UploadPack.uploadWithExceptionPropagation(UploadPack.java:836)
at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:752)
at com.google.gerrit.sshd.commands.Upload.runImpl(Upload.java:101)
at com.google.gerrit.sshd.AbstractGitCommand.service(AbstractGitCommand.java:109)
at com.google.gerrit.sshd.AbstractGitCommand$1.run(AbstractGitCommand.java:74)
at com.google.gerrit.sshd.BaseCommand$TaskThunk.run(BaseCommand.java:490)
at com.google.gerrit.server.logging.LoggingContextAwareRunnable.run(LoggingContextAwareRunnable.java:113)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at com.google.gerrit.server.git.WorkQueue$Task.run(WorkQueue.java:612)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Suppressed: org.apache.sshd.common.channel.exception.SshChannelClosedException: write(ChannelOutputStream[ChannelSession[id=0, recipient=0]-ServerSessionImpl[ci_build@/172.16.11.42:45484]] SSH_MSG_CHANNEL_DATA) len=26 - channel already closed
at org.apache.sshd.common.channel.ChannelOutputStream.write(ChannelOutputStream.java:124)
at org.eclipse.jgit.transport.UploadPack$ResponseBufferedOutputStream.write(UploadPack.java:2397)
at org.eclipse.jgit.transport.SideBandOutputStream.writeBuffer(SideBandOutputStream.java:141)
at org.eclipse.jgit.transport.SideBandOutputStream.flushBuffer(SideBandOutputStream.java:94)
at org.eclipse.jgit.transport.SideBandOutputStream.flush(SideBandOutputStream.java:100)
at org.eclipse.jgit.transport.UploadPack$SideBandErrorWriter.writeError(UploadPack.java:2430)
at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:770)
... 12 more

And client will recieve the follwoing error

fatal: remote error: want 501c0c152c3ab3710dd9a15df6fd26c6ed0f8ace not valid

fatal: internal server error

Please Help

thanks

Juan

[Luca Milanesio]

On 14 Aug 2024, at 02:06, bonnie chen <bonnie....@gmail.com> wrote:

On Gerrit-3.4.3

There are some errors in gerrit server error log like the following 

[2024-08-14T10:11:16.490+08:00] [SSH git-upload-pack /acore (shaowei.song)] ERROR com.google.gerrit.sshd.BaseCommand : Internal server error (user shaowei.song account 1001162) during git-upload-pack '/acore'
org.eclipse.jgit.transport.UploadPackInternalServerErrorException
at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:775)
at com.google.gerrit.sshd.commands.Upload.runImpl(Upload.java:101)
at com.google.gerrit.sshd.AbstractGitCommand.service(AbstractGitCommand.java:109)
at com.google.gerrit.sshd.AbstractGitCommand$1.run(AbstractGitCommand.java:74)
at com.google.gerrit.sshd.BaseCommand$TaskThunk.run(BaseCommand.java:490)
at com.google.gerrit.server.logging.LoggingContextAwareRunnable.run(LoggingContextAwareRunnable.java:113)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at com.google.gerrit.server.git.WorkQueue$Task.run(WorkQueue.java:612)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.eclipse.jgit.errors.MissingObjectException: Missing unknown 2ec00021328779ef05297a78bfef16ccf4a605d8

That’s the error: 2ec00021328779ef05297a78bfef16ccf4a605d8 does not exist on the repo.

Have you checked the repo?

Luca.

--
--
To unsubscribe, email repo-discuss...@googlegroups.com
More info at http://groups.google.com/group/repo-discuss?hl=en

---
You received this message because you are subscribed to the Google Groups "Repo and Gerrit Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to repo-discuss...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/repo-discuss/1f377cf1-0239-49de-94d5-0f6e20456d9en%40googlegroups.com.

[bonnie chen]

check, it is exist in the repo

and then the other user can cherrt-pick at that time

[Luca Milanesio]

On 14 Aug 2024, at 19:02, bonnie chen <bonnie....@gmail.com> wrote:

check, it is exist in the repo

and then the other user can cherrt-pick at that time

Do you still see the “missing unknown” now if you perform a clone or a fetch?

Luca.

To view this discussion on the web visit https://groups.google.com/d/msgid/repo-discuss/3a8324ab-5d25-4741-9d38-1aa6cfe5b5c8n%40googlegroups.com.

[bonnie chen]

After try some times, that user can fetch 

[Luca Milanesio]

On 14 Aug 2024, at 22:21, bonnie chen <bonnie....@gmail.com> wrote:

After try some times, that user can fetch 

It was therefore a temporary hiccup of the JGit cache, it may happen, especially when the repository is over NFS.

Luca.

To view this discussion on the web visit https://groups.google.com/d/msgid/repo-discuss/1694e25e-360b-4b3f-ac1f-59cb378048fan%40googlegroups.com.

[bonnie chen]

Got it, thanks

how about this error

[2024-08-15T13:13:08.507+08:00] [SSH git-upload-pack /tops (jiali.yi)] ERROR com.google.gerrit.sshd.BaseCommand : Internal server error (user jiali.yi account 1000557) during git-upload-pack '/tops'
org.apache.sshd.common.channel.exception.SshChannelClosedException: write(ChannelOutputStream[ChannelSession[id=0, recipient=0]-ServerSessionImpl[jiali.yi@/172.16.11.42:60836]] SSH_MSG_CHANNEL_DATA) len=4 - channel already closed

at org.apache.sshd.common.channel.ChannelOutputStream.write(ChannelOutputStream.java:124)
at org.eclipse.jgit.transport.UploadPack$ResponseBufferedOutputStream.write(UploadPack.java:2397)

at org.eclipse.jgit.transport.PacketLineOut.writePacket(PacketLineOut.java:157)
at org.eclipse.jgit.transport.RefAdvertiser$PacketLineOutRefAdvertiser.advertiseId(RefAdvertiser.java:83)
at org.eclipse.jgit.transport.RefAdvertiser.advertiseAny(RefAdvertiser.java:364)
at org.eclipse.jgit.transport.RefAdvertiser.send(RefAdvertiser.java:311)

at org.eclipse.jgit.transport.UploadPack.sendAdvertisedRefs(UploadPack.java:1536)
at org.eclipse.jgit.transport.UploadPack.sendAdvertisedRefs(UploadPack.java:1469)
at org.eclipse.jgit.transport.UploadPack.service(UploadPack.java:1009)
at org.eclipse.jgit.transport.UploadPack.uploadWithExceptionPropagation(UploadPack.java:838)
at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:752)

at com.google.gerrit.sshd.commands.Upload.runImpl(Upload.java:101)
at com.google.gerrit.sshd.AbstractGitCommand.service(AbstractGitCommand.java:109)
at com.google.gerrit.sshd.AbstractGitCommand$1.run(AbstractGitCommand.java:74)
at com.google.gerrit.sshd.BaseCommand$TaskThunk.run(BaseCommand.java:490)
at com.google.gerrit.server.logging.LoggingContextAwareRunnable.run(LoggingContextAwareRunnable.java:113)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at com.google.gerrit.server.git.WorkQueue$Task.run(WorkQueue.java:612)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)

Suppressed: org.apache.sshd.common.channel.exception.SshChannelClosedException: write(ChannelOutputStream[ChannelSession[id=0, recipient=0]-ServerSessionImpl[jiali.yi@/172.16.11.42:60836]] SSH_MSG_CHANNEL_DATA) len=4 - channel already closed

at org.apache.sshd.common.channel.ChannelOutputStream.write(ChannelOutputStream.java:124)
at org.eclipse.jgit.transport.UploadPack$ResponseBufferedOutputStream.write(UploadPack.java:2397)

at org.eclipse.jgit.transport.PacketLineOut.writePacket(PacketLineOut.java:157)
at org.eclipse.jgit.transport.PacketLineOut.writePacket(PacketLineOut.java:133)
at org.eclipse.jgit.transport.PacketLineOut.writeString(PacketLineOut.java:119)
at org.eclipse.jgit.transport.UploadPack$PackProtocolErrorWriter.writeError(UploadPack.java:2438)

at org.eclipse.jgit.transport.UploadPack.upload(UploadPack.java:770)
... 12 more

"channel already closed "

[Luca Milanesio]

On 14 Aug 2024, at 22:32, bonnie chen <bonnie....@gmail.com> wrote:

Got it, thanks

how about this error

Please do not overload a discussion thread with any possible ERROR you find in the error_log.

Ask specific questions in different discussion threads: this new error has nothing to do with the previous one.

Luca.

To view this discussion on the web visit https://groups.google.com/d/msgid/repo-discuss/76907d39-7906-4fc2-8b93-94f566eaefb6n%40googlegroups.com.

[bonnie chen]

OK，thanks again