speeding up repo sync over ssh

439 views
Skip to first unread message

Shawn Pearce

unread,
Apr 10, 2009, 10:14:18 PM4/10/09
to repo-discuss
I just posted a patch for repo
(https://review.source.android.com/9507) that can cut the time for a
no-op (no new changes) sync of AOSP (via SSH) on my desktop from 60s
to 17s.

Unfortunately, if your SSH daemon is Gerrit it also triggers a
protocol incompatibility between the OpenSSH command line client and
the Gerrit SSH daemon; the client spews state machine errors. The
sync appears to go through correctly, but the state machine errors
give me some pause because I can't be 100% sure that the two sides
haven't gotten out of sync and somehow crossed data streams. So the
patch is on the back-burner until I can fix the SSH daemon.

But... repo sync is going to get faster. Soon.

:-)

Marcelo

unread,
Apr 10, 2009, 10:18:45 PM4/10/09
to repo-d...@googlegroups.com
On Fri, Apr 10, 2009 at 20:14, Shawn Pearce <s...@google.com> wrote:

> I just posted a patch for repo
> (https://review.source.android.com/9507) that can cut the time for a
> no-op (no new changes) sync of AOSP (via SSH) on my desktop from 60s
> to 17s.

Am I getting this right? You maintain two manifests, one with git://
and one with ssh:// acess methods?

I have been toying with that idea in my mind for our project, but I
was trying to figure out a way of not repeating myself... do you have
such a thing?

Marcelo

Shawn Pearce

unread,
Apr 10, 2009, 11:40:32 PM4/10/09
to repo-d...@googlegroups.com
On Fri, Apr 10, 2009 at 19:18, Marcelo <marcelo....@gmail.com> wrote:
>
> On Fri, Apr 10, 2009 at 20:14, Shawn Pearce <s...@google.com> wrote:
>
>> I just posted a patch for repo
>> (https://review.source.android.com/9507) that can cut the time for a
>> no-op (no new changes) sync of AOSP (via SSH) on my desktop from 60s
>> to 17s.
>
> Am I getting this right?  You maintain two manifests, one with git://
> and one with ssh:// acess methods?

Yes.

Sometimes people use a url.insteadof in their ~/.gitconfig to rewrite
the AOSP git://android.git.kernel.org/ URLs to a local mirror, rather
than edit the manifest. I prefer just editing the manifest. In the
specific case I was testing against today, its an SSH based mirror of
AOSP, within Google.

Reply all
Reply to author
Forward
0 new messages