Getting Chromium source code on Linux error:WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=2g" "clone" "--no-checkout" "--progress" "https://chromium.googlesource.com/chromium/src.git"...failed; will retry after a short nap...

1,473 views
Skip to first unread message

weimin xiao

unread,
Mar 12, 2015, 3:01:05 AM3/12/15
to chromi...@chromium.org
Hello,
I try to Build Chromium on my server, system: Ubuntu LTS 14.04, and pptpsetup a VPN(Because I'm in China...) here is what I do on remote SecureCRT:

1.create a new folder:Chromium_src_20150311
2.$ cd Chromium_src_20150311
4.$ export PATH=$PATH:/path/to/depot_tools
5.$ git config --global user.name "..."
$ git config --global user.email "...@email.com"
$ git config --global core.autocrlf false
$ git config --global core.filemode false
6.$ fetch chromium

Then error comes:

19:21:42.594720 pkt-line.c:46           packet:   fetch-pack< \2Finding sources:  99% (4515/4560)   \15
19:21:42.598025 pkt-line.c:46           packet:   fetch-pack< \2Finding sources: 100% (4560/4560)   \15
19:21:42.598097 pkt-line.c:46           packet:   fetch-pack< \2Finding sources: 100% (4560/4560)
remote: Finding sources: 100% (4560/4560)
19:21:42.601755 run-command.c:351       trace: run_command: 'index-pack' '--stdin' '-v' '--fix-thin' '--keep=fetch-pack 16141 on ubuntu' '--check-self-contained-and-connected' '--pack_header=2,3494878'
19:21:42.602349 exec_cmd.c:129          trace: exec: 'git' 'index-pack' '--stdin' '-v' '--fix-thin' '--keep=fetch-pack 16141 on ubuntu' '--check-self-contained-and-connected' '--pack_header=2,3494878'
19:21:42.604484 git.c:346               trace: built-in: git 'index-pack' '--stdin' '-v' '--fix-thin' '--keep=fetch-pack 16141 on ubuntu' '--check-self-contained-and-connected' '--pack_header=2,3494878'
* GnuTLS recv error (-9): A TLS packet with unexpected length was received.
* Closing connection 0
error: RPC failed; result=56, HTTP code = 200
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

Then I run $ gclient sync

error comes as:

xiaowm@ubuntu:~/chromium_src_20150311$ gclient sync
14:11:04.374733 git.c:346               trace: built-in: git 'config' '--get' 'remote.origin.url'
14:11:04.377728 git.c:346               trace: built-in: git 'config' 'remote.origin.fetch'

[0:01:00] Still working on:
[0:01:00]   src

[0:01:10] Still working on:
[0:01:10]   src

[0:01:20] Still working on:
[0:01:20]   src

...
[0:30:00] Still working on:
[0:30:00]   src

[0:30:10] Still working on:
[0:30:10]   src

[0:30:20] Still working on:
[0:30:20]   src
WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=2g" "clone" "--no-checkout" "--progress" "https://chromium.googlesource.com/chromium/src.git" "/home/xiaowm/chromium_src_20150311/_gclient_src_2j1ict"' in /home/xiaowm/chromium_src_20150311 failed; will retry after a short nap...

[0:30:30] Still working on:
[0:30:30]   src

[0:30:40] Still working on:
[0:30:40]   src

...

[1:51:49] Receiving objects:  22% (779055/3496801), 205.19 MiB | 18.00 KiB/s   
[1:51:50] * GnuTLS recv error (-9): A TLS packet with unexpected length was received.
[1:51:50] * Closing connection 0
[1:51:50] error: RPC failed; result=56, HTTP code = 200
[1:51:50] fatal: The remote end hung up unexpectedly
[1:51:50] fatal: early EOF
[1:51:50] fatal: index-pack failed
Traceback (most recent call last):
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_scm.py", line 905, in _Clone
    self._Run(clone_cmd, options, cwd=self._root_dir, retry=True)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_scm.py", line 1159, in _Run
    gclient_utils.CheckCallAndFilterAndHeader(cmd, env=env, **kwargs)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_utils.py", line 293, in CheckCallAndFilterAndHeader
    return CheckCallAndFilter(args, **kwargs)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_utils.py", line 538, in CheckCallAndFilter
    rv, args, kwargs.get('cwd', None), None, None)
CalledProcessError: Command git -c core.deltaBaseCacheLimit=2g clone --no-checkout --progress https://chromium.googlesource.com/chromium/src.git /home/xiaowm/chromium_src_20150311/_gclient_src_qHkNHi returned non-zero exit status 128 in /home/xiaowm/chromium_src_20150311
----------------------------------------
Traceback (most recent call last):
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient.py", line 2300, in <module>
    sys.exit(main(sys.argv[1:]))
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient.py", line 2286, in main
    return dispatcher.execute(OptionParser(), argv)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/subcommand.py", line 245, in execute
    return command(parser, args[1:])
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient.py", line 2043, in CMDsync
    ret = client.RunOnDeps('update', args)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient.py", line 1520, in RunOnDeps
    work_queue.flush(revision_overrides, command, args, options=self._options)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_utils.py", line 1027, in run
    self.item.run(*self.args, **self.kwargs)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient.py", line 832, in run
    file_list)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_scm.py", line 162, in RunCommand
    return getattr(self, command)(options, args, file_list)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_scm.py", line 412, in update
    self._Clone(revision, url, options)
  File "/home/xiaowm/chromium_src_20150311/depot_tools/gclient_scm.py", line 913, in _Clone
    if os.listdir(tmp_dir):
OSError: [Errno 2] No such file or directory: '/home/xiaowm/chromium_src_20150311/_gclient_src_qHkNHi'



Thanks very much for any advice.

Sylvain Defresne

unread,
Mar 12, 2015, 4:55:56 AM3/12/15
to min...@gmail.com, chromi...@chromium.org
It looks like the remote server close the connection while you are cloning some of third party repository.

This can happen for multiple reasons (server issue, poor connectivity, transient network error). If you don't care about having the whole history, you can try to pass --no-history flag to fetch command to do shallow git clones.

$ fetch chromium --no-history

Hope this helps,
-- Sylvain

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev

Andrey

unread,
Mar 12, 2015, 10:57:02 AM3/12/15
to chromi...@chromium.org
Thanks very much for any advice.
This is normal. Repeat gclient sync until it succeeds:
until gclient sync; do sleep 1; done
The rest depends on your machine internet reliability. It do can take more than the universe life time, if it is not good enough. If you can download 1Gb successfully 50% of the time, you will need about 100Gb of traffic. If you can download only 500Mb successfully 50% of the time, you will need 4Tb of traffic. If it less reliable than that, you don't want to know.

PS Does --no-history affect child repositories? It is not the main repository that is the largest one.

-- Andrey Khalyavin

Primiano Tucci

unread,
Mar 13, 2015, 4:24:25 PM3/13/15
to haly...@chromium.org, Chromium-dev
>PS Does --no-history affect child repositories? It is not the main repository that is the largest one.

Yes

--

weimin xiao

unread,
Mar 19, 2015, 3:55:35 AM3/19/15
to chromi...@chromium.org, min...@gmail.com
Thanks for you advice. And I successfully checkout the src, but there is the error:

First, In /src/ directory ,I run # ./build/install-build-deps.sh , then no error happens.
Second, I run  # gclient runhooks , also no error.
Third, # ninja -C our/Debug chrome , completed!

at last , # out/Debug/chrome ,and error is here:
$ out/Debug/chrome
[23009:23009:0319/155322:FATAL:browser_main_loop.cc(169)] Running without the SUID sandbox! See https://code.google.com/p/chromium/wiki/LinuxSUIDSandboxDevelopment for more information on developing with the sandbox on.
#0 0x7f0bb8fa954e base::debug::StackTrace::StackTrace()
#1 0x7f0bb9001035 logging::LogMessage::~LogMessage()
#2 0x7f0bc0e1a004 content::(anonymous namespace)::SetupSandbox()
#3 0x7f0bc0e198f9 content::BrowserMainLoop::EarlyInitialization()
#4 0x7f0bc0e26e74 content::BrowserMainRunnerImpl::Initialize()
#5 0x7f0bc0e189ff content::BrowserMain()
#6 0x7f0bc0c8553f content::RunNamedProcessTypeMain()
#7 0x7f0bc0c87ad2 content::ContentMainRunnerImpl::Run()
#8 0x7f0bc0c84af5 content::ContentMain()
#9 0x7f0bc68c7212 ChromeMain
#10 0x7f0bc68c71c2 main
#11 0x7f0bb0012ec5 __libc_start_main
#12 0x7f0bc68c70a4 <unknown>

Aborted (core dumped)

I also try $ out/Debug/chrome --no-sandbox
$ out/Debug/chrome --disable-setuid-sandbox
and there is error code.

Thanks very much for your help~~

Sylvain Defresne於 2015年3月12日星期四 UTC+8下午4時55分56秒寫道:

Sylvain Defresne

unread,
Mar 19, 2015, 4:20:03 AM3/19/15
to min...@gmail.com, chromi...@chromium.org
It is recommended that you use the SUID helper on Linux as documented here: https://code.google.com/p/chromium/wiki/LinuxSUIDSandboxDevelopment

You can install it following the following steps:

In most cases, you can run build/update-linux-sandbox.sh and it'll install the proper sandbox for you in /usr/local/sbin and tell you to update your .bashrc if needed.


-- Sylvain

weimin xiao

unread,
Mar 19, 2015, 4:43:51 AM3/19/15
to chromi...@chromium.org, min...@gmail.com
It is my fault, running chromium with # out/Debug/chrome --no-sandbox    should be on the machine,not form remote control.
And problem solved.
Thanks for everyone!!!

weimin xiao於 2015年3月19日星期四 UTC+8下午3時55分35秒寫道:
Reply all
Reply to author
Forward
0 new messages