fetch gives me "core.deltaBaseCacheLimit=512m"

1,139 views
Skip to first unread message

Kevin Luty

unread,
Sep 15, 2014, 5:34:02 PM9/15/14
to chromi...@chromium.org
I'm looking for what to try next after trying to build chromium on Windows 7 x64 using non-Cygwin.

So I'm following this and I've gotten to Step 3.

my PATH is:
C:\Users\kevlut\Documents\GitHub\depot_tools


In cmd.exe (Admin), after calling:
fetch --nohooks chromium

A folder, "_gclient_src_xgjzme", is created at path and eventually, I get this:

[0:38:50] Still working on:
[0:38:50]   src
WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=512m" "fetch" "origin
' in C:\Users\kevlut\Documents\GitHub\depot_tools\src failed; will retry after
 short nap...
WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=512m" "fetch" "origin
' in C:\Users\kevlut\Documents\GitHub\depot_tools\src failed; will retry after
 short nap...
WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=512m" "fetch" "origin
' in C:\Users\kevlut\Documents\GitHub\depot_tools\src failed; will retry after
 short nap...
[0:39:00] Still working on:
[0:39:00]   src
WARNING: subprocess '"git" "-c" "core.deltaBaseCacheLimit=512m" "fetch" "origin
' in C:\Users\kevlut\Documents\GitHub\depot_tools\src failed; will retry after
 short nap...
[0:39:10] Still working on:
[0:39:10]   src

I don't see any "src" folder in depot_tools.

I then notice "_bad_scm" folder is created and placed inside my PATH.  Then it seems it tries to fetch again instead of taking a nap because I also see a "_gclient_src_lbkjvr" folder created in PATH. 

I looked for a "deltaBaseCacheLimit" setting in my .git folder+files but I do not see it.  Maybe I'm looking in the wrong place.  

Every time it "fails" the size of "_bad_scm" is ~2.52 GB.  This is my 6th time trying.  It'll usually fail twice before I have to restart it (call fetch --nohooks chromium again).  After the second time I see a "src" folder with nothing but a ".git" folder inside of it.

For what its worth, here is my depot_tools/.git/config:
[core]
repositoryformatversion = 0
filemode = false
bare = false
logallrefupdates = true
symlinks = false
ignorecase = true
hideDotFiles = dotGitOnly
[remote "origin"]
url = https://chromium.googlesource.com/chromium/tools/depot_tools.git
fetch = +refs/heads/*:refs/remotes/origin/*
[branch "master"]
remote = origin
merge = refs/heads/master

depot_tools/.gclient:
solutions = [{u'managed': False, u'name': u'src', u'url': u'https://chromium.googlesource.com/chromium/src.git', u'custom_deps': {}, u'deps_file': u'.DEPS.git', u'safesync_url': u''}]

 

Kevin Luty

unread,
Sep 15, 2014, 6:11:59 PM9/15/14
to chromi...@chromium.org
Here is the message after the second time fails:

[1:21:08] Resolving deltas:  99% (2462998/2463093)
[1:21:08] Resolving deltas: 100% (2463093/2463093)
[1:21:17] remote: Total 3133658 (delta 2462198), reused 3133019 (delta 2462198)
[1:21:18] Checking connectivity... done.
[1:21:18] fatal: Not a git repository (or any of the parent directories): .git
[1:21:19] fatal: Not a git repository (or any of the parent directories): .git
[1:21:20] fatal: Not a git repository (or any of the parent directories): .git
[1:21:22] fatal: Not a git repository (or any of the parent directories): .git
----------------------------------------
Error: Command git -c core.deltaBaseCacheLimit=512m fetch origin returned non-ze
ro exit status 128 in C:\Users\kevlut\Documents\GitHub\depot_tools\src

Warnings:
Conflicting directory C:\Users\kevlut\Documents\GitHub\depot_tools\src moved to
C:\Users\kevlut\Documents\GitHub\depot_tools\_bad_scm\srcopjtbd.
Traceback (most recent call last):
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\\fetch.py", line 317, in <m
odule>
    sys.exit(main())
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\\fetch.py", line 313, in ma
in
    return run(options, spec, root)
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\\fetch.py", line 307, in ru
n
    return checkout.init()
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\\fetch.py", line 122, in in
it
    self.run_gclient(*sync_cmd)
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\\fetch.py", line 76, in run
_gclient
    return self.run(cmd_prefix + cmd, **kwargs)
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\\fetch.py", line 66, in run
    return subprocess.check_call(cmd, **kwargs)
  File "C:\Users\kevlut\Documents\GitHub\depot_tools\python276_bin\lib\subproces
s.py", line 540, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '('C:\\Users\\kevlut\\Documents\\GitHub\\
depot_tools\\python276_bin\\python.exe', 'C:\\Users\\kevlut\\Documents\\GitHub\\
depot_tools\\gclient.py', 'sync', '--nohooks')' returned non-zero exit status 1

Scott Graham

unread,
Sep 15, 2014, 6:14:48 PM9/15/14
to kevi...@gmail.com, chromium-dev
It isn't intended that you fetch inside depot_tools, normally src and depot_tools would be siblings. I don't know if that's causing your errors though.

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev

Kevin Luty

unread,
Sep 15, 2014, 6:16:54 PM9/15/14
to chromi...@chromium.org
And here is the git config
C:\Users\kevlut\Documents\GitHub\depot_tools>git config --list
 
core.symlinks=false
core.autocrlf=false
core.fscache=true
core.preloadindex=true
color.diff=auto
color.status=auto
color.branch=auto
color.interactive=true
pack.packsizelimit=2g
help.format=html
help.htmlpathalt=..\man\html
http.sslcainfo=/bin/curl-ca-bundle.crt
sendemail.smtpserver=/bin/msmtp.exe
diff.astextplain.textconv=astextplain
rebase.autosquash=true
core.repositoryformatversion=0
core.filemode=false
core.bare=false
core.logallrefupdates=true
core.symlinks=false
core.ignorecase=true
core.hidedotfiles=dotGitOnly
remote.origin.url=https://chromium.googlesource.com/chromium/tools/depot_tools.g
it
remote.origin.fetch=+refs/heads/*:refs/remotes/origin/*
branch.master.remote=origin
branch.master.merge=refs/heads/master

On Monday, September 15, 2014 4:34:02 PM UTC-5, Kevin Luty wrote:
On Monday, September 15, 2014 4:34:02 PM UTC-5, Kevin Luty wrote:
On Monday, September 15, 2014 4:34:02 PM UTC-5, Kevin Luty wrote:

Kevin Luty

unread,
Sep 15, 2014, 6:18:29 PM9/15/14
to chromi...@chromium.org, kevi...@gmail.com
Going to extract depot_tools again and try this.

Primiano Tucci

unread,
Sep 15, 2014, 6:38:48 PM9/15/14
to Kevin Luty, Chromium-dev

this is probably due to a flaky network connection.
try fetch --no-history chromium, should reduce drastically the checkout size

Sasha Bermeister

unread,
Sep 16, 2014, 1:26:01 PM9/16/14
to prim...@chromium.org, Kevin Luty, Chromium-dev
You could also just try:

$ cd chromium

Then create a .gclient file yourself containing something like:
solutions = [{u'managed': False, u'name': u'src', u'url': u'https://chromium.googlesource.com/chromium/src.git', u'custom_deps': {}, u'deps_file': u'.DEPS.git', u'safesync_url': u''}]

Then just run the sync to update all the submodules:
$ cd src
$ gclient sync

Breaking it into steps this way might just help prevent you from starting all over again whenever it fails :)

Sasha

Primiano Tucci

unread,
Sep 16, 2014, 1:40:08 PM9/16/14
to Sasha Bermeister, Kevin Luty, Chromium-dev
This is precisely what "fetch chromium" does. Why that would reduce the number of failures? 
Once fetch chromium fails, you can just gclient sync to retry and fetch the subproject that failed.

Stefan Zager

unread,
Sep 16, 2014, 1:56:13 PM9/16/14
to Primiano Tucci, Sasha Bermeister, Kevin Luty, Chromium-dev
On Tue, Sep 16, 2014 at 10:39 AM, Primiano Tucci <prim...@chromium.org> wrote:
> This is precisely what "fetch chromium" does. Why that would reduce the
> number of failures?
> Once fetch chromium fails, you can just gclient sync to retry and fetch the
> subproject that failed.

Running git directly from the shell prompt may reveal the underlying
problem. 'fetch' and 'gclient' may be hiding terminal spew coming
from the underlying git process.
Reply all
Reply to author
Forward
0 new messages