Issues running a local buildbot

141 views
Skip to first unread message

ryanbar...@gmail.com

unread,
Feb 1, 2017, 3:18:53 AM2/1/17
to infra-dev
I am trying to run a local buildbot, however, on the bot_update step, it tries to contact chrome-internal. Is there a way to fix this or prevent it from trying to access it? Here is the log:

===Running /usr/bin/python -u /b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py populate --ignore_locks -v --cache-dir /b/c/git_cache https://chrome-internal.googlesource.com/chrome/src-internal.git (attempt #4)===
In directory: /b/c/b/win_chrome
running "git config gc.autodetach 0" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config remote.origin.url https://chrome-internal.googlesource.com/chrome/src-internal.git" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
WARNING: The Git cache is corrupt.
running "git init --bare" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
Initialized empty Git repository in /b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal/
running "git config gc.autodetach 0" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
running "git config remote.origin.url https://chrome-internal.googlesource.com/chrome/src-internal.git" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal"
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmpW0c6znchrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
Traceback (most recent call last):
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 785, in <module>
sys.exit(main(sys.argv[1:]))
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 780, in main
return dispatcher.execute(OptionParser(), argv)
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/subcommand.py", line 252, in execute
return command(parser, args[1:])
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 653, in CMDpopulate
mirror.populate(**kwargs)
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 496, in populate
self._fetch(tempdir or self.mirror_path, verbose, depth)
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 471, in _fetch
raise ClobberNeeded() # Corrupted cache.
__main__.ClobberNeeded
===Failed in 0.5 mins===

Aaron Gable

unread,
Feb 1, 2017, 12:12:38 PM2/1/17
to ryanbar...@gmail.com, infra-dev
Can you provide the exact command you're executing? Based on the snippet of log, it looks like you're trying to do a build of a particular release branch, including the internal dependencies that convert Chromium into Chrome. If you show us exactly what you're doing, we can probably point you at the appropriate wholly-open-source DEPS file to use instead.

--
You received this message because you are subscribed to the Google Groups "infra-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to infra-dev+...@chromium.org.
To post to this group, send email to infr...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-dev/1da13b7f-55e1-4ace-8211-e1172ab36465%40chromium.org.

ryanbar...@gmail.com

unread,
Feb 1, 2017, 3:44:11 PM2/1/17
to infra-dev
I don't know the exact command. Herr is the full log of bot_update:

@@@STEP_CURSOR@bot_update@@@
@@@STEP_STARTED@@@
python -u /b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipe_modules/bot_update/resources/bot_update.py --spec $'cache_dir = \'/b/c/git_cache\'\nsolutions = [{\'deps_file\': \'.DEPS.git\', \'managed\': True, \'name\': \'src\', \'url\': \'https://chromium.googlesource.com/chromium/src.git\'}, {\'custom_deps\': {\'src/chrome/test/data/firefox2_profile/searchplugins\': None, \'src/chrome/test/data/firefox2_searchplugins\': None, \'src/chrome/test/data/firefox3_profile/searchplugins\': None, \'src/chrome/test/data/firefox3_searchplugins\': None, \'src/chrome/test/data/osdd\': None, \'src/chrome/test/data/perf/frame_rate/private\': None, \'src/chrome/test/data/plugin\': None, \'src/chrome/test/data/ssl/certs\': None, \'src/data/autodiscovery\': None, \'src/data/esctf\': None, \'src/data/mach_ports\': None, \'src/data/memory_test\': None, \'src/data/mozilla_js_tests\': None, \'src/data/page_cycler\': None, \'src/data/selenium_core\': None, \'src/data/tab_switching\': None, \'src/tools/grit/grit/test/data\': None, \'src/webkit/data/bmp_decoder\': None, \'src/webkit/data/ico_decoder\': None, \'src/webkit/data/test_shell/plugins\': None, \'src/webkit/data/xbm_decoder\': None}, \'deps_file\': \'.DEPS.git\', \'managed\': True, \'name\': \'src-internal\', \'url\': \'https://chrome-internal.googlesource.com/chrome/src-internal.git\'}]' --patch_root src --revision_mapping_file /tmp/tmp07lJso.json --git-cache-dir /b/c/git_cache --output_json /tmp/tmpk5AMup.json --revision src@ab70c862d2b27087dd382a65a00001c666550cdd --output_manifest
in dir /b/c/b/win_chrome:
allow_subannotations: False
base_name: bot_update
cmd: ['python', '-u', '/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipe_modules/bot_update/resources/bot_update.py', '--spec', "cache_dir = '/b/c/git_cache'\nsolutions = [{'deps_file': '.DEPS.git', 'managed': True, 'name': 'src', 'url': 'https://chromium.googlesource.com/chromium/src.git'}, {'custom_deps': {'src/chrome/test/data/firefox2_profile/searchplugins': None, 'src/chrome/test/data/firefox2_searchplugins': None, 'src/chrome/test/data/firefox3_profile/searchplugins': None, 'src/chrome/test/data/firefox3_searchplugins': None, 'src/chrome/test/data/osdd': None, 'src/chrome/test/data/perf/frame_rate/private': None, 'src/chrome/test/data/plugin': None, 'src/chrome/test/data/ssl/certs': None, 'src/data/autodiscovery': None, 'src/data/esctf': None, 'src/data/mach_ports': None, 'src/data/memory_test': None, 'src/data/mozilla_js_tests': None, 'src/data/page_cycler': None, 'src/data/selenium_core': None, 'src/data/tab_switching': None, 'src/tools/grit/grit/test/data': None, 'src/webkit/data/bmp_decoder': None, 'src/webkit/data/ico_decoder': None, 'src/webkit/data/test_shell/plugins': None, 'src/webkit/data/xbm_decoder': None}, 'deps_file': '.DEPS.git', 'managed': True, 'name': 'src-internal', 'url': 'https://chrome-internal.googlesource.com/chrome/src-internal.git'}]", '--patch_root', 'src', '--revision_mapping_file', '/tmp/tmp07lJso.json', '--git-cache-dir', '/b/c/git_cache', '--output_json', '/tmp/tmpk5AMup.json', '--revision', 'src@ab70c862d2b27087dd382a65a00001c666550cdd', '--output_manifest']
cwd: /b/c/b/win_chrome
env: {'PATH': '%(PATH)s:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/'}
infra_step: True
name: bot_update
nest_level: 0
ok_ret: frozenset([0, 88, 87])
step_test_data: <lambda>(...)
trigger_specs: []
full environment:
BUILDBOT_BLAMELIST: [u'cha...@chromium.org', u'maxb...@chromium.org', u'o...@chromium.org', u'sh...@chromium.org']
BUILDBOT_BRANCH: master
BUILDBOT_BUILDBOTURL: http://192.168.1.18:8215/
BUILDBOT_BUILDERNAME: Google Chrome Win
BUILDBOT_BUILDNUMBER: 3
BUILDBOT_CLOBBER:
BUILDBOT_GOT_REVISION: None
BUILDBOT_MASTERNAME: chromium.chrome
BUILDBOT_REVISION: ab70c862d2b27087dd382a65a00001c666550cdd
BUILDBOT_SCHEDULER: chromium
BUILDBOT_SLAVENAME: build52-m1
CHROME_HEADLESS: 1
GIT_USER_AGENT: linux2 git/1.9.1 RBS-V02-L
HOME: /home/ryanb
LANG: en_US.UTF-8
LOGNAME: root
PAGER: cat
PATH: /home/ryanb/slavebin:/b/depot_tools:/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/
PWD: /b/build/slave/google-chrome-rel-win/build
PYTHONPATH: /b/rr/tmpjKUSJB/rw/checkout/scripts:/b/rr/tmpjKUSJB/rw/checkout/site_config:/b/rr/tmpjKUSJB/rw/checkout/third_party:/b/rr/tmpjKUSJB/rw/checkout/third_party/buildbot_8_4p1:/b/rr/tmpjKUSJB/rw/checkout/third_party/buildbot_slave_8_4:/b/rr/tmpjKUSJB/rw/checkout/third_party/coverage-3.7.1:/b/rr/tmpjKUSJB/rw/checkout/third_party/decorator_3_3_1:/b/rr/tmpjKUSJB/rw/checkout/third_party/google_api_python_client:/b/rr/tmpjKUSJB/rw/checkout/third_party/httplib2/python2:/b/rr/tmpjKUSJB/rw/checkout/third_party/infra_libs:/b/rr/tmpjKUSJB/rw/checkout/third_party/jinja2:/b/rr/tmpjKUSJB/rw/checkout/third_party/markupsafe:/b/rr/tmpjKUSJB/rw/checkout/third_party/mock-1.0.1:/b/rr/tmpjKUSJB/rw/checkout/third_party/oauth2client:/b/rr/tmpjKUSJB/rw/checkout/third_party/pyasn1:/b/rr/tmpjKUSJB/rw/checkout/third_party/pyasn1-modules:/b/rr/tmpjKUSJB/rw/checkout/third_party/python-rsa:/b/rr/tmpjKUSJB/rw/checkout/third_party/requests_2_10_0:/b/rr/tmpjKUSJB/rw/checkout/third_party/setuptools-0.6c11:/b/rr/tmpjKUSJB/rw/checkout/third_party/sqlalchemy_0_7_1:/b/rr/tmpjKUSJB/rw/checkout/third_party/sqlalchemy_migrate_0_7_1:/b/rr/tmpjKUSJB/rw/checkout/third_party/tempita_0_5:/b/rr/tmpjKUSJB/rw/checkout/third_party/twisted_10_2:/b/rr/tmpjKUSJB/rw/checkout/third_party/uritemplate:/b/rr/tmpjKUSJB/rw/checkout/third_party/site-packages:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/recipe_modules/test_results/resources:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/requests:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/six:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/client-py:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/mock-1.0.1:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine/recipe_engine/third_party/astunparse:/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/recipe_engine:/b/build/site_config:/b/build/scripts:/b/build/scripts/release:/b/build/third_party:/b/build/third_party/requests_2_10_0:/b/build_internal/site_config:/b/build_internal/symsrc:/b/build/slave:/b/build/third_party/buildbot_slave_8_4:/b/build/third_party/twisted_10_2:/b/build/slave/google-chrome-rel-win/build:/usr/lib/python2.7:/usr/lib/python2.7/plat-x86_64-linux-gnu:/usr/lib/python2.7/lib-tk:/usr/lib/python2.7/lib-old:/usr/lib/python2.7/lib-dynload
PYTHONUNBUFFERED: 1
SHELL: /bin/bash
TESTING_MASTER_HOST: 192.168.1.18
TESTING_SLAVENAME: build52-m1
USER: root
USERNAME: root

Debugging info:
BUILDER_DIR: '/b/c/b'
CURRENT_DIR: '/b/c/b/win_chrome'
DEPOT_TOOLS_DIR: '/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools'
THIS_DIR: '/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/recipe_modules/bot_update/resources'
Gclient Solutions
=================
src (https://chromium.googlesource.com/chromium/src.git)
Dependencies file is .DEPS.git
Managed mode is OFF

src-internal (https://chrome-internal.googlesource.com/chrome/src-internal.git)
Dependencies file is .DEPS.git
Managed mode is OFF
Custom Dependencies:
src/chrome/test/data/firefox2_profile/searchplugins: Ignore
src/chrome/test/data/firefox2_searchplugins: Ignore
src/chrome/test/data/firefox3_profile/searchplugins: Ignore
src/chrome/test/data/firefox3_searchplugins: Ignore
src/chrome/test/data/osdd: Ignore
src/chrome/test/data/perf/frame_rate/private: Ignore
src/chrome/test/data/plugin: Ignore
src/chrome/test/data/ssl/certs: Ignore
src/data/autodiscovery: Ignore
src/data/esctf: Ignore
src/data/mach_ports: Ignore
src/data/memory_test: Ignore
src/data/mozilla_js_tests: Ignore
src/data/page_cycler: Ignore
src/data/selenium_core: Ignore
src/data/tab_switching: Ignore
src/tools/grit/grit/test/data: Ignore
src/webkit/data/bmp_decoder: Ignore
src/webkit/data/ico_decoder: Ignore
src/webkit/data/test_shell/plugins: Ignore
src/webkit/data/xbm_decoder: Ignore

Revisions: ['src@ab70c862d2b27087dd382a65a00001c666550cdd']
Fetching Git checkout at src@ab70c862d2b27087dd382a65a00001c666550cdd
Checking git version...
===Running git version (attempt #1)===
In directory: /b/c/b/win_chrome
git version 1.9.1
===Succeeded in 0.0 mins===

Using git version 1.9.1
Fetching Git checkout
===Running /usr/bin/python -u /b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py unlock -vv --force --all --cache-dir /b/c/git_cache (attempt #1)===
In directory: /b/c/b/win_chrome
===Succeeded in 0.0 mins===

===Running /usr/bin/python -u /b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py populate --ignore_locks -v --cache-dir /b/c/git_cache https://chromium.googlesource.com/chromium/src.git (attempt #1)===
In directory: /b/c/b/win_chrome
running "git config gc.autodetach 0" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config remote.origin.url https://chromium.googlesource.com/chromium/src.git" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/chromium.googlesource.com-chromium-src"
POST git-upload-pack (964 bytes)
remote: Counting objects: 1
remote: Counting objects: 240511, done
remote: Finding sources: 10% (1/10)
remote: Finding sources: 20% (2/10)
remote: Finding sources: 30% (3/10)
remote: Finding sources: 40% (4/10)
remote: Finding sources: 50% (5/10)
remote: Finding sources: 60% (6/10)
remote: Finding sources: 70% (7/10)
remote: Finding sources: 80% (8/10)
remote: Finding sources: 90% (9/10)
remote: Finding sources: 100% (10/10)
remote: Finding sources: 100% (10/10)
remote: Total 10 (delta 8), reused 10 (delta 8)
From https://chromium.googlesource.com/chromium/src
= [up to date] ignore/bar -> ignore/bar
= [up to date] ignore/foo -> ignore/foo
= [up to date] infra/config -> infra/config
7453182..8346af5 lkcr -> lkcr
= [up to date] lkgr -> lkgr
8206eac..ab70c86 master -> master
===Succeeded in 0.1 mins===

===Running /usr/bin/python -u /b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py exists --quiet --cache-dir /b/c/git_cache https://chromium.googlesource.com/chromium/src.git (attempt #1)===
In directory: /b/c/b/win_chrome
/b/c/git_cache/chromium.googlesource.com-chromium-src
===Succeeded in 0.0 mins===

===Running git remote set-url origin /b/c/git_cache/chromium.googlesource.com-chromium-src (attempt #1)===
In directory: /b/c/b/win_chrome/src
===Succeeded in 0.0 mins===

===Running git fetch origin (attempt #1)===
In directory: /b/c/b/win_chrome/src
From /b/c/git_cache/chromium.googlesource.com-chromium-src
7453182..8346af5 lkcr -> origin/lkcr
8206eac..ab70c86 master -> origin/master
===Succeeded in 0.0 mins===

===Running git checkout --force ab70c862d2b27087dd382a65a00001c666550cdd (attempt #1)===
In directory: /b/c/b/win_chrome/src
Previous HEAD position was a13e604... Identity extension API impl: Split constants into their own file
HEAD is now at ab70c86... Compile audio player with gyp v2.
===Succeeded in 0.1 mins===

===Running git clean -dff (attempt #1)===
In directory: /b/c/b/win_chrome/src
===Succeeded in 0.0 mins===

===Running git log --format=%H --max-count=1 (attempt #1)===
In directory: /b/c/b/win_chrome/src
ab70c862d2b27087dd382a65a00001c666550cdd
===Succeeded in 0.0 mins===

===Running /usr/bin/python -u /b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py populate --ignore_locks -v --cache-dir /b/c/git_cache https://chrome-internal.googlesource.com/chrome/src-internal.git (attempt #1)===
In directory: /b/c/b/win_chrome
running "git config gc.autodetach 0" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config remote.origin.url https://chrome-internal.googlesource.com/chrome/src-internal.git" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal"
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
WARNING: The Git cache is corrupt.
running "git init --bare" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
Initialized empty Git repository in /b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal/
running "git config gc.autodetach 0" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
running "git config gc.autopacklimit 0" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
running "git config core.deltaBaseCacheLimit 2g" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
running "git config remote.origin.url https://chrome-internal.googlesource.com/chrome/src-internal.git" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
running "git config --replace-all remote.origin.fetch +refs/heads/*:refs/heads/* \+refs/heads/\*:.*" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
Fetching +refs/heads/*:refs/heads/*
running "git fetch -v --progress origin +refs/heads/*:refs/heads/*" in "/b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal"
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
fatal: Authentication failed for 'https://chrome-internal.googlesource.com/chrome/src-internal.git/'
WARNING: subprocess '"git" "fetch" "-v" "--progress" "origin" "+refs/heads/*:refs/heads/*"' in /b/c/git_cache/_cache_tmp7qz117chrome--internal.googlesource.com-chrome-src--internal failed; will retry after a short nap...
Traceback (most recent call last):
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 785, in <module>
sys.exit(main(sys.argv[1:]))
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 780, in main
return dispatcher.execute(OptionParser(), argv)
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/subcommand.py", line 252, in execute
return command(parser, args[1:])
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 653, in CMDpopulate
mirror.populate(**kwargs)
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 496, in populate
self._fetch(tempdir or self.mirror_path, verbose, depth)
File "/b/rr/tmpjKUSJB/rw/checkout/scripts/slave/.recipe_deps/depot_tools/git_cache.py", line 471, in _fetch
raise ClobberNeeded() # Corrupted cache.
__main__.ClobberNeeded
===Failed in 0.6 mins===

Ryan Tseng

unread,
Feb 1, 2017, 3:46:18 PM2/1/17
to ryanbar...@gmail.com, infra-dev
Looks like you're trying to run a master.chromium.chrome, which is configured by default to build internal binaries on ToT.  Try running master.chromium instead, which builds chormium binaries on ToT

--
You received this message because you are subscribed to the Google Groups "infra-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to infra-dev+unsubscribe@chromium.org.

To post to this group, send email to infr...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-dev/badddaf6-3894-4708-bf6d-dd34362976de%40chromium.org.

ryanbar...@gmail.com

unread,
Feb 1, 2017, 4:31:55 PM2/1/17
to infra-dev, ryanbar...@gmail.com, hin...@google.com
That fixed that issue, now gclient runhooks is failing on this part:

________ running '/usr/bin/python src/third_party/WebKit/Source/devtools/scripts/local_node/node.py --running-as-hook --version' in '/b/c/b/win_archive'
Fetching https://storage.googleapis.com/chromium-nodejs/4.5.0/node-v4.5.0-linux-x86.tar.gz


Traceback (most recent call last):

File "src/third_party/WebKit/Source/devtools/scripts/local_node/node.py", line 127, in <module>
sys.exit(main())
File "src/third_party/WebKit/Source/devtools/scripts/local_node/node.py", line 123, in main
return subprocess.call([bin_location,] + rest_args)
File "/usr/lib/python2.7/subprocess.py", line 522, in call
return Popen(*popenargs, **kwargs).wait()
File "/usr/lib/python2.7/subprocess.py", line 710, in __init__
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
Error: Command '/usr/bin/python src/third_party/WebKit/Source/devtools/scripts/local_node/node.py --running-as-hook --version' returned non-zero exit status 1 in /b/c/b/win_archive
step returned non-zero exit code: 2
@@@STEP_FAILURE@@@

Aaron Gable

unread,
Feb 1, 2017, 4:35:59 PM2/1/17
to ryanbar...@gmail.com, infra-dev, hin...@google.com
Reading the source of the file referenced in the stack trace (node.py) will give you a sense of what executable it expects to exist on your machine which doesn't. Judging by the url it says it is fetching, I'm guessing it's "tar".

--
You received this message because you are subscribed to the Google Groups "infra-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to infra-dev+...@chromium.org.

To post to this group, send email to infr...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-dev/b32dcfe4-efa9-4ee6-bf43-eca6025620af%40chromium.org.

ryanbar...@gmail.com

unread,
Feb 2, 2017, 10:37:08 PM2/2/17
to infra-dev, ryanbar...@gmail.com, hin...@google.com
I noticed on ensure_goma.ensure installed had an exception. Is there a fix?

[P16453 16:21:32.274 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:32.274 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:32.274 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:32.274 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:34.275 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:34.275 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:34.275 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:34.275 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:36.276 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:36.276 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:36.276 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:36.276 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:38.277 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:38.277 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:38.278 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:38.278 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:40.278 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:40.278 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:40.279 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:40.279 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:42.279 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:42.279 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:42.280 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:42.280 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:44.280 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:44.281 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:44.281 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:44.281 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:46.281 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:46.281 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:46.282 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:46.282 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:48.282 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:48.282 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:48.283 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
[P16453 16:21:48.283 remote.go:95 W] cipd: retrying request to https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module
[P16453 16:21:50.283 service.go:71 W] Failed to load private key JSON - open /creds/service_accounts/service-account-goma-client.json: no such file or directory {"pkg":"auth"}
[P16453 16:21:50.284 auth.go:580 W] Failed to mint a token: invalid service account credentials {"pkg":"auth"}
[P16453 16:21:50.284 remote.go:95 W] cipd: connectivity error (Get https://chrome-infra-packages.appspot.com/_ah/api/repo/v1/instance/resolve?package_name=infra%2Ftools%2Fcloudtail%2Flinux-amd64&version=goma_recipe_module: invalid service account credentials)
Error: request to the backend failed after multiple attempts.
step returned non-zero exit code: 1
@@@STEP_L...@json.output@{@@@
@@@STEP_L...@json.output@ "error": "request to the backend failed after multiple attempts", @@@
@@@STEP_L...@json.output@ "result": null@@@
@@@STEP_L...@json.output@}@@@
@@@STEP_L...@json.output@@@
@@@STEP_EXCEPTION@@@

ryanbar...@gmail.com

unread,
Feb 4, 2017, 4:41:28 PM2/4/17
to infra-dev, ryanbar...@gmail.com
I ran the build again and got another error. It has something to do with logdog.

@@@SEED_STEP remote_run_result@@@

@@@STEP_CURSOR remote_run_result@@@

@@@STEP_STARTED@@@

@@@STEP_CURSOR remote_run_result@@@

@@@STEP_LOG_LINE@exception@Traceback (most recent call last):@@@

@@@STEP_LOG_LINE@exception@ File "../../../scripts/slave/remote_run.py", line 274, in shell_main@@@

@@@STEP_LOG_LINE@exception@ return main(argv, stream)@@@

@@@STEP_LOG_LINE@exception@ File "../../../scripts/slave/remote_run.py", line 236, in main@@@

@@@STEP_LOG_LINE@exception@ recipe_cmd)@@@

@@@STEP_LOG_LINE@exception@ File "/b/b/build/scripts/slave/logdog_bootstrap.py", line 499, in bootstrap@@@

@@@STEP_LOG_LINE@exception@ service_account_json = _get_service_account_json(opts, plat.credential_path)@@@

@@@STEP_LOG_LINE@exception@ File "/b/b/build/scripts/slave/logdog_bootstrap.py", line 318, in _get_service_account_json@@@

@@@STEP_LOG_LINE@exception@ 'Tried: %s' % (credential_path,))@@@

@@@STEP_LOG_LINE@exception@BootstrapError: Could not find service account credentials. Tried: /creds/service_accounts/service-account-luci-logdog-publisher.json@@@

@@@STEP_LOG_END@exception@@@

@@@STEP_EXCEPTION@@@

Reply all
Reply to author
Forward
0 new messages