Hang in downloading buildtools/mac/gn.sha1

83 views
Skip to first unread message

Avi Drissman

unread,
Apr 25, 2017, 12:09:14 PM4/25/17
to Chromium-dev
I'm trying to "gclient sync" and I keep getting a hang:

/V/s/c/src ((cebcfd84a5f1...))> gclient sync 
Syncing projects:  95% (69/72) src/third_party/swiftshader/third_party/pnacl-sub
Syncing projects:  97% (70/72) src/third_party/skia                             Syncing projects: 100% (72/72), done.                            

________ running '/usr/bin/python src/build/landmines.py' in '/Volumes/src/chrome-git'

[...]

________ running '/usr/bin/python src/tools/clang/scripts/update.py --if-needed' in '/Volumes/src/chrome-git'
Updating Clang to 300839-1...
Clang is already up to date.

________ running '/usr/bin/python src/build/util/lastchange.py -o src/build/util/LASTCHANGE' in '/Volumes/src/chrome-git'

________ running '/usr/bin/python src/build/util/lastchange.py -m SKIA_COMMIT_HASH -s src/third_party/skia --header src/skia/ext/skia_commit_hash.h' in '/Volumes/src/chrome-git'

________ running 'download_from_google_storage --no_resume --platform=win32 --no_auth --bucket chromium-gn -s src/buildtools/win/gn.exe.sha1' in '/Volumes/src/chrome-git'
The current platform doesn't match "win32", skipping.

________ running 'download_from_google_storage --no_resume --platform=darwin --no_auth --bucket chromium-gn -s src/buildtools/mac/gn.sha1' in '/Volumes/src/chrome-git'
[hang]

Any suggestions for diagnosing this?

Thanks!

Avi

Primiano Tucci

unread,
Apr 25, 2017, 12:14:02 PM4/25/17
to a...@google.com, Chromium-dev
What happens if you:

1) gsutil.py stat gs://chromium-gn/b8db422af70c716836c579dad9153c687ab54f7c
2) gsutil.py cp gs://chromium-gn/b8db422af70c716836c579dad9153c687ab54f7c /tmp/foo
3) download_from_google_storage --no_resume --platform=darwin --no_auth --bucket chromium-gn -s src/buildtools/mac/gn.sha1

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/CACWgwAZ_rPKccVxKMLY2Y6WbZzWQ%2BKcVm%3DE8HU3dMyigfRJksQ%40mail.gmail.com.

Avi Drissman

unread,
Apr 25, 2017, 12:19:36 PM4/25/17
to Primiano Tucci, Chromium-dev
Apologies.

This hung last night overnight, and hung this morning right before I sent this email, but of course now that I sent the email it works great.

Thank you anyway.

Avi

Avi Drissman

unread,
May 2, 2017, 11:05:20 AM5/2/17
to Primiano Tucci, Chromium-dev
It's hanging again on a different file, always on that one file (src/v8/test/fuzzer/wasm.tar.gz.sha1 this time). When I do that first diagnostic step of statting that gs:// bucket, it hangs:

/V/s/c/src (dialog-trunk) [1]> 
gsutil.py stat gs://chromium-gn/b8db422af70c716836c579dad9153c687ab54f7c
^CCaught signal 2 - exiting
Traceback (most recent call last):
  File "/Users/avi/bin/depot_tools/gsutil.py", line 160, in <module>
Your "Oauth 2.0 User Account" credentials are invalid. For more help, see "gsutil help creds", or re-run the gsutil config command (see "gsutil help config").
    sys.exit(main())
  File "/Users/avi/bin/depot_tools/gsutil.py", line 157, in main
    clean=args.clean)
  File "/Users/avi/bin/depot_tools/gsutil.py", line 130, in run_gsutil
    return subprocess.call(cmd)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 522, in call
    return Popen(*popenargs, **kwargs).wait()
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1384, in wait
    pid, sts = _eintr_retry_call(os.waitpid, self.pid, 0)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 476, in _eintr_retry_call
    return func(*args)
KeyboardInterrupt

Ryan Tseng

unread,
May 2, 2017, 4:09:31 PM5/2/17
to Avi Drissman, Primiano Tucci, Chromium-dev
What version of depot_tools are you running?

To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev+unsubscribe@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/CACWgwAYpPOOPbSkNPdRJgPxoe1ygYFYViSTdPwdKa5po%2B8fNzA%40mail.gmail.com.

Avi Drissman

unread,
May 2, 2017, 4:13:27 PM5/2/17
to Ryan Tseng, Primiano Tucci, Chromium-dev
So again it magically started working after a few hours.

When I do git log in the depot_tools folder, it's e0a1afbf4b0d41b10d9eb1463835647024eb25bc.

Leonard Grey

unread,
May 2, 2017, 5:19:18 PM5/2/17
to Avi Drissman, Ryan Tseng, Primiano Tucci, Chromium-dev
I'm having the same issue as Avi, also with wasm.tar.gz.sha1

Same hash for depot_tools

Primiano Tucci

unread,
May 3, 2017, 7:10:33 AM5/3/17
to Leonard Grey, Avi Drissman, Ryan Tseng, Chromium-dev, infr...@chromium.org
Your "Oauth 2.0 User Account" credentials are invalid. For more help, see "gsutil help creds", or re-run the gsutil config command (see "gsutil help config").
is a bit suspicious. Did you see that only when hitting CTRL-C  or did show up before? Does it show consistently when failing?

avi@ if it happens again can you plz run this time:
gsutil.py -DD stat gs://chromium-gn/b8db422af70c716836c579dad9153c687ab54f7c
(note the -DD)
and attach the output to a RVG crbug?
That will spit out all the debugging X- headers which contain link to the backend traces (But also your Oauth2 bearer, hence mind the RVG)

To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.

Avi Drissman

unread,
May 3, 2017, 11:34:51 AM5/3/17
to Primiano Tucci, Leonard Grey, Ryan Tseng, Chromium-dev, infr...@chromium.org
No, it would just silently hang. I only saw that line when I used control-C. Plus, it was only jamming on one specific file. Surely that one file wasn't looking for a specific credential different from the others.

I'll keep an eye out for it happening again and will run that line for you.

Thank you for your help in this.

Avi

To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev+unsubscribe@chromium.org.

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.

Avi Drissman

unread,
May 17, 2017, 1:13:36 PM5/17/17
to Primiano Tucci, Leonard Grey, Ryan Tseng, Chromium-dev, infr...@chromium.org
It's happening again. http://crbug.com/723733
Reply all
Reply to author
Forward
0 new messages