gclient sync hangs when directly checking out from source tree without bootstrapping tarball

1,648 views
Skip to first unread message

Stephen Cheng

unread,
Apr 30, 2013, 5:09:17 PM4/30/13
to chromi...@chromium.org
I am trying to check out the source code of Chromium 26.0.1410.64. Here is the procedure I followed:
 
1. Create a folder named d:\chromium_root
2. Created a .gclient file under this folder. The content is shown below:
 
solutions = [
  { "name"        : "26.0.1410.64",
    "url"         : "https://src.chromium.org/chrome/releases/26.0.1410.64",
    "deps_file"   : "DEPS",
    "managed"     : True,
 "custom_deps": {     
  "src/third_party/WebKit/LayoutTests": None,
  "src/content/test/data/layout_tests/LayoutTests": None,
  "src/chrome/tools/test/reference_build/chrome_win": None,
  "src/chrome_frame/tools/test/reference_build/chrome_win": None,
  "src/chrome/tools/test/reference_build/chrome_linux": None,
  "src/chrome/tools/test/reference_build/chrome_mac": None,
  "src/third_party/hunspell_dictionaries": None,
 },
    "safesync_url": "",
  },
]
 
3. run "svn ls https://src.chromium.org/chrome" from the chromium_root folder.
4. run "gclient sync".
 
After I issue the last command, it starts to download the source code. But the process hangs within a few seconds. If I use ctrl+c to break it, I got the following traceback output:
 
src/third_party/xulrunner-sdk: 26.0.1410.64, src
src/third_party/yasm/binaries: 26.0.1410.64, src
src/third_party/yasm/source/patched-yasm: 26.0.1410.64, src
src/tools/deps2git: 26.0.1410.64, src
src/tools/grit: 26.0.1410.64, src
src/tools/gyp: 26.0.1410.64, src
src/tools/page_cycler/acid3: 26.0.1410.64, src
src/tools/swarm_client: 26.0.1410.64, src
src/v8: 26.0.1410.64, src
src/webkit/media/crypto/ppapi/cdm: 26.0.1410.64, src
Traceback (most recent call last):
  File "d:\chromium\depot_tools\\gclient.py", line 1787, in <module>
    sys.exit(Main(sys.argv[1:]))
  File "d:\chromium\depot_tools\\gclient.py", line 1776, in Main
    return command(parser, argv[1:])
  File "d:\chromium\depot_tools\\gclient.py", line 1548, in CMDsync
    return client.RunOnDeps('update', args)
  File "d:\chromium\depot_tools\\gclient.py", line 1125, in RunOnDeps
    work_queue.flush(revision_overrides, command, args, options=self._options)
  File "d:\chromium\depot_tools\gclient_utils.py", line 591, in flush
    self.ready_cond.wait(10)
  File "d:\chromium\depot_tools\python_bin\lib\threading.py", line 256, in wait
    _sleep(delay)
KeyboardInterrupt
 
On the other hand, if I download the big tar ball and start checkout from there, I can update to the latest green release using safesync_url https://commondatastorage.googleapis.com/chromium-browser-continuous/Win/LAST_CHANGE .
 
 
 

Xiyuan Xia

unread,
Apr 30, 2013, 5:17:43 PM4/30/13
to flas...@gmail.com, chromium-dev
I hit similar problem trying to pull M26. And gclient is waiting for me to enter a svn password for "blink". Found that out using "gclient -j1". 


 
 
 

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
 
 
 

Message has been deleted

Stephen Cheng

unread,
May 1, 2013, 10:10:46 PM5/1/13
to chromi...@chromium.org, flas...@gmail.com, xiy...@google.com
I tried m27 and m28. They all hangs when running gclient sync. The svn.exe process is hanging. I used the -j1 option as well but I don't see anywhere it is asking me for a password.
 
I also tried checking out the latest version in the trunk without using the tar ball. That worked well.

Xiyuan Xia

unread,
May 2, 2013, 1:40:21 AM5/2/13
to Stephen Cheng, chromium-dev
Have you tried 'svn ls --username your_us...@chromium.org svn://svn.chromium.org/blink/' and see if it succeeds? If that works for you, then the problem might be with the pdf check out. Try to comment out the 'src/pdf' entry in the M26 DEPS. 
Message has been deleted

Rik Cabanier

unread,
May 2, 2013, 12:49:52 PM5/2/13
to flas...@gmail.com, chromi...@chromium.org, xiy...@google.com
I have the same problem on my pc. 3 out of 4 sync's "fetch blink" just hangs or aborts.
It works fine on my mac though.
Message has been deleted

Stephen Cheng

unread,
May 3, 2013, 1:08:14 AM5/3/13
to chromi...@chromium.org, flas...@gmail.com, xiy...@google.com
I believe there is some bug in the svn.exe client on Windows when it interacts with the svn server where the release repository is hosted. The hanging is pretty random. It can hang at different file each time. If I kill svn.exe and attempt to sync again, I will be told to do svn cleanup. I have to manually remove some svn log files and then do the svn cleanup. After that, the checkout process will continue to run. But it will hang again within a minute. If I do this again and again, I believe I can eventually get it to check out completely. Since it hangs so frequently, that will probably take me a whole day or longer to check out the whole beast.
 
I have already disabled Norton antivirus and Windows file indexing. So it'd be safe to exclude these factors.
 
I ended up checking out the source tree on Mac first. Then I copy the entire source tree from Mac to Windows. After that, I run "gclient sync" from there. Since the Windows source tree and Mac source tree shares the majority of the stuff, it's a much better starting point. I still get about 5 hangs starting from this point. But that's manageable. At the end, I have obtained a fully-synced version of V27 release. 

Dragomir Goranov

unread,
Mar 4, 2014, 8:01:44 PM3/4/14
to chromi...@chromium.org
I have a similar problem. I am on Windows7 I am trying to checkout the source code of Chromium 30.0.1599.101. I follow this procedure:

2. set GYP_GENERATORS=msvs-ninja,ninja
4. gclient sync
This step fails with the following error:
Checked out revision 227552.
Error: Command svn checkout http://gsutil.googlecode.com/svn/trunk/src@263 G:\CHROMIUM\build\third_party\gsutil --revision 263 --non-interactive --ignore-externals returned non-zero exit status 1 in G:\CHROMIUM

I am not a committer, is it possible that this error is somehow connected to that?
What is the correct way to checkout and compile an older version of Chromium?

Marc-Antoine Ruel

unread,
Mar 10, 2014, 1:26:31 PM3/10/14
to dragomir...@gmail.com, chromium-dev
It is because this external subversion repository was removed. You can ask gclient to skip it with a modification in your .gclient file;

solutions = [
{
 ...
 'custom_deps': {
   'src/third_party/gsutil': None,
 },
]

Then fetch gsutil manually.

M-A



--

Dragomir Goranov

unread,
Mar 10, 2014, 2:17:12 PM3/10/14
to Marc-Antoine Ruel, chromium-dev
Thank you very much - this was the problem and now everything is OK :)
I am much obliged!
Reply all
Reply to author
Forward
0 new messages