gclient sync in old version is not working

[Juan Carlos Gutiérrez Barquero]

I'm following the steps here(https://www.chromium.org/developers/how-tos/get-the-code/working-with-release-branches) in order to get the sources for the chromium v37.

After running: gclient sync --with_branch_heads --jobs 16

I'm getting the following error:

src/buildtools (ERROR)

----------------------------------------

[0:00:00] Started.

----------------------------------------

Error: Command git checkout --quiet 10a5251e71445a832953f1374bbbbe60ad019144 returned non-zero exit status 128 in /Applications/chromium/src/buildtools

fatal: reference is not a tree: 10a5251e71445a832953f1374bbbbe60ad019144

Or sometimes stops at:

src/media/cdm/ppapi/api (ERROR)

----------------------------------------

[0:00:00] Started.

----------------------------------------

Error: Command git checkout --quiet 400ae69a79d6b8b531c6960d0558d13cde600879 returned non-zero exit status 128 in /Applications/chromium/src/media/cdm/ppapi/api

fatal: reference is not a tree: 400ae69a79d6b8b531c6960d0558d13cde600879

Or

Error: Command git checkout --quiet 6b1759c3816d574bddde3e1725c51a811c8870e7 returned non-zero exit status 128 in /Applications/chromium/src/buildtools

fatal: reference is not a tree: 6b1759c3816d574bddde3e1725c51a811c8870e7

I already tried by running: rm -rf src/third_party/WebKit , but didn't work.

Please help.

[Primiano Tucci]

Can you paste the full list of commands you are using. What are you trying to check out? a release branch or tag? How are you doing that?

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev

[Juan Carlos Gutiérrez Barquero]

On Wednesday, April 1, 2015 at 8:11:02 AM UTC-6, Primiano Tucci wrote:

Can you paste the full list of commands you are using. What are you trying to check out? a release branch or tag? How are you doing that?

I'm trying to get the tag 37.0.2062.99, so I ran: 

git fetch --tags

git checkout -b mybranch 37.0.2062.99

 Both commands ran without errors/warnings

[Michael Moss]

Both of those commits seem valid:

https://chromium.googlesource.com/chromium/buildtools.git/+/10a5251e71445a832953f1374bbbbe60ad019144

https://chromium.googlesource.com/chromium/cdm.git/+/400ae69a79d6b8b531c6960d0558d13cde600879

so I'm not sure why they would be failing in your local checkout. Maybe run 'gclient sync --with_branch_heads --jobs 1 --verbose --force' to see if the extra output might give a clue.

[Juan Carlos Gutiérrez Barquero]

Here is the full log after running that command:

solutions = [

  {

    "managed": False,

    "name": "src",

    "url": "https://chromium.googlesource.com/chromium/src.git",

    "custom_deps": {},

    "deps_file": ".DEPS.git",

    "safesync_url": "",

  },

]

src (Elapsed: 0:00:00)

----------------------------------------

[0:00:00] Started.

_____ src at refs/remotes/origin/master

[0:00:00] ________ unmanaged solution; skipping src

[0:00:00] Finished.

----------------------------------------

build (Elapsed: 0:00:00)

----------------------------------------

[0:00:00] Started.

_____ build at 92e739ce86728eeba5fd494b21bc8cbc6deb322e

________ running 'git reset --hard HEAD' in '/Applications/chromium/build'

[0:00:01] HEAD is now at 92e739c Remove master.chromium.gpu's old gatekeeper code.

[0:00:01] Up-to-date; skipping checkout.

Checked out revision 92e739ce86728eeba5fd494b21bc8cbc6deb322e

[0:00:01] Finished.

----------------------------------------

build/scripts/command_wrapper/bin (Elapsed: 0:00:00)

----------------------------------------

[0:00:01] Started.

_____ build/scripts/command_wrapper/bin at 2eeebba9a512cae9e4e9312f5ec728dbdad80bd0

________ running 'git reset --hard HEAD' in '/Applications/chromium/build/scripts/command_wrapper/bin'

[0:00:01] HEAD is now at 2eeebba Write retry text to stderr so stdout is clean for real output from gsutil.

[0:00:01] Up-to-date; skipping checkout.

Checked out revision 2eeebba9a512cae9e4e9312f5ec728dbdad80bd0

[0:00:01] Finished.

----------------------------------------

build/scripts/gsd_generate_index (Elapsed: 0:00:00)

----------------------------------------

[0:00:01] Started.

_____ build/scripts/gsd_generate_index at d2f5d5a5d212d8fb337d751c0351644a6ac83ac8

________ running 'git reset --hard HEAD' in '/Applications/chromium/build/scripts/gsd_generate_index'

[0:00:01] HEAD is now at d2f5d5a Fix GenerateIndex for gsutil directories by stripping colon off directory names.

[0:00:01] Up-to-date; skipping checkout.

Checked out revision d2f5d5a5d212d8fb337d751c0351644a6ac83ac8

[0:00:01] Finished.

----------------------------------------

build/scripts/private/data/reliability (Elapsed: 0:00:00)

----------------------------------------

[0:00:01] Started.

_____ build/scripts/private/data/reliability at 90d6f258a2fbff583dcfc107ab1727bd8efe65e8

________ running 'git reset --hard HEAD' in '/Applications/chromium/build/scripts/private/data/reliability'

[0:00:01] HEAD is now at 90d6f25 Rename RenderViewHostManager to RenderFrameHostManager.

[0:00:01] Up-to-date; skipping checkout.

Checked out revision 90d6f258a2fbff583dcfc107ab1727bd8efe65e8

[0:00:01] Finished.

----------------------------------------

build/scripts/tools/deps2git (Elapsed: 0:00:00)

----------------------------------------

[0:00:01] Started.

_____ build/scripts/tools/deps2git at f04828eb0b5acd3e7ad983c024870f17f17b06d9

________ running 'git reset --hard HEAD' in '/Applications/chromium/build/scripts/tools/deps2git'

[0:00:01] HEAD is now at f04828e First step in cleaning up pefile hack.

[0:00:01] Up-to-date; skipping checkout.

Checked out revision f04828eb0b5acd3e7ad983c024870f17f17b06d9

[0:00:01] Finished.

----------------------------------------

build/third_party/lighttpd (Elapsed: 0:00:00)

----------------------------------------

[0:00:01] Started.

_____ build/third_party/lighttpd at 9dfa55d15937a688a92cbf2b7a8621b0927d06eb

________ running 'git reset --hard HEAD' in '/Applications/chromium/build/third_party/lighttpd'

[0:00:01] HEAD is now at 9dfa55d Add missing mac mods.

[0:00:01] Up-to-date; skipping checkout.

Checked out revision 9dfa55d15937a688a92cbf2b7a8621b0927d06eb

[0:00:01] Finished.

----------------------------------------

depot_tools (Elapsed: 0:00:00)

----------------------------------------

[0:00:01] Started.

_____ depot_tools at 2b7d3ed286d03877e910d76dafe0e4668c5cc971

________ running 'git reset --hard HEAD' in '/Applications/chromium/depot_tools'

[0:00:02] HEAD is now at 2b7d3ed Allow gclient sync to overwrite untracked files when moving detached git HEAD.

[0:00:02] Up-to-date; skipping checkout.

Checked out revision 2b7d3ed286d03877e910d76dafe0e4668c5cc971

[0:00:02] Finished.

----------------------------------------

src/breakpad/src (Elapsed: 0:00:00)

----------------------------------------

[0:00:02] Started.

_____ src/breakpad/src at 64dfc4d07c1b247ae69e1d4317f49950e399b9e9

________ running 'git reset --hard HEAD' in '/Applications/chromium/src/breakpad/src'

[0:00:02] HEAD is now at 64dfc4d Use PAGE_MAX_SIZE. PAGE_SIZE is now a variable size.

[0:00:02] Up-to-date; skipping checkout.

Checked out revision 64dfc4d07c1b247ae69e1d4317f49950e399b9e9

[0:00:02] Finished.

----------------------------------------

src/buildtools (ERROR)

----------------------------------------

[0:00:02] Started.

_____ src/buildtools at 10a5251e71445a832953f1374bbbbe60ad019144

[0:00:03] Fetching origin

________ running 'git -c core.deltaBaseCacheLimit=2g fetch origin --verbose' in '/Applications/chromium/src/buildtools'

[0:00:03] From https://chromium.googlesource.com/chromium/buildtools

[0:00:03]  = [up to date]      master     -> origin/master

________ running 'git reset --hard HEAD' in '/Applications/chromium/src/buildtools'

[0:00:03] HEAD is now at 3b302fe Roll GN to #321178.

----------------------------------------

Error: Command git checkout --quiet 10a5251e71445a832953f1374bbbbe60ad019144 returned non-zero exit status 128 in /Applications/chromium/src/buildtools

fatal: reference is not a tree: 10a5251e71445a832953f1374bbbbe60ad019144

[Michael Moss]

Maybe your 'buildtools' checkout is corrupt. You can 'git fsck' that dir to see if it complains, or just delete it and try the sync again.

[Juan Carlos Gutiérrez Barquero]

I followed a hunch and started to delete (e.g. rm -rf tools/gyp/) those conflictive folders and retry. After a about 20 deletions (of different folders) and retry, finally the syncing stage went well, however at the end I'm getting this error:

running '/usr/bin/python src/build/gyp_chromium' in '/Applications/chromium'

Updating projects from gyp files...

gyp: /Applications/chromium/src/third_party/google_toolbox_for_mac/google_toolbox_for_mac.gyp not found (cwd: /Applications/chromium)

Error: Command /usr/bin/python src/build/gyp_chromium returned non-zero exit status 1 in /Applications/chromium

Any further help?

[Thiago Farina]

On Wed, Apr 1, 2015 at 7:26 PM, Juan Carlos Gutiérrez Barquero <ju...@mediarain.com.ni> wrote:

I followed a hunch and started to delete (e.g. rm -rf tools/gyp/) those conflictive folders and retry. After a about 20 deletions (of different folders) and retry, finally the syncing stage went well, however at the end I'm getting this error:

running '/usr/bin/python src/build/gyp_chromium' in '/Applications/chromium'

Updating projects from gyp files...

gyp: /Applications/chromium/src/third_party/google_toolbox_for_mac/google_toolbox_for_mac.gyp not found (cwd: /Applications/chromium)

So it didn't sync well. gclient sync should get that for you. 

Are you in a slow, unstable network?

Checking out Chromium requires a good bandwidth. 

--

Thiago Farina

[Juan Carlos Gutiérrez Barquero]

I deleted that folder and retried, but got the exact same error " /Applications/chromium/src/third_party/google_toolbox_for_mac/google_toolbox_for_mac.gyp not found ", is there other way to get that file so I can copy/paste it manually?

Here is the full log, in case you think is necessary:

Syncing projects: 100% (86/86), done.                                                               

________ running '/usr/bin/python src/build/download_nacl_toolchains.py --exclude arm_trusted' in '/Applications/chromium'

________ running '/usr/bin/python src/build/linux/install-arm-sysroot.py --linux-only' in '/Applications/chromium'

________ running '/usr/bin/python src/chrome/installer/linux/sysroot_scripts/install-debian.wheezy.sysroot.py --linux-only --arch=amd64' in '/Applications/chromium'

________ running '/usr/bin/python src/chrome/installer/linux/sysroot_scripts/install-debian.wheezy.sysroot.py --linux-only --arch=i386' in '/Applications/chromium'

________ running '/usr/bin/python src/tools/clang/scripts/update.py --if-needed' in '/Applications/chromium'

Clang already at 209387-8

________ running '/usr/bin/python src/build/vs_toolchain.py update' in '/Applications/chromium'

________ running '/usr/bin/python src/build/util/lastchange.py -o src/build/util/LASTCHANGE' in '/Applications/chromium'

________ running '/usr/bin/python src/build/util/lastchange.py -s src/third_party/WebKit -o src/build/util/LASTCHANGE.blink' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=win32 --no_auth --bucket chromium-gn -s src/buildtools/win/gn.exe.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=darwin --no_auth --bucket chromium-gn -s src/buildtools/mac/gn.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=linux* --no_auth --bucket chromium-gn -s src/buildtools/linux32/gn.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=linux* --no_auth --bucket chromium-gn -s src/buildtools/linux64/gn.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=win32 --no_auth --bucket chromium-gn -s src/tools/gn/bin/win/gn.exe.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=darwin --no_auth --bucket chromium-gn -s src/tools/gn/bin/mac/gn.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=linux* --no_auth --bucket chromium-gn -s src/tools/gn/bin/linux/gn.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=linux* --no_auth --bucket chromium-gn -s src/tools/gn/bin/linux/gn32.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=win32 --no_auth --bucket chromium-clang-format -s src/third_party/clang_format/bin/win/clang-format.exe.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=darwin --no_auth --bucket chromium-clang-format -s src/third_party/clang_format/bin/mac/clang-format.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=linux* --no_auth --bucket chromium-clang-format -s src/third_party/clang_format/bin/linux/clang-format.sha1' in '/Applications/chromium'

________ running '/usr/bin/python src/third_party/binutils/download.py' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=linux* --no_auth --bucket chromium-eu-strip -s src/build/linux/bin/eu-strip.sha1' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=win32 --no_auth --bucket chromium-drmemory -s src/third_party/drmemory/drmemory-windows-sfx.exe.sha1' in '/Applications/chromium'

________ running '/usr/bin/python src/build/get_syzygy_binaries.py --output-dir=src/third_party/syzygy/binaries --revision=b08fb72610963d31cc3eae33f746a04e263bd860 --overwrite' in '/Applications/chromium'

________ running 'download_from_google_storage --no_resume --platform=win32 --directory --recursive --no_auth --num_threads=16 --bucket chromium-apache-win32 src/third_party/apache-win32' in '/Applications/chromium'

________ running '/usr/bin/python src/build/gyp_chromium' in '/Applications/chromium'

Updating projects from gyp files...

gyp: /Applications/chromium/src/third_party/google_toolbox_for_mac/google_toolbox_for_mac.gyp not found (cwd: /Applications/chromium)

Error: Command /usr/bin/python src/build/gyp_chromium returned non-zero exit status 1 in /Applications/chromium

Hook '/usr/bin/python src/build/gyp_chromium' took 20.89 secs

[Thiago Farina]

How are you checking out chromium? `fetch chromium`? Other way? Is this the first time you are trying? What `git status` says?

--

--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev

--

Thiago Farina

[Juan Carlos Gutiérrez Barquero]

On Mon, Apr 6, 2015 at 3:30 PM, Thiago Farina <tfa...@chromium.org> wrote:

How are you checking out chromium? `fetch chromium`? Other way? Is this the first time you are trying? What `git status` says?

Here is what I got after git status:

Changes not staged for commit:

  (use "git add/rm <file>..." to update what will be committed)

  (use "git checkout -- <file>..." to discard changes in working directory)

deleted:    third_party/google_toolbox_for_mac/LICENSE

deleted:    third_party/google_toolbox_for_mac/OWNERS

deleted:    third_party/google_toolbox_for_mac/README.chromium

deleted:    third_party/google_toolbox_for_mac/google_toolbox_for_mac.gyp

Untracked files:

  (use "git add <file>..." to include in what will be committed)

.landmines

third_party/boringssl/

third_party/crashpad/

third_party/dom_distiller_js/dist/

third_party/py_trace_event/

So I ran:

Juans-iMac:src jgutix$ git checkout -- third_party/google_toolbox_for_mac/LICENSE

Juans-iMac:src jgutix$ git checkout -- third_party/google_toolbox_for_mac/OWNERS

Juans-iMac:src jgutix$ git checkout -- third_party/google_toolbox_for_mac/README.chromium

Juans-iMac:src jgutix$ git checkout -- third_party/google_toolbox_for_mac/google_toolbox_for_mac.gyp

Now the syncing seems to go all the way to the final, but got these messages:

WARNING: 'src/third_party/dom_distiller_js/dist' is no longer part of this client.  It is recommended that you manually remove it.

WARNING: 'src/third_party/crashpad/crashpad' is no longer part of this client.  It is recommended that you manually remove it.

WARNING: 'src/third_party/py_trace_event/src' is no longer part of this client.  It is recommended that you manually remove it.

WARNING: 'src/third_party/boringssl/src' is no longer part of this client.  It is recommended that you manually remove it.

Now it goes without errors.

So thank you so much for your help.

--

..............................................

JUAN CARLOS GUTIERREZ

..............................................

Software developer

..............................................

RAIN / mediarain.com.ni

..............................................

NI / (505) 8988-1102

..............................................

NEW YORK / UTAH / NICARAGUA

[Juan Carlos Gutiérrez Barquero]

I want to thank you again for all of your help. Now that I got the code, I'll be trying to do the next tasks:

* Default to a specific URL.

* Hide or remove all browser controls (back button, navigation bar,menus, etc.)

* Default to a full screen mode or prompt to allow a full screen mode as allowed by the operating system

Any suggestion/documentation on how to get that done will be very appreciated. Also if any of them are not possible to do, let me know.

Thank you so much.

[Kenneth Strickland]

Juan, looking at your tasks.

I'd like to recommend the chromium embedded framework created by Marshall Greenblatt.

https://bitbucket.org/chromiumembedded/cef 

Using the CEF3, your tasks will be a lot easier and the code base much smaller and manageable.

Just my two cents...

[Giang Nguyen]

I've had these same problems over the past few days on Linux (Ubuntu 14.10 if that matters), trying with 3-4 of the latest stable release branches 41.0.2272.118 down to 40.0.2214.115. I've worked with release branches numerous times in the last month, so it's probably not a rookie mistake (I even tried a fresh chromium fetch, from scratch).
The directory/repository that failed was not deterministic: running the same command after one failure would result in the failure with a different directory.
After reading what worked for Juan, I started deleting whatever directory that failed (e.g., src/buildtools, src/third_party/mesa/src, src/gyp, etc.), and finally it's now happy. At least I hope so -- the gclient sync --with_branch_heads --jobs 16 command now runs to completion.

[Juan Carlos Gutiérrez Barquero]

Thanks for the suggestion +Kenneth Strickland, I think it would be a good way, but I have to ask to my boss first.

For now, I'm trying to overcome the first task (custom default url) with an extension, planning to later embed that extension as a default app (default_apps: http://www.chromium.org/developers/design-documents/extensions/how-the-extension-system-works/default-apps), however when I load the extension I'm getting two errors:

'chrome_settings_overrides' is not allowed for specified platform.

Unrecognized property 'bookmarks_ui' of manifest key 'chrome_ui_overrides'.

Here is the manifest I'm using:

{

  "manifest_version": 2,

  "name": "Certiport chromium customisation",

  "description": "This extension customise Chrome including homepage, etc",

  "version": "1.0",

  "chrome_settings_overrides": {

    "homepage": "http://example.com",

    "startup_pages": ["http://example.com"]

  },

  "chrome_ui_overrides" : {

    "bookmarks_ui": {

      "remove_button": "true",

      "remove_bookmark_shortcut": "true"

    }

  }

}

Extensions

Any idea?

[何洪亮]

Key word: shallow clone vs clone

project buildtools is a shallow clone, turn it to complete clone,otherwise some commit history can not be found in you local.

step by step:

1,cd src/buildtools

2,git fetch --unshallow

在 2015年4月1日星期三 UTC+8上午2:47:14，Juan Carlos Gutiérrez Barquero写道：

[Christian Biesinger]

FWIW, that is not the default. Did you use --no-history when running fetch the first time?

-Christian