Gclient fails while running hooks

[Sindhu Madasamy]

Hi all,

I am trying to build the latest version of chromium in a Mac.. Even though I have python (version 3.8.3), it is unable to download the binutils_arm_x86_64_apple_darwin.tgz. It retries to download and fails midstream. Is it python that is causing this issue or something else?

Any idea on how this could be approached?

 gclient sync
Updating depot_tools...
using /var/folders/m1/r4s9xtgx1196x8vsr0l543nc0000gn/T/goma_sindhumadasamy as tmpdir
INFO: creating cache dir (/var/folders/m1/r4s9xtgx1196x8vsr0l543nc0000gn/T/goma_sindhumadasamy/goma_cache).
compiler_proxy is not running
Syncing projects: 100% (132/132), done.
Running hooks:   4% ( 6/134) nacltools
________ running 'python3 src/build/download_nacl_toolchains.py --mode nacl_core_sdk sync --extract' in '/Users/sm/QS/BT/doc/chromium'
INFO: --Syncing nacl_arm_glibc to revision 053185d68ed3b96640f15c4ae457b1ff373c6cac--
INFO: Downloading package archive: binutils_arm_x86_64_apple_darwin.tgz (1/6)
WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (1)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (2)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (3)

WARNING: Failed mid stream.

Error: Command 'python3 src/build/download_nacl_toolchains.py --mode nacl_core_sdk sync --extract' returned non-zero exit status 1 in /Users/sm/QS/BT/doc/chromium
INFO: --Syncing nacl_arm_glibc to revision 053185d68ed3b96640f15c4ae457b1ff373c6cac--
INFO: Downloading package archive: binutils_arm_x86_64_apple_darwin.tgz (1/6)
WARNING: Failed mid stream.


Hook 'python3 src/build/download_nacl_toolchains.py --mode nacl_core_sdk sync --extract' took 111.91 secs

-Sindhu

[Dirk Pranke]

Hi Sindu,

The errors you're seeing are not specific to Python (or, at least I don't think they are).

It looks like you're having networking issues and failing to download some of the larger archives that we need (like the compiler toolchain)

I would try to take the actual command that is running as part of gclient hooks and run it manually outside of `gclient sync`. In other words, run

`python3 src/build/download_nacl_toolchains.py --mode nacl_core_sdk sync --extract` directly and see what happens.

Hope that helps,

-- Dirk

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev
---
You received this message because you are subscribed to the Google Groups "Chromium-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chromium-dev...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/chromium-dev/43e1f03d-131e-41cc-909e-774bb4f25b71n%40chromium.org.

[Dirk Pranke]

No thoughts beyond the idea that you're having some sort of networking issue.

You can avoid building for NaCl and fetching all of the NaCl toolchains by setting the custom variable 'checkout_nacl' to False in the .gclient file in the directory above your src directory, e.g.:

solutions = [
  {
    "name": "src",
    "url": "https://chromium.googlesource.com/chromium/src.git",
    "managed": False,
    "custom_vars": {
      "checkout_nacl": False,
    },
  },
]

That should help, and it will also cause your builds to not compile and link NaCl which can be pretty sizeable difference if you don't need it (and most people don't).

-- Dirk

On Tue, Jan 31, 2023 at 7:42 PM Sindhu Madasamy <sindhu....@gmail.com> wrote:

Hi Dirk,

Thanks for your reply.

While I try to run the stand alone command, the download fails. But now, it points to the package version. Any thoughts on this message.

python3 src/build/download_nacl_toolchains.py --mode nacl_core_sdk sync --extract

INFO: --Syncing nacl_arm_glibc to revision 053185d68ed3b96640f15c4ae457b1ff373c6cac--
INFO: Downloading package archive: binutils_arm_x86_64_apple_darwin.tgz (1/6)
WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (1)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (2)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (3)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, giving up.

package_version: Could not download URL (https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz): No active exception to reraise

-Sindhu

[Sindhu Madasamy]

Hi Dirk,

Thanks for your reply.

While I try to run the stand alone command, the download fails. But now, it points to the package version. Any thoughts on this message.

python3 src/build/download_nacl_toolchains.py --mode nacl_core_sdk sync --extract

INFO: --Syncing nacl_arm_glibc to revision 053185d68ed3b96640f15c4ae457b1ff373c6cac--
INFO: Downloading package archive: binutils_arm_x86_64_apple_darwin.tgz (1/6)
WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (1)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (2)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, retrying... (3)

WARNING: Failed mid stream.

WARNING: Download failed on https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz, giving up.

package_version: Could not download URL (https://storage.googleapis.com/nativeclient-once/object/binutils_arm_x86_64_apple_darwin_b33eac0121acfb07112b84a130824382abab91e2.tgz): No active exception to reraise

-Sindhu

On Tue, Jan 31, 2023 at 2:27 PM Dirk Pranke <dpr...@google.com> wrote:

[Volodymyr Shalashenko]

In my case it was related to SSL: CERTIFICATE_VERIFY_FAILED error. I've ran

$ sudo update-ca-certificates --fresh $ export SSL_CERT_DIR=/etc/ssl/certs

and it solved the problem