First-time gclient sync woes

[Philipp Hancke]

new reclient user here so this might be a first-time setup issue. I followed

  https://chromium.googlesource.com/chromium/src/+/main/docs/linux/build_instructions.md#use-reclient

and my args.gn looks like this:

use_remoteexec = true

rbe_cfg_dir = "../../buildtools/reclient_cfgs/linux"

and my .gclient like this:

solutions = [

  {

    "name": "src",

    "url": "https://chromium.googlesource.com/chromium/src.git",

    "managed": False,

    "custom_deps": {},

    "custom_vars": {

      "download_remoteexec_cfg": True,

      "rbe_instance": "projects/rbe-chromium-untrusted/instances/default_instance",

    },

  },

]

With that I run into an error when I run gclient sync -D:

Running hooks:  51% (96/185) download_and_configure_reclient_cfgs                      

________ running 'python3 src/buildtools/reclient_cfgs/configure_reclient_cfgs.py --rbe_instance projects/rbe-chromium-untrusted/instances/default_instance --reproxy_cfg_template reproxy.cfg.template --rewrapper_cfg_project  --quiet' in '/media/fippo/Chromium/chromium'

log for http://b/304677840: stdout from cipd auth-info: Logged in as 

<... oauth token details removed>

log for http://b/304677840: stderr from cipd auth-info: 

Errors:

  failed to resolve infra_internal/rbe/reclient_cfgs/rbe-chromium-untrusted/chromium-browser-clang@revision/llvmorg-19-init-2941-ga0b3dbaf-22 (line 3): prefix "infra_internal/rbe/reclient_cfgs/rbe-chromium-untrusted/chromium-browser-clang" doesn't exist or "user:mewhohappenstousethesameemail" is not allowed to see it, run `cipd auth-login` to login or relogin

I noticed that "download_remoteexec_cfg" is not what

  https://chromium.googlesource.com/chromium/src/+/main/docs/linux/build_instructions.md#use-reclient

suggests. So I removed that which made gclient sync work again.

But then autoninja refused to work and suggested adding download_remoteexec_cfg set to true.

Which at least explains where this is coming from. After re-adding that I get the same gclient error however.

This looks like an issue with access to the "remote exec config" download?

Any suggestions for what I can try next?

cheers

Philipp

[Philipp Wollermann]

Hi Philipp,

The "download_remoteexec_cfg" custom var is only meant to be used by Googlers logged in with their @google.com account on their corporate machine.

It downloads a special set of reclient configs that we need to use in that case. All other users don't need to care about this and can just use the configs that are checked into the chromium repository.

I hope we can remove that mechanism soon, as it's a maintenance headache for us. 😅

May I ask where you initially read about that flag, as I can't see it in the docs you pointed out? If we accidentally mislead folks by mentioning it in the public docs, I'd like to remove it there.

Could you post the full error message that you get when you remove it from your .gclient file, rerun "gclient sync -D" and then start a build with autoninja?

Cheers,

Philipp

--
You received this message because you are subscribed to the Google Groups "reclient-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to reclient-user...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/reclient-users/CADxkKiK%3DP5yTMog55J__xzKF02M6i4uJn5ROkOYrgXf6P3Q98w%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "chrome-build-team" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chrome-build-t...@google.com.
To view this discussion on the web visit https://groups.google.com/a/google.com/d/msgid/chrome-build-team/CADxkKiK%3DP5yTMog55J__xzKF02M6i4uJn5ROkOYrgXf6P3Q98w%40mail.gmail.com.

[Philipp Hancke]

Hi Philipp!

Am Mo., 15. Apr. 2024 um 23:30 Uhr schrieb Philipp Wollermann <phi...@google.com>:

Hi Philipp,

The "download_remoteexec_cfg" custom var is only meant to be used by Googlers logged in with their @google.com account on their corporate machine.

It downloads a special set of reclient configs that we need to use in that case. All other users don't need to care about this and can just use the configs that are checked into the chromium repository.

I hope we can remove that mechanism soon, as it's a maintenance headache for us. 😅

May I ask where you initially read about that flag, as I can't see it in the docs you pointed out? If we accidentally mislead folks by mentioning it in the public docs, I'd like to remove it there.

I did not get it from the docs. But...

 

Could you post the full error message that you get when you remove it from your .gclient file, rerun "gclient sync -D" and then start a build with autoninja?

without the flag gclient sync worked but autoninja -C out/Default showed this error message:

  Build is configured to use reclient but necessary binaries or config files can't be found.

  Please check if `"download_remoteexec_cfg": True` custom var is set in `.gclient`, and run `gclient sync`.

which, for non-googlers is the wrong thing to do?

I then checked that the path ../../buildtools/reclient_cfgs/linux/ exists which it did.

Now searching for the error message got me further:

  https://source.chromium.org/chromium/chromium/tools/depot_tools/+/main:reclient_helper.py;l=318

Logging reclient_bin_dir and reclient_cfg showed that my reclient_bin_dir was pointing to a webrtc checkout which did *not* have the same gclient arguments and hence never downloaded the build configs?

Adding a "If you are a Googler" warning and logging both variables might help the next person running into this!

Now the root cause for this was that my environment had CHROMIUM_BUILDTOOLS_PATH point to that checkout because I occasionally use it to run lcov and that is resolved by gclient_paths.GetBuildtoolsPath()

Unsetting that variable made it work and it is blazingly fast!

Thank you very much for pointing me in the right direction (or telling me these are areas I am not supposed to go to :-))!

cheers

Philipp