Hello,
I'd like to cross compile my team's test target (`chrome/updater:updater_tests`) for Windows from my M1 mac. I'm able to run the build locally but can't get it to use `remote_exec=true`. I don't have any issues with remoteexec for native builds. Does anyone have any idea what my issue is?
I've tried:
- Ran `update_depot_tools` and `gclient sync`. GN args and `../.gclient` are attached below.
- Deleted `./out/<build>/.reproxy_tmp` as well as `../.reproxy_cache/*`
Also included error messages and logs below.
Thanks,
Felipe
gn args:
# Set build arguments here. See `gn help buildargs`.
use_remoteexec=true
target_os="win"
is_component_build=false
../.gclient:
solutions = [
{
"name": "src",
"url": "https://chromium.googlesource.com/chromium/src.git",
"managed": False,
"custom_deps": {},
"custom_vars": {
"download_remoteexec_cfg": True,
"checkout_src_internal": True,
"checkout_telemetry_dependencies": "False",
},
},
]
target_os = ['win', 'linux']
end of terminal output from `autoninja -C out/<build> chrome/updater:updater_tests`
stderr:
reclient[ae0333e0-5610-416a-9405-0a978af511b8]: LocalErrorResultStatus: this build has encountered too many local fallbacks. This means that the ratio of actions that failed remotely is equal to or above the preconfigured threshold of 50.0%
build failed
1m01.60s Build Failure: 782 done 80 failed 13155 remaining - 12.69/s
1 steps failed: reproxy error: reproxy error LOCAL_ERROR: exit=35: this build has encountered too many local fallbacks. This means that the ratio of actions that failed remotely is equal to or above the preconfigured threshold of 50.0%
see ./out/Win/siso_output for full command line and output
or ./out/Win/siso.INFO
use ./out/Win/siso_failed_commands.sh to re-run failed commands
RBE Stats: down 620.05 KB, up 18.77 KB, 28 cache hits, 433 racing locals, 8 racing remotes, 880 local failures
./out/<build>/.reproxy_logs/metricsuploader.log.ERROR:
Log file created at: 2025/03/13 12:23:55
Running on machine: fpazos-macbookpro
Binary: Built with gc go1.23.1 X:nocoverageredesign for darwin/arm64
Previous log: <none>
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E0313 12:23:55.063009 27592 monitoring.go:208] Failed to export to Stackdriver: ResourceExhausted rpc error: code = ResourceExhausted desc = Errors during metric descriptor creation: {(metric: custom.googleapis.com/opencensus/go.chromium.org/rbe/build/latency, error: Request throttled. You have hit the per-project limit on metric definition or label definition changes per minute. This issue should resolve itself within a few minutes.)}.
./out/<build>/.reproxy_tmp/reproxy.log.ERROR (abridged)
---
2 E0313 12:23:52.194273 26353 server.go:551] 593ff953-d273-4727-a13e-53344150015f: Execution f ailed with &{ExitCode:35 Status:LocalErrorResultStatus Err:this build has encountered too many local fallbacks. This means that the ratio of actions that failed remotely is equal to or abo ve the preconfigured threshold of 50.0%}
---
1 E0313 12:23:52.197351 26353 server.go:551] 82112b27-cef2-4ca5-81b9-2236ae2aa910: Execution f ailed with &{ExitCode:-1 Status:NonZeroExitResultStatus Err:<nil>}
----
E0313 12:23:54.329330 26353 depsscannerclient.go:66] depsscannerclient stderr: E20250313 12:23:01.676009 1854697472 cxx_compiler_type_specific.cc:25] 1a1273bd-a57a-42a2-bbd7-63c0dd675bb0 multiple inputs? 0
E20250313 12:23:01.676517 1848963072 scandeps.cc:164] GomaIPService encountered the following error processing a command: "multiple inputs are not supported."; Command: [/Users/fpazos/workspace/chromium/src/third_party/llvm-build/Release+Asserts/bin/clang-cl /c /nologo /showIncludes:user /winsysroot../../third_party/depot_tools/win_toolchain/vs_files/7393122652 -DDCHECK_ALWAYS_ON=1 -DUSE_AURA=1 -DCR_CLANG_REVISION="llvmorg-21-init-1655-g7b473dfe-1" -D_LIBCPP_HARDENING_MODE=_LIBCPP_HARDENING_MODE_EXTENSIVE -D_LIBCPP_DISABLE_VISIBILITY_ANNOTATIONS -D_LIBCPP_INSTRUMENTED_WITH_ASAN=0 -DCR_LIBCXX_REVISION=4f05e20cbe1d02fa0871ac88b30eead9e38cab3a -DTMP_REBUILD_HACK -D__STD_C -D_CRT_RAND_S -D_CRT_SECURE_NO_DEPRECATE -D_SCL_SECURE_NO_DEPRECATE -D_ATL_NO_OPENGL -D_WINDOWS -DCERT_CHAIN_PARA_HAS_EXTRA_FIELDS -DPSAPI_VERSION=2 -DWIN32 -D_SECURE_ATL -DWINAPI_FAMILY=WINAPI_FAMILY_DESKTOP_APP -DWIN32_LEAN_AND_MEAN -DNOMINMAX -D_UNICODE -DUNICODE -DNTDDI_VERSION=NTDDI_WIN10_NI -D_WIN32_WINNT=0x0A00 -DWINVER=0x0A00 -D_DEBUG -DDYNAMIC_ANNOTATIONS_ENABLED=1 -D_CRT_NONSTDC_NO_WARNINGS -D_WINSOCK_DEPRECATED_NO_WARNINGS -DPACKAGE_STRING="860492290f7d1f25e2bd45da6471bfd4cd4d7add" -DPACKAGE_VERSION="860492290f7d1f25e2bd45da6471bfd4cd4d7add" -DHAVE_CONFIG_H -DOPENSSL -DGCM -DHAVE_STDLIB_H -DHAVE_STRING_H -DHAVE_STDINT_H -DHAVE_INTTYPES_H -DHAVE_INT16_T -DHAVE_INT32_T -DHAVE_INT8_T -DHAVE_UINT16_T -DHAVE_UINT32_T -DHAVE_UINT64_T -DHAVE_UINT8_T -DHAVE_WINSOCK2_H -I../.. -Igen -I../../buildtools/third_party/libc++ -I../../third_party/libsrtp -I../../third_party/libsrtp/config -I../../third_party/libsrtp/include -I../../third_party/libsrtp/crypto/include -I../../third_party/boringssl/src/include -fno-delete-null-pointer-checks /clang:-fno-strict-overflow -fno-ident -fcolor-diagnostics -fmerge-all-constants /Zc:sizedDealloc- -fcrash-diagnostics-dir=../../tools/clang/crashreports -mllvm -instcombine-lower-dbg-declare=0 -mllvm -split-threshold-for-reg-with-hint=0 /clang:-ffp-contract=off -fcomplete-member-pointers /Gy /FS /bigobj /utf-8 /Zc:twoPhase -ffile-reproducible /D__WRL_ENABLE_FUNCTION_STATICS__ -fmsc-version=1934 --target=x86_64-windows -msse3 /Brepro -Wno-builtin-macro-redefined -D__DATE__= -D__TIME__= -D__TIMESTAMP__= -ffile-compilation-dir=. -no-canonical-prefixes -ftrivial-auto-var-init=pattern /Od /Ob0 /GF /Z7 -gno-codeview-command-line -gcodeview-ghash -gomit-unreferenced-methods -Xclang -fuse-ctor-homing /guard:cf,nochecks /MTd -Wheader-hygiene -Wstring-conversion -Wtautological-overlap-compare -Xclang -add-plugin -Xclang find-bad-constructs -Xclang -plugin-arg-find-bad-constructs -Xclang span-ctor-from-string-literal -Xclang -plugin-arg-find-bad-constructs -Xclang raw-ref-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang raw-span-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang check-stack-allocated -Xclang -add-plugin -Xclang raw-ptr-plugin -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-to-stack-allocated -Xclang -plugin-arg-raw-ptr-plugin -Xclang disable-check-raw-ptr-to-stack-allocated-error -Xclang -plugin-arg-raw-ptr-plugin -Xclang raw-ptr-exclude-path=../../third_party/dawn/ -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-span-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ref-fields -DUNSAFE_BUFFERS_BUILD -Xclang -add-plugin -Xclang unsafe-buffers -Xclang -plugin-arg-unsafe-buffers -Xclang ../../build/config/unsafe_buffers_paths.txt /W3 /wd4800 /wd4267 -Wno-unused-variable -Wno-c++11-narrowing -Wno-unused-but-set-variable -Wno-misleading-indentation -Wno-missing-field-initializers -Wno-unused-parameter -Wno-psabi -Wloop-analysis -Wno-unneeded-internal-declaration -Wno-nonportable-include-path -Wno-cast-function-type -Wno-thread-safety-reference-return -Wno-nontrivial-memcall /WX /wd4018 /std:c11 /TC /Foobj/third_party/libsrtp/libsrtp/aes_icm_ossl.obj /Fdobj/third_party/libsrtp/libsrtp_c.pdb -Qunused-arguments /Users/fpazos/workspace/chromium/src/third_party/libsrtp/crypto/cipher/aes_icm_ossl.c ]
E20250313 12:23:03.274748 1854697472 cxx_compiler_type_specific.cc:25] 560a81ee-cee6-420c-aa16-eb7aa8b0a07f multiple inputs? 0
E20250313 12:23:03.275034 1848963072 scandeps.cc:164] GomaIPService encountered the following error processing a command: "multiple inputs are not supported."; Command: [/Users/fpazos/workspace/chromium/src/third_party/llvm-build/Release+Asserts/bin/clang-cl /c /nologo /showIncludes:user /winsysroot../../third_party/depot_tools/win_toolchain/vs_files/7393122652 -DDCHECK_ALWAYS_ON=1 -DUSE_AURA=1 -DCR_CLANG_REVISION="llvmorg-21-init-1655-g7b473dfe-1" -D_LIBCPP_HARDENING_MODE=_LIBCPP_HARDENING_MODE_EXTENSIVE -D_LIBCPP_DISABLE_VISIBILITY_ANNOTATIONS -D_LIBCPP_INSTRUMENTED_WITH_ASAN=0 -DCR_LIBCXX_REVISION=4f05e20cbe1d02fa0871ac88b30eead9e38cab3a -DTMP_REBUILD_HACK -D__STD_C -D_CRT_RAND_S -D_CRT_SECURE_NO_DEPRECATE -D_SCL_SECURE_NO_DEPRECATE -D_ATL_NO_OPENGL -D_WINDOWS -DCERT_CHAIN_PARA_HAS_EXTRA_FIELDS -DPSAPI_VERSION=2 -DWIN32 -D_SECURE_ATL -DWINAPI_FAMILY=WINAPI_FAMILY_DESKTOP_APP -DWIN32_LEAN_AND_MEAN -DNOMINMAX -D_UNICODE -DUNICODE -DNTDDI_VERSION=NTDDI_WIN10_NI -D_WIN32_WINNT=0x0A00 -DWINVER=0x0A00 -D_DEBUG -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DZSTDLIB_STATIC_API=ZSTDLIB_HIDDEN -DZDICTLIB_STATIC_API=ZDICTLIB_HIDDEN -DZSTDLIB_VISIBLE=ZSTDLIB_HIDDEN -DZSTDERRORLIB_VISIBLE=ZSTDERRORLIB_HIDDEN -DZDICTLIB_VISIBLE=ZDICTLIB_HIDDEN -I../.. -Igen -I../../buildtools/third_party/libc++ -fno-delete-null-pointer-checks /clang:-fno-strict-overflow -fno-ident -fcolor-diagnostics -fmerge-all-constants /Zc:sizedDealloc- -fcrash-diagnostics-dir=../../tools/clang/crashreports -mllvm -instcombine-lower-dbg-declare=0 -mllvm -split-threshold-for-reg-with-hint=0 /clang:-ffp-contract=off -fcomplete-member-pointers /Gy /FS /bigobj /utf-8 /Zc:twoPhase -ffile-reproducible /D__WRL_ENABLE_FUNCTION_STATICS__ -fmsc-version=1934 --target=x86_64-windows -msse3 /Brepro -Wno-builtin-macro-redefined -D__DATE__= -D__TIME__= -D__TIMESTAMP__= -ffile-compilation-dir=. -no-canonical-prefixes -ftrivial-auto-var-init=pattern /Z7 -gno-codeview-command-line -gcodeview-ghash -gomit-unreferenced-methods -Xclang -fuse-ctor-homing /guard:cf,nochecks /MTd -Wheader-hygiene -Wstring-conversion -Wtautological-overlap-compare -Xclang -add-plugin -Xclang find-bad-constructs -Xclang -plugin-arg-find-bad-constructs -Xclang span-ctor-from-string-literal -Xclang -plugin-arg-find-bad-constructs -Xclang raw-ref-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang raw-span-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang check-stack-allocated -Xclang -add-plugin -Xclang raw-ptr-plugin -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-to-stack-allocated -Xclang -plugin-arg-raw-ptr-plugin -Xclang disable-check-raw-ptr-to-stack-allocated-error -Xclang -plugin-arg-raw-ptr-plugin -Xclang raw-ptr-exclude-path=../../third_party/dawn/ -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-span-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ref-fields -DUNSAFE_BUFFERS_BUILD -Xclang -add-plugin -Xclang unsafe-buffers -Xclang -plugin-arg-unsafe-buffers -Xclang ../../build/config/unsafe_buffers_paths.txt /std:c11 /TC /Foobj/third_party/zstd/common/xxhash.obj /Fdobj/third_party/zstd/common_c.pdb -Qunused-arguments /Users/fpazos/workspace/chromium/src/third_party/zstd/src/lib/common/xxhash.c ]
E20250313 12:23:03.372151 1854697472 cxx_compiler_type_specific.cc:25] 06909b36-dfb7-4656-831c-c2d8215090ac multiple inputs? 0
E20250313 12:23:03.374708 1848963072 scandeps.cc:164] GomaIPService encountered the following error processing a command: "multiple inputs are not supported."; Command: [/Users/fpazos/workspace/chromium/src/third_party/llvm-build/Release+Asserts/bin/clang-cl /c /Foobj/third_party/boringssl/boringssl/cpu_aarch64_linux.obj /nologo /showIncludes:user /winsysroot../../third_party/depot_tools/win_toolchain/vs_files/7393122652 -DDCHECK_ALWAYS_ON=1 -DUSE_AURA=1 -DCR_CLANG_REVISION="llvmorg-21-init-1655-g7b473dfe-1" -D_LIBCPP_HARDENING_MODE=_LIBCPP_HARDENING_MODE_EXTENSIVE -D_LIBCPP_DISABLE_VISIBILITY_ANNOTATIONS -D_LIBCPP_INSTRUMENTED_WITH_ASAN=0 -DCR_LIBCXX_REVISION=4f05e20cbe1d02fa0871ac88b30eead9e38cab3a -DTMP_REBUILD_HACK -D__STD_C -D_CRT_RAND_S -D_CRT_SECURE_NO_DEPRECATE -D_SCL_SECURE_NO_DEPRECATE -D_ATL_NO_OPENGL -D_WINDOWS -DCERT_CHAIN_PARA_HAS_EXTRA_FIELDS -DPSAPI_VERSION=2 -DWIN32 -D_SECURE_ATL -DWINAPI_FAMILY=WINAPI_FAMILY_DESKTOP_APP -DWIN32_LEAN_AND_MEAN -DNOMINMAX -D_UNICODE -DUNICODE -DNTDDI_VERSION=NTDDI_WIN10_NI -D_WIN32_WINNT=0x0A00 -DWINVER=0x0A00 -D_DEBUG -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DBORINGSSL_IMPLEMENTATION -DOPENSSL_SMALL -D_CRT_NONSTDC_NO_WARNINGS -D_WINSOCK_DEPRECATED_NO_WARNINGS -I../.. -Igen -I../../buildtools/third_party/libc++ -I../../third_party/boringssl/src/include -fno-delete-null-pointer-checks /clang:-fno-strict-overflow -fno-ident -fcolor-diagnostics -fmerge-all-constants /Zc:sizedDealloc- -fcrash-diagnostics-dir=../../tools/clang/crashreports -mllvm -instcombine-lower-dbg-declare=0 -mllvm -split-threshold-for-reg-with-hint=0 /clang:-ffp-contract=off -fcomplete-member-pointers /Gy /FS /bigobj /utf-8 /Zc:twoPhase -ffile-reproducible /D__WRL_ENABLE_FUNCTION_STATICS__ -fmsc-version=1934 --target=x86_64-windows -msse3 /Brepro -Wno-builtin-macro-redefined -D__DATE__= -D__TIME__= -D__TIMESTAMP__= -ffile-compilation-dir=. -no-canonical-prefixes -ftrivial-auto-var-init=pattern /Od /Ob0 /GF /Z7 -gno-codeview-command-line -gcodeview-ghash -gomit-unreferenced-methods -Xclang -fuse-ctor-homing /guard:cf,nochecks /MTd -Wheader-hygiene -Wstring-conversion -Wtautological-overlap-compare -Xclang -add-plugin -Xclang find-bad-constructs -Xclang -plugin-arg-find-bad-constructs -Xclang span-ctor-from-string-literal -Xclang -plugin-arg-find-bad-constructs -Xclang raw-ref-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang raw-span-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang check-stack-allocated -Xclang -add-plugin -Xclang raw-ptr-plugin -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-to-stack-allocated -Xclang -plugin-arg-raw-ptr-plugin -Xclang disable-check-raw-ptr-to-stack-allocated-error -Xclang -plugin-arg-raw-ptr-plugin -Xclang raw-ptr-exclude-path=../../third_party/dawn/ -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-span-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ref-fields -DUNSAFE_BUFFERS_BUILD -Xclang -add-plugin -Xclang unsafe-buffers -Xclang -plugin-arg-unsafe-buffers -Xclang ../../build/config/unsafe_buffers_paths.txt /W3 /wd4800 /wd4267 -Wno-unused-variable -Wno-c++11-narrowing -Wno-unused-but-set-variable -Wno-misleading-indentation -Wno-missing-field-initializers -Wno-unused-parameter -Wno-psabi -Wloop-analysis -Wno-unneeded-internal-declaration -Wno-nonportable-include-path -Wno-cast-function-type -Wno-thread-safety-reference-return -Wno-nontrivial-memcall /WX -Wno-undefined-bool-conversion -Wno-tautological-undefined-compare /std:c++20 -Wno-trigraphs /TP /GR- -I../../third_party/libc++/src/include -Wno-invalid-offsetof -Wenum-compare-conditional -Wno-c++11-narrowing-const-reference -Wno-missing-template-arg-list-after-template-kw /Fdobj/third_party/boringssl/boringssl_cc.pdb -Qunused-arguments /Users/fpazos/workspace/chromium/src/third_party/boringssl/src/crypto/cpu_aarch64_linux.cc ]
E20250313 12:23:03.588554 1854697472 cxx_compiler_type_specific.cc:25] 5e3fe578-4aa6-421d-b3db-d7b9c59c97ce multiple inputs? 0
E20250313 12:23:03.588708 1848963072 scandeps.cc:164] GomaIPService encountered the following error processing a command: "multiple inputs are not supported."; Command: [/Users/fpazos/workspace/chromium/src/third_party/llvm-build/Release+Asserts/bin/clang-cl /c /nologo /showIncludes:user /winsysroot../../third_party/depot_tools/win_toolchain/vs_files/7393122652 -DDCHECK_ALWAYS_ON=1 -DUSE_AURA=1 -DCR_CLANG_REVISION="llvmorg-21-init-1655-g7b473dfe-1" -D_LIBCPP_HARDENING_MODE=_LIBCPP_HARDENING_MODE_EXTENSIVE -D_LIBCPP_DISABLE_VISIBILITY_ANNOTATIONS -D_LIBCPP_INSTRUMENTED_WITH_ASAN=0 -DCR_LIBCXX_REVISION=4f05e20cbe1d02fa0871ac88b30eead9e38cab3a -DTMP_REBUILD_HACK -D__STD_C -D_CRT_RAND_S -D_CRT_SECURE_NO_DEPRECATE -D_SCL_SECURE_NO_DEPRECATE -D_ATL_NO_OPENGL -D_WINDOWS -DCERT_CHAIN_PARA_HAS_EXTRA_FIELDS -DPSAPI_VERSION=2 -DWIN32 -D_SECURE_ATL -DWINAPI_FAMILY=WINAPI_FAMILY_DESKTOP_APP -DWIN32_LEAN_AND_MEAN -DNOMINMAX -D_UNICODE -DUNICODE -DNTDDI_VERSION=NTDDI_WIN10_NI -D_WIN32_WINNT=0x0A00 -DWINVER=0x0A00 -D_DEBUG -DDYNAMIC_ANNOTATIONS_ENABLED=1 -D_CRT_NONSTDC_NO_WARNINGS -D_WINSOCK_DEPRECATED_NO_WARNINGS -DCHROMIUM -DVPX_MAX_ALLOCABLE_MEMORY=((1ULL << 31) - (1 << 21)) -I../.. -Igen -I../../buildtools/third_party/libc++ -I../../third_party/libvpx/source/config -I../../third_party/libvpx/source/libvpx -I../../third_party/libvpx/source/config/win/x64 -fno-delete-null-pointer-checks /clang:-fno-strict-overflow -fno-ident -fcolor-diagnostics -fmerge-all-constants /Zc:sizedDealloc- -fcrash-diagnostics-dir=../../tools/clang/crashreports -mllvm -instcombine-lower-dbg-declare=0 -mllvm -split-threshold-for-reg-with-hint=0 /clang:-ffp-contract=off -fcomplete-member-pointers /Gy /FS /bigobj /utf-8 /Zc:twoPhase -ffile-reproducible /D__WRL_ENABLE_FUNCTION_STATICS__ -fmsc-version=1934 --target=x86_64-windows -msse3 /Brepro -Wno-builtin-macro-redefined -D__DATE__= -D__TIME__= -D__TIMESTAMP__= -ffile-compilation-dir=. -no-canonical-prefixes -ftrivial-auto-var-init=pattern /Od /Ob0 /GF /Z7 -gno-codeview-command-line -gcodeview-ghash -gomit-unreferenced-methods -Xclang -fuse-ctor-homing /guard:cf,nochecks /MTd -Wheader-hygiene -Wstring-conversion -Wtautological-overlap-compare -Xclang -add-plugin -Xclang find-bad-constructs -Xclang -plugin-arg-find-bad-constructs -Xclang span-ctor-from-string-literal -Xclang -plugin-arg-find-bad-constructs -Xclang raw-ref-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang raw-span-template-as-trivial-member -Xclang -plugin-arg-find-bad-constructs -Xclang check-stack-allocated -Xclang -add-plugin -Xclang raw-ptr-plugin -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-to-stack-allocated -Xclang -plugin-arg-raw-ptr-plugin -Xclang disable-check-raw-ptr-to-stack-allocated-error -Xclang -plugin-arg-raw-ptr-plugin -Xclang raw-ptr-exclude-path=../../third_party/dawn/ -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ptr-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-span-fields -Xclang -plugin-arg-raw-ptr-plugin -Xclang check-raw-ref-fields -DUNSAFE_BUFFERS_BUILD -Xclang -add-pl
E0313 12:23:54.640637 26353 monitoring.go:208] Failed to export to Stackdriver: ResourceExhausted rpc error: code = ResourceExhausted desc = Errors during metric descriptor creation: {(metric: custom.googleapis.com/opencensus/go.chromium.org/rbe/action/latency, error: Request throttled. You have hit the per-project limit on metric definition or label definition changes per minute. This issue should resolve itself within a few minutes.)}.