grpcio wheel build

[ioannis.vogiat...@ansys.com]

I am trying to build grpcio against an already build protobuf version

I am first building grpc core according to these instructions 

https://github.com/grpc/grpc/blob/e6cd312346655d9a936acfb97927dbcd35615623/test/distrib/cpp/run_distrib_test_cmake.bat 

then I am moving on to the wheel build according to these instructions 

https://github.com/grpc/grpc/blob/7f32b96e3d9093dff6f0584ad605a2f10a744ec8/tools/run_tests/artifacts/build_artifact_python.bat

However the build keeps failing (with or without cython) with the following error

[Errno 2] No such file or directory: 'third_party\\protobuf\\src\\google\\protobuf\\wrappers.proto'

My build tooldchain is the following:

- MSVC 2017

- Python 3.6

- setuptools  40.8.0

- cython 0.29.13

[ioannis.vogiat...@ansys.com]

PS: i checked out the latest release 1.23.0

[Lidi Zheng]

Did you pull in the submodules?

    git submodule update --init

It looks like those third_party files are missing.

[Ioannis Vogiatzis Oikonomidis]

Yes I did. The files are there.I checked.

I more or less copy pasted the build scripts from the links

---

From: 'Lidi Zheng' via grpc.io <grp...@googlegroups.com>
Sent: Wednesday, August 21, 2019 8:06:17 PM
To: grpc.io <grp...@googlegroups.com>
Subject: [grpc-io] Re: grpcio wheel build

 

--
You received this message because you are subscribed to a topic in the Google Groups "grpc.io" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/grpc-io/brh7Jj7Dso0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to grpc-io+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/cd77608f-6628-40bd-a852-ce147e681738%40googlegroups.com.

[Lidi Zheng]

Did the C-Core build succeed? Can you provide specific command and logs?

To unsubscribe from this group and all its topics, send an email to grp...@googlegroups.com.

[Lidi Zheng]

Hi Ioannis,

This error doesn't look like a bug in the installation process.

This failure is in the compilation of grpcio-tools package.

Can you check the working directory for your IDE, and the relative path of that file?

It seems somewhere in the settings is wrong.

Lidi

On Thu, Aug 22, 2019 at 1:08 AM Ioannis Vogiatzis Oikonomidis <ioannis.vogiat...@ansys.com> wrote:

Yes the Core build succeeds.

 

The command that fails is the following (it is running under a build agent)

$(Build.BinariesDirectory)\python\CPython\$(PythonVersionShort)\winx64\Release\python\python.exe -VVV setup.py  --prefix=$(Build.SourcesDirectory) build_ext -c msvc -vvv || goto :error

 

Before calling the command I am modifying the PATH and adding the protobuf c-core build

** Visual Studio 2017 Developer Command Prompt v15.8.5

** Copyright (c) 2017 Microsoft Corporation

**********************************************************************

Environment initialized for: 'x64'

Python 3.6.7 (heads/python_3.6.7_vs2017-dirty:cdc6a0e, May 28 2019, 15:50:17) [MSC v.1910 64 bit (AMD64)]

Python 3.6.7 (heads/python_3.6.7_vs2017-dirty:cdc6a0e, May 28 2019, 15:50:17) [MSC v.1910 64 bit (AMD64)]

Compiling grpc_tools\_protoc_compiler.pyx because it changed.

Cythonizing grpc_tools\_protoc_compiler.pyx

C:\Dev\tfs_agent\_work\57\b\python\CPython\3_6\winx64\Release\python\lib\site-packages\Cython\Compiler\Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: C:\Dev\tfs_agent\_work\57\s\tools\distrib\python\grpcio_tools\grpc_tools\_protoc_compiler.pyx

  tree = Parsing.p_module(s, pxd, full_module_name)

Traceback (most recent call last):

  File "setup.py", line 209, in <module>

    package_data=package_data(),

  File "setup.py", line 155, in package_data

    shutil.copy(source, target)

  File "C:\Dev\tfs_agent\_work\57\b\python\CPython\3_6\winx64\Release\python\lib\shutil.py", line 241, in copy

    copyfile(src, dst, follow_symlinks=follow_symlinks)

  File "C:\Dev\tfs_agent\_work\57\b\python\CPython\3_6\winx64\Release\python\lib\shutil.py", line 120, in copyfile

    with open(src, 'rb') as fsrc:

FileNotFoundError: [Errno 2] No such file or directory: 'third_party\\protobuf\\src\\google\\protobuf\\wrappers.proto'

To unsubscribe from this group and all its topics, send an email to grpc-io+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/grpc-io/b6ba10d0-5005-44c9-b36f-bb02cccc3bbb%40googlegroups.com.

[Ioannis Vogiatzis Oikonomidis]

Hi Lidi

 

The working directory is the repo root dir.

 

Ioannis