Importing any.proto in .proto files

[akshay patil]

 I am trying to define my own messages representing python classes that I want to serialize. However, I need to import any.proto or timestamp.proto in my .proto files to represent certain messages

syntax = "proto3";
import "/google/protobuf/any.proto";

message Test {
   Any var1 = 1;
}

However, seems like the protobuf installation does not come with any .proto files. I am using python 3.5 and have protobuf 3.5.2 installed. I tried to look under google/protobuf/ but just found the compiled files like ant_pb2.py and timestamp_pb2.py. I am following docs here to import any.proto - https://developers.google.com/protocol-buffers/docs/proto3#any

[Feng Xiao]

Have you install protocol compiler, i.e., protoc? These protos should be installed along with the protoc binary if you get it from our release page.

--
You received this message because you are subscribed to the Google Groups "Protocol Buffers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to protobuf+u...@googlegroups.com.
To post to this group, send email to prot...@googlegroups.com.
Visit this group at https://groups.google.com/group/protobuf.
For more options, visit https://groups.google.com/d/optout.

[akshay patil]

I have protoc installed which I can run via command line. I did install protobuf using conda and when I check in my site-packages in my python environment under ` site-packages/google/protobuf ` I do not see any *.proto files

[Feng Xiao]

On Mon, Aug 20, 2018 at 9:24 PM akshay patil <aksl...@gmail.com> wrote:

I have protoc installed which I can run via command line. I did install protobuf using conda and when I check in my site-packages in my python environment under ` site-packages/google/protobuf ` I do not see any *.proto files

They are not in your python site-packages, but should be installed along side with the protoc binary. Check where your protoc is and look around to see if the protos are install there.

Try compile the following proto and see if protoc can find the right imports:

syntax = "proto3";
import "google/protobuf/any.proto";

message Test {
   google.protobuf.Any var1 = 1;
}

If you are unsure whether your proto definition is valid (your original one has a invalid import path and incomplete type name for Any), try it here:

https://unpkg.com/google-proto...@0.0.6/index.html

If you can get it working it on this site, you should be able to get it working locally as well.

[Siddharth]

Hi feng, 

Can we convert JSON object into Google.protobuf.Any format? If yes, can you provide an example. Thanks for the help.

Thanks,

Sid

[Feng Xiao]

On Mon, Aug 20, 2018 at 10:02 PM Siddharth <siddharth...@gmail.com> wrote:

Hi feng, 

Can we convert JSON object into Google.protobuf.Any format? If yes, can you provide an example. Thanks for the help.

Check out the Any unittest examples:

https://github.com/google/protobuf/blob/master/java/util/src/test/java/com/google/protobuf/util/JsonFormatTest.java#L835

[akshay patil]

Thanks a lot for the suggestions. I can import the any.proto correctly into my proto files.

Wanted to ask about importing other proto files not provided by google protobuf but different python libraries.

eg. tensorflow/core/framework/tensor.proto  or onnx/onnx.proto

i.e 

import "onnx/onnx.proto";

message Test {
    onnx.TensorProto var = 1; 
}

Do I have to copy over the files and use them or the protoc compiler can detect that from my site-packages?

Same is the case for other proto files eg. import "tensorflow/core/framework/tensor.proto"

On Tuesday, August 21, 2018 at 12:16:12 AM UTC-5, Feng Xiao wrote:

On Mon, Aug 20, 2018 at 10:02 PM Siddharth <siddharth...@gmail.com> wrote:

Hi feng, 

Can we convert JSON object into Google.protobuf.Any format? If yes, can you provide an example. Thanks for the help.

Check out the Any unittest examples:

https://github.com/google/protobuf/blob/master/java/util/src/test/java/com/google/protobuf/util/JsonFormatTest.java#L835

 

Thanks,

Sid

On Tue, Aug 21, 2018, 10:27 AM 'Feng Xiao' via Protocol Buffers <prot...@googlegroups.com> wrote:

On Mon, Aug 20, 2018 at 9:24 PM akshay patil <aksl...@gmail.com> wrote:

I have protoc installed which I can run via command line. I did install protobuf using conda and when I check in my site-packages in my python environment under ` site-packages/google/protobuf ` I do not see any *.proto files

They are not in your python site-packages, but should be installed along side with the protoc binary. Check where your protoc is and look around to see if the protos are install there.

Try compile the following proto and see if protoc can find the right imports:

syntax = "proto3";
import "google/protobuf/any.proto";

message Test {
   google.protobuf.Any var1 = 1;
}

If you are unsure whether your proto definition is valid (your original one has a invalid import path and incomplete type name for Any), try it here:

https://unpkg.com/google-protocol...@0.0.6/index.html

[Feng Xiao]

On Tue, Aug 21, 2018 at 8:27 AM akshay patil <aksl...@gmail.com> wrote:

Thanks a lot for the suggestions. I can import the any.proto correctly into my proto files.

Wanted to ask about importing other proto files not provided by google protobuf but different python libraries.

eg. tensorflow/core/framework/tensor.proto  or onnx/onnx.proto

Protocol compiler can't detect those files. You will need to use the --proto_path option to specify where those protos are located.

For example, suppose onnx/onnx.proto is at /some/path/onnx/onnx.proto, try:

protoc --proto_path=/some/path your_proto.proto

 

i.e 

import "onnx/onnx.proto";

message Test {
    onnx.TensorProto var = 1; 
}

Do I have to copy over the files and use them or the protoc compiler can detect that from my site-packages?

Same is the case for other proto files eg. import "tensorflow/core/framework/tensor.proto"

On Tuesday, August 21, 2018 at 12:16:12 AM UTC-5, Feng Xiao wrote:

On Mon, Aug 20, 2018 at 10:02 PM Siddharth <siddharth...@gmail.com> wrote:

Hi feng, 

Can we convert JSON object into Google.protobuf.Any format? If yes, can you provide an example. Thanks for the help.

Check out the Any unittest examples:

https://github.com/google/protobuf/blob/master/java/util/src/test/java/com/google/protobuf/util/JsonFormatTest.java#L835

 

Thanks,

Sid

On Tue, Aug 21, 2018, 10:27 AM 'Feng Xiao' via Protocol Buffers <prot...@googlegroups.com> wrote:

On Mon, Aug 20, 2018 at 9:24 PM akshay patil <aksl...@gmail.com> wrote:

I have protoc installed which I can run via command line. I did install protobuf using conda and when I check in my site-packages in my python environment under ` site-packages/google/protobuf ` I do not see any *.proto files

They are not in your python site-packages, but should be installed along side with the protoc binary. Check where your protoc is and look around to see if the protos are install there.

Try compile the following proto and see if protoc can find the right imports:

syntax = "proto3";
import "google/protobuf/any.proto";

message Test {
   google.protobuf.Any var1 = 1;
}

If you are unsure whether your proto definition is valid (your original one has a invalid import path and incomplete type name for Any), try it here:

https://unpkg.com/google-proto...@0.0.6/index.html