Managed VM with Go Runtime incoming bandwidth restricted to 22MB/min in Billing Enabled Project

[Roy Palacios]

Hello,

I've been trying App Engine Managed VM with Go runtime in my project sanguine-form-95600

I have a Go Handler that downloads a 300MB file from an external source, and, even though I have billing enabled, it's being downloaded at 380KB/s (~22MB/min), which I understand is the default quota for free projects (https://cloud.google.com/appengine/docs/quotas).

Could you please check if this network quota is being correctly applied for Managed VM? (shoudn't it be +740MB/min?)

I have no problems with the same task in Java on Compute Engine.

Thanks,

Roy

----------

Relevant Go source:

response, err := http.Get(url)

zipBody, err := ioutil.ReadAll(response.Body)

----------

I'm also getting 502 Bad Gateway error after 18 minutes (roughly when the 300MB may have been downloaded). Probably a side effect...

 

[Nick (Cloud Platform Support)]

Hey Roy,

The main issue which needs to be dealt with here is that of determining whether the data received rate is actually being limited based on quotas or based on the network performance of the resource in question. Part of this might include producing the data and methods of the benchmark done with Compute Engine. I'll be attempting to look into whether your quota is what it should be in regard to UrlFetch in the meantime.

[Roy Palacios]

Hi Nick,

I was concerned about this also, thus I did a test in my local at the same time and was able to get the resource (350MB) in 6-7min whereas MVM was considerably slower.

The curious thing here is that the rate in MVM was 22MB/s as documented for free apps.

The tests were done few minutes before the original post.

Thanks
Roy

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/g6R7xI9Fcgo/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/71288071-9777-4be2-bb79-0ae108f51bb4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Nick (Cloud Platform Support)]

Thanks for the clarification. I'm currently working to check in on your quota, or on the specifics of Managed VMs, to determine what might be behind this behaviour.

On Wednesday, February 10, 2016 at 7:35:14 PM UTC-5, Roy Palacios wrote:

Hi Nick,

I was concerned about this also, thus I did a test in my local at the same time and was able to get the resource (350MB) in 6-7min whereas MVM was considerably slower.

The curious thing here is that the rate in MVM was 22MB/s as documented for free apps.

The tests were done few minutes before the original post.

Thanks
Roy

On Wed, Feb 10, 2016 at 6:39 PM 'Nick (Cloud Platform Support)' via Google App Engine <google-appengine@googlegroups.com> wrote:

Hey Roy,

The main issue which needs to be dealt with here is that of determining whether the data received rate is actually being limited based on quotas or based on the network performance of the resource in question. Part of this might include producing the data and methods of the benchmark done with Compute Engine. I'll be attempting to look into whether your quota is what it should be in regard to UrlFetch in the meantime.

On Wednesday, February 10, 2016 at 2:17:40 AM UTC-5, Roy Palacios wrote:

Hello,

I've been trying App Engine Managed VM with Go runtime in my project sanguine-form-95600

I have a Go Handler that downloads a 300MB file from an external source, and, even though I have billing enabled, it's being downloaded at 380KB/s (~22MB/min), which I understand is the default quota for free projects (https://cloud.google.com/appengine/docs/quotas).

Could you please check if this network quota is being correctly applied for Managed VM? (shoudn't it be +740MB/min?)

I have no problems with the same task in Java on Compute Engine.

Thanks,

Roy

----------

Relevant Go source:

response, err := http.Get(url)

zipBody, err := ioutil.ReadAll(response.Body)

----------

I'm also getting 502 Bad Gateway error after 18 minutes (roughly when the 300MB may have been downloaded). Probably a side effect...

 

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/g6R7xI9Fcgo/unsubscribe.

To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.

[Brian Stark]

Hi Roy,

I'm from support at GCP.  We checked your quota and it appeared to be properly set at (744MB).  Can you confirm that you've tried this in the last few hours?

We also wanted to understand how you are communicating with the external source.  Are you using GAE URL Fetch or direct sockets from the VM to the remote host?  This may impact the speed.

[Roy Palacios]

Thank you very much Brian / Nick,

Today I updated my GAE SDK and Google Cloud SDK from latest - 1 to latest version, then redeployed everything and it is working fine now!!

I'm using http.Get() and ioutil.ReadAll(response), because UrlFetch restricts on the response size and timeout.

Thanks,

Roy

--

You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/g6R7xI9Fcgo/unsubscribe.

To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.

Visit this group at https://groups.google.com/group/google-appengine.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/8ea533fe-7920-4ffd-9128-5388e9f30535%40googlegroups.com.