Does gae support boto3?

Ray Wong

unread,

Aug 22, 2019, 9:09:00 AM8/22/19

to Google App Engine

Recently I migrated from boto to boto3 in my gae project. But when I run my project(environment: python27), I get the error:

def __init__(self, profile_name, load_config, popen=subprocess.Popen):

AttributeError: 'module' object has no attribute 'Popen'

I searched on Google and find some people say that boto3 doesn't support gae sandbox. Now that my project has to use boto3, is there any solution to run boto3 on gae? Thanks!

Nicolas (Google Cloud Platform Support)

unread,

Aug 22, 2019, 3:31:34 PM8/22/19

to Google App Engine

Hi Ray,

Thank you for opening this thread, I’m not a Boto3 expert however from what I understand of the research that I made, I think you are right Boto3 seems to be experiencing some issues with App Engine.

Also I found some unofficial resource that seems to imply that you could rollback and use Boto2.

Ray Wong

unread,

Aug 22, 2019, 9:58:00 PM8/22/19

to Google App Engine

Thanks for your reply! In fact I need to use Mturk api which is included in boto and boto3 in my project. However the Mturk api in boto is now deprecated so that means I have to use boto3 continue my work.

Nicolas (Google Cloud Platform Support)

unread,

Aug 23, 2019, 8:00:22 PM8/23/19

to Google App Engine

Hi Ray,

I understand that you really need Boto3 to be supported by App Engine as of now it is now so I have notified our engineering team of this feature request[1] and they are now investigating it. There is currently no ETA for its implementation.

[1] https://issuetracker.google.com/issues/139956261

Ray Wong

unread,

Sep 24, 2019, 9:08:18 AM9/24/19

to Google App Engine

Any progress in this issue? It seems that it's because GAE dosen't support subprogress.Popen.

George (Cloud Platform Support)

unread,

Sep 24, 2019, 11:09:02 AM9/24/19

to Google App Engine

This sub-process is now supported in App Engine's production environment for Python 2.7.

Soeren Balko

unread,

Sep 30, 2019, 9:27:31 PM9/30/19

to Google App Engine

Can you please elaborate? I am on the latest version of the Google Cloud SDK (264.0.0) with its app-engine-python component up to date. However, when adding the boto3 pip dependency (version 1.9.237), and importing it into my AppEngine module, I get the aforementioned "AttributeError: 'module' object has no attribute 'Popen'" error. So I am not sure what the AppEngine production environment does or doesn't support, but this is surely not supported in the dev_appserver.py sandbox.

Soeren

Ray Wong

unread,

Oct 10, 2019, 6:41:57 AM10/10/19

to Google App Engine

Can it be fixed in GAE standard environment?

George (Cloud Platform Support)

unread,

Oct 10, 2019, 8:24:36 AM10/10/19

to Google App Engine

You are right: supported in GAE runtime, so after your app is deployed, not in local development environment.

George (Cloud Platform Support)

unread,

Oct 17, 2019, 11:27:15 AM10/17/19

to Google App Engine

This sub-process is now supported in App Engine Standard production environment for Python 2.7. You are encouraged verify and report eventual errors.

Reply all

Reply to author

Forward