New deploys suddenly fail to find local packages

143 views
Skip to first unread message

Andreas Blixt

unread,
Jan 12, 2016, 5:52:04 PM1/12/16
to Google App Engine
Today I was deploying a new version with minimal code changes and everything stopped working (starting with appengine_config.py) with the reason "ImportError: No module named roger" where "roger" is the package (directory) containing all the application files. I tried redeploying (with gcloud preview app deploy --no-promote) and the error persists.

Like I said there's been very few changes and none of them should cause this. We have over 100 unit tests with large code coverage that run fine locally, and the dev server also runs everything correctly.

Did something change on Google Cloud recently that could explain this?

Here's the traceback:

Traceback (most recent call last):
  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py", line 240, in Handle
    handler = _config_handle.add_wsgi_middleware(self._LoadHandler())
  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/lib_config.py", line 354, in __getattr__
    self._update_configs()
  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/lib_config.py", line 290, in _update_configs
    self._registry.initialize()
  File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/lib_config.py", line 165, in initialize
    import_func(self._modname)
  File "/base/data/home/apps/s~roger-api/20160112t173640.389939601188018605/appengine_config.py", line 21, in <module>
    from roger import config, report
ImportError: No module named roger

Andreas Blixt

unread,
Jan 12, 2016, 6:03:18 PM1/12/16
to Google App Engine
I've tried rebuilding the entire source directory from scratch and there is still no difference. What I do notice is that the App Engine Versions list claims my source changed from 9.8 MB to 5.3 MB which clearly is wrong when all that changed was a few lines of code. I'm starting to suspect this is a problem with the Google Cloud Storage staging area again (it's destroyed deploys in the past).

Andreas Blixt

unread,
Jan 12, 2016, 7:21:30 PM1/12/16
to Google App Engine
I'm still unable to get any further with this. I also tried emptying the staging bucket in Cloud Storage. The only real difference I can find is that App Engine v1.9.31 came out recently.

Nick (Cloud Platform Support)

unread,
Jan 12, 2016, 8:02:14 PM1/12/16
to Google App Engine
Can you attempt to check the python path during initialization (appengine_config.py) and also attempt to add the relevant "roger" directory? I know this is a sanity-check, but does roger/ contain an __init__.py file?

Is it possible to check the size on disk of the versions against what the Versions list shows?

This might be worth posting to the Public Issue Tracker if we can keep debugging until it becomes clear that there's a platform issue and not just a change in the deployed app.

Fahim ul Haq

unread,
Jan 13, 2016, 4:36:57 AM1/13/16
to Google App Engine
I am seeing the exact same issue and just like Andreas, we didn't change anything in the appengine directory and have local test cases that all pass. I tried clearing the staging bucket as well and it didn't help.

Here's very similar traceback.

Traceback (most recent call last): File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py", line 240, in Handle handler = _config_handle.add_wsgi_middleware(self._LoadHandler()) File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py", line 299, in _LoadHandler handler, path, err = LoadObject(self._handler) File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/runtime/wsgi.py", line 85, in LoadObject obj = __import__(path[0]) File "/base/data/home/apps/s~educative-hesive/30.389949971313765746/main.py", line 25, in <module> import routes as routes # noqa File "/base/data/home/apps/s~educative-hesive/30.389949971313765746/routes.py", line 4, in <module> from handlers import user_handlers File "/base/data/home/apps/s~educative-hesive/30.389949971313765746/handlers/user_handlers.py", line 3, in <module> import forms File "/base/data/home/apps/s~educative-hesive/30.389949971313765746/forms.py", line 1, in <module> from wtforms import Form ImportError: No module named wtforms

Giuseppe Reina

unread,
Jan 13, 2016, 9:57:01 AM1/13/16
to Google App Engine
We are currently investigating on few reports of this issue. As a workaround you can either deploy via the old appcfg tool [1,2] or use gcloud by disabling the use_appengine_api flag, e.g.

> gcloud config set app/use_appengine_api False


Sincerely,

Stefano Ciccarelli

unread,
Jan 13, 2016, 10:27:52 AM1/13/16
to Google App Engine
We are experiencing the same issue on our java app: some parts of the app are missing.


--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/588a0f0e-6403-4f5a-bf2b-f488339283d7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 
stefano.c...@mmbsoftware.it 

M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 
www.mmbsoftware.it - in...@mmbsoftware.it

Le informazioni contenute in questa comunicazione sono riservate e destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per errore, Vi preghiamo di rispondere a questa e-mail e successivamente cancellarla dal Vostro sistema.

Nick (Cloud Platform Support)

unread,
Jan 13, 2016, 1:20:52 PM1/13/16
to Google App Engine
Hey all,

This issue was likely to be affecting multiple users. It was related to a change in the deployment pipeline to improve performance of deployments. One possible fix is to run:

gcloud config set app/use_appengine_api True 

One could also attempt to use appcfg for deployment.

If this is still occurring for anybody, please feel free to update the thread. 
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 


M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 
Reply all
Reply to author
Forward
0 new messages