app.cfg update - excludes hidden files/folders in upload (with names starting with a ".")?

105 views
Skip to first unread message

roshan

unread,
Sep 11, 2016, 3:38:35 AM9/11/16
to Google App Engine
Hi,

I have the need to upload in my app-engine app a static config file that needs to be in a folder whose name starts with a "." - say the path is ".aa/bb.config".

I notice that this folder is not being uploaded.

I referred the code of the following classes, but didn't really see folders starting with "." being excluded anywhere. I could only find exactly "." / ".." named folders being excluded.

- com.google.appengine.tools.admin.AppAdminImpl
- com.google.appengine.tools.admin.AppVersionUpload
- com.google.appengine.tools.util.FileIterator

Q1) Can someone please confirm if it's indeed the case that files / folders with names starting with a "." are excluded in the upload-to-app-engine cycle?

Q2) Where can I find the logs generated by tools like appcfg.sh? How should I tweak the logging levels?

Thanks,
Roshan

roshan

unread,
Sep 11, 2016, 3:41:25 AM9/11/16
to Google App Engine
Sorry about the typo. I meant to ask the question in "appcfg.sh update" context.

Vitaly Bogomolov

unread,
Sep 11, 2016, 3:16:07 PM9/11/16
to Google App Engine
Hi, Roshan

You need to define your own "skip_files" directive in app.yaml file.

The skip_files has the following default:


skip_files:


- ^(.*/)?#.*#$

- ^(.*/)?.*~$

- ^(.*/)?.*\.py[co]$

- ^(.*/)?.*/RCS/.*$

- ^(.*/)?\..*$


https://cloud.google.com/appengine/docs/python/config/appref


WBR, Vitaly.



roshan

unread,
Sep 11, 2016, 10:38:46 PM9/11/16
to Google App Engine
Hi,

I tried introducing an App.yaml file with the custom skip_files entries, but it's not helping. I still couldn't get ".aa/bb.config" to get uploaded to app engine.

Mine is a java app and not a python app, btw. Is this mechanism even supported for a Java app?

Cheers,
Roshan

roshan

unread,
Sep 11, 2016, 10:47:56 PM9/11/16
to Google App Engine
Hi,

I also tried introducing an entry for the file in appengine-web.xml's static / include block as shown below, but even that didn't make appcfg.sh not skip the exclusion of this file.

<static-files>
        <include path="/.aa/bb.config" />
</static-files>

How can I make appcfg include / deploy this content of the folder whose name starts with "."?

Cheers,
Roshan

roshan

unread,
Sep 12, 2016, 2:57:36 AM9/12/16
to Google App Engine
Hi,

The code at the below location (com.google.appengine.tools.admin.Application), which is involved in copying over the app files to a staging directory before uploading them seems to suggest that it's hard-coded that files / folders starting with "." will be ignored, which is different from the "skip_files" config based approach of the python app and is quite unfortunate :-(

https://github.com/greghaskins/googleappengine/blob/e78ea5c1ef55564b776ff155630202afb2d4ecfa/java/src/main/com/google/appengine/tools/admin/Application.java#L699

I really wanted to avoid mapping "/.aa/bb.config" to a servlet! :-(

Cheers,
Roshan

On Monday, 12 September 2016 00:46:07 UTC+5:30, Vitaly Bogomolov wrote:

Nick (Cloud Platform Support)

unread,
Sep 20, 2016, 4:43:20 PM9/20/16
to Google App Engine
Hey Roshan,

It appears you're correct that this is expected behaviour. But I want to encourage you to make a Feature Request to change this in the Public Issue Tracker for App Engine. We monitor it regularly and it's open to users for situations just like yours. 

Cheers,

Nick
Cloud Platform Community Support

Roshan Dawrani

unread,
Sep 27, 2016, 11:52:22 AM9/27/16
to google-a...@googlegroups.com
Hi Nick,

Could manage to file the feature request only now. Here it is: https://code.google.com/p/googleappengine/issues/detail?id=13307

Thanks for taking interest in this thread.

Cheers.
Roshan

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/zJdyy63nW_w/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/9e7725f0-3e58-47ec-915a-3758222ef139%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages