Anyone else getting Status 500 returned randomly for requests on GAE?

[Kelly Ingram]

I have a cron job setup to run every 20 minutes which has been running as expected until 2 days ago where I am now getting intermittent failures and GAE is returning a status of 500 with the WARNING message:

While handling this request, the process that handled this request was found to be using too much memory and was terminated. This is likely to cause a new process to be used for the next request to your application. If you see this message frequently, you may have a memory leak in your application.

and sometimes includes the INFO message:

This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application.

It will run ok once or twice and then randomly it won't run and returns the above messages.  

Nothing is changing in the code or the files it's processing on Google Drive so I am confused as to what could be the issue.

I've also occasionally received a status of 404 over the past few days.  Again with no obvious reason why.

Anyone else receiving these errors?

Thanks

This communication together with any attachments transmitted with it ("this email") is intended only for the use of the addressee and may contain information which is privileged and confidential. If the reader of this email is not the intended recipient or the employee or agent responsible for delivering it to the intended recipient you are hereby notified that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited.  If you have received this email in error please notify us immediately by email at ad...@cloudle.com.au  Please then immediately delete, erase or otherwise destroy this email and any copies of it.  Addressees should check this email for viruses. Cloudle Pty Ltd makes no representations as regards to the absence of viruses in this email.

Any opinions expressed in this email are those of the author and do not necessarily constitute the views of Cloudle Pty Ltd. Nothing in this email shall bind the Company in any contract or obligation.

[Nicholas (Google Cloud Support)]

Hey Kelly,

Welcome and thanks for sharing your questions here with the community.  Generally, when getting 4xx and 5xx responses from your App Engine application, I would suggest looking for related request logs in Stackdriver Logging which you seem to have done.  The log you've pasted in your initial message suggests the application is consuming more memory than releasing.

• What runtime are you using?
  
• You mention that the application is processing Google Drive files.  How large are these files?
  
• Can you point to the APIs and client libraries the application uses to handle the files?  I ask as it's possible the files are too large to be processed entirely at once.
  
• Do you still get this same error if using instances with greater memory?
  
• Are you using the standard environment or flexible environment?