Loads of Exceeded soft process size limit errors? (Python app)

[Jan Zawadzki / Hapara]

Hi - we're seeing tons of Exceeded soft process size limit errors
appear in the last 24 hours.

I have not seen these before, ever.

These kick in after anywhere from 20 to 700 requests.

Should I worry? Not exactly much we can do about memory leaks here,
is there? (Python app)

Thanks!

Jan

[Tim Hoffman]

HI Jan

Something to watch for on the memory front, is if you are doing a lot of string manipulation

using '+' operator.  I have seen someone here last year using + rather than join and 

hitting soft and hard memory limits with a single request, and changing to join reduced 

memory use by 100 times.  Its an extreme example I know.

Also if you are holding references to entities in modules, global, etc... things may not get garbage collected.

Have a look at apptrace http://pypi.python.org/pypi/apptrace/0.2.3  which allows you to monitor memory use in appengine

Rgds

T

[Jan Zawadzki / Hapara]

Hmm. We don't do enough of that, plus, it's a new problem - months of
incremental code changes w/ no problems and suddenly our memory usage
triggers errors.

I think something else changed in the GAE environment...

J

On Sep 2, 1:35 am, Tim Hoffman <zutes...@gmail.com> wrote:
> HI Jan
>
> Something to watch for on the memory front, is if you are doing a lot of
> string manipulation
> using '+' operator.  I have seen someone here last year using + rather than
> join and
> hitting soft and hard memory limits with a single request, and changing to
> join reduced
> memory use by 100 times.  Its an extreme example I know.
>
> Also if you are holding references to entities in modules, global, etc...
> things may not get garbage collected.
>

> Have a look at apptracehttp://pypi.python.org/pypi/apptrace/0.2.3 which