Server Error (500) while uploading index definitions (again)

[gae123]

If somebody from Google could contact me to resolve why I get this
message again I would appreciate. I also see "out of Datastor Indice
quotas" on the server while I have only 58 indexes in my index.yaml
file.

$ ../out/google_appengine/appcfg.py update_indexes ../out/site
Uploading index definitions.
Error 500: --- begin server output ---

Server Error (500)
A server error has occurred.
--- end server output ---
$

[gae123]

The problem persists 24 hours later and nobody has offered any help.
Sorry for spamming the whole list, if there is a more appropriate way
to get support please let me know.

[Nick Johnson (Google)]

Hi,

What's your app's App ID?

-Nick Johnson

[Ｌ]

testbbs2009.appspot.com

[Nick Johnson (Google)]

Hi,

Looking at your app, I only see 3 indexes, all in 'serving' state. What exactly is the problem?

-Nick Johnson

2009/6/15 Ｌ <kensh...@live.cn>

testbbs2009.appspot.com

[gae123]

For the record, four days after the original posting this remains an
issue!!

I sent a private message to Nick Johnosn with my app id yesterday
morning but have not heard back. There is another posting in this
thread by "L" whom I do not know and has nothing to do with my
original posting and should have never replied to this thread with his
issues because he just confused things.

[Nick Johnson (Google)]

Hi gae123,

My apologies - your email to me mistakenly got categorized as spam. I've moved the stuck indexes to 'error' state, so you should now be able to vacuum and re-create them.

-Nick Johnson

--
Nick Johnson, App Engine Developer Programs Engineer
Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047

[gae123]

Hi Nick,

I followed the directions, in fact I deleted all indexes, but the
problem persists:

$ ../out/google_appengine/appcfg.py update_indexes ../out/site
Uploading index definitions.
Error 500: --- begin server output ---

Server Error (500)
A server error has occurred.
--- end server output ---
$

Could you also please provide a root cause and how to avoid this? This
is happening on a test site but if it were to happen on my production
site it would have been be a disaster.

[Nick Johnson (Google)]

Hi gae123,

500s from the deploy process are generally transient, and not related to your app in particular. Can you retry it, please, and let us know if you're still getting it?

-Nick Johnson

[gae123]

Nick,

the error persists.

It has been 6 days since my original posting and we have not made much
progress. I think this is primarily because of the difference in
timezone between you and me. Each exchange takes 24 hours. Could you
hand off the case to somebody else closer to my timezone? I am in PDT,
actually in the bay area, miles from Google's headquarters....

Thanks

[Jason (Google)]

I'm sorry that your issue hasn't been resolved yet. Can you send me your application's ID also?

Thanks,

- Jason

[gae123]

Jason,

I sent you two personal e-mails yesterday with the id, did you receive
them? Please check your spam folder as well...

Thanks

> > Thanks- Hide quoted text -
>
> - Show quoted text -

[Jason (Google)]

Yes, I received them. I will look into it and get back to you soon.

- Jason

[C Partac]

I have the same problem Server Error (500) on my applications
cpedevtest01 and cpedevtest02 while uploading. The indexes are
building for 4 days already.
Could you reset the indexes manually because after deleting the
indexes from index I still get the error while uploading the
application.

Thank you

Costi

[Jason (Google)]

Hi Costi. How many indexes are you trying to deploy? There is a hard limit of 100, and it looks like you're very close to this number.

- Jason

[Jason (Google)]

OK, I nudged your indexes into the error state and reset your Datastore Indices Count quota, but make sure not to upload more than 100 indexes or you may see this issue again.

- Jason

[Partac Constantin]

Hi Jason,

Thank you for your help. I tried to redeploy the application with just a few indexes but those indexes you nudged into error state are remaining in error state. I tried erasing all indexes from datastore-indexes.xml but this did not help either. What should I do in order to erase the indexes which are in error state.

About the limitation of 100 indexes I did not know that it existed. Is this limitation referring to 100 new indexes when deploying the application or the total count should not exceed 100 indexes. On the page http://code.google.com/appengine/docs/java/datastore/overview.html#Quotas_and_Limits it mentioned that there is a limitation of 1,000 indexes on an entity. Could you detail what you mean by 100 quota.

Thank you,

Costi

[kawai]

I'm getting 500 errors in the response of appcfg.py now.
I don't know what triggers this. Does anybody know?

Scanning files on local disk.
Initiating update.
Cloning 7 static files.
Cloning 68 application files.
Uploading 2 files.
Deploying new version.
Checking if new version is ready to serve.
Will check again in 1 seconds.
Checking if new version is ready to serve.
Closing update: new version is ready to start serving.
2009-06-23 12:12:09,135 ERROR appcfg.py:1272 An unexpected error
occurred. Aborting.
Traceback (most recent call last):
File "C:\Program Files\Google\google_appengine\google\appengine\tools
\appcfg.py", line 1265, in DoUpload
self.Commit()
File "C:\Program Files\Google\google_appengine\google\appengine\tools
\appcfg.py", line 1141, in Commit
self.StartServing()
File "C:\Program Files\Google\google_appengine\google\appengine\tools
\appcfg.py", line 1194, in StartServing
app_id=self.app_id, version=self.version)
File "C:\Program Files\Google\google_appengine\google\appengine\tools
\appengine_rpc.py", line 344, in Send
f = self.opener.open(req)
File "d:\prog\python\lib\urllib2.py", line 387, in open
response = meth(req, response)
File "d:\prog\python\lib\urllib2.py", line 498, in http_response
'http', request, response, code, msg, hdrs)
File "d:\prog\python\lib\urllib2.py", line 425, in error
return self._call_chain(*args)
File "d:\prog\python\lib\urllib2.py", line 360, in _call_chain
result = func(*args)
File "d:\prog\python\lib\urllib2.py", line 506, in
http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 500: Internal Server Error
Rolling back the update.

[Cat]

I just tried to deploy a new version and bumped its version number
from 1 to 122 (the svn number).
Now access to 122.latest...appspot.com results in a 500 Server Error
while my 1.latest... version works fine.

Some changes:
The index.yaml has not changed (except reference counts) and there
should not be a need for a new index. Some DBs do not occur in the
index (accessed by keyword & parent only).
I have changed one existing db.Model from package dbmodels to
iconmanager

application/octet-stream.
Cloning 88 static files.
Cloning 56 application files.
Uploading 26 files.

Deploying new version.
Checking if new version is ready to serve.
Will check again in 1 seconds.
Checking if new version is ready to serve.

Will check again in 2 seconds.

Checking if new version is ready to serve.
Closing update: new version is ready to start serving.

Uploading index definitions.

Error 500: --- begin server output ---

Server Error (500)
A server error has occurred.
--- end server output ---

Your app was updated, but there was an error updating your indexes.
Please retry later with appcfg.py update_indexes.

[Cat]

Ok, the error traces back to an import error on the "Logs" menu
probably my fault.
I am investigating because the local app did not show this error ...

[Cat]

Ok, when uploading version 2 and after deleting version 122 I could
trace the Error back to a circular import that did not show when
running locally.

[rjportier]

Hi Jason,

We needed to vacuum the indexes first and we did so on cpedevtest01,
cpedevtest02 and cpeacc01.
We also reduced the number of indexes to a much smaller set.

On cpedevtest02 the indexes are ok now, but on cpedevtest01 and on
cpeacc01 there are still some indexes stuck in 'Building' state. On
cpeacc01 we also get an error 500 when updating the indexes. So can
you help us out again and nudge them into the Error state? We'll then
vacuum them and update these application IDs also with the smaller
set.

Thanks!
Robert

On Jun 23, 12:55 am, Partac Constantin <cpar...@gmail.com> wrote:
> Hi Jason,
>
> Thank you for your help. I tried to redeploy the application with just a few
> indexes but those indexes you nudged into error state are remaining in error
> state. I tried erasing all indexes from datastore-indexes.xml but this did
> not help either. What should I do in order to erase the indexes which are in
> error state.
> About the limitation of 100 indexes I did not know that it existed. Is this
> limitation referring to 100 new indexes when deploying the application or

> the total count should not exceed 100 indexes. On the pagehttp://code.google.com/appengine/docs/java/datastore/overview.html#Qu...

>  it mentioned that there is a limitation of 1,000 indexes on an entity.
> Could you detail what you mean by 100 quota.
>
> Thank you,
> Costi
>

> On Mon, Jun 22, 2009 at 20:45, Jason (Google) <apija...@google.com> wrote:
> > OK, I nudged your indexes into the error state and reset your Datastore
> > Indices Count quota, but make sure not to upload more than 100 indexes or
> > you may see this issue again.
> > - Jason
>

> > On Mon, Jun 22, 2009 at 10:29 AM, Jason (Google) <apija...@google.com>wrote:
>
> >> Hi Costi. How many indexes are you trying to deploy? There is a hard limit
> >> of 100, and it looks like you're very close to this number.
> >> - Jason
>