Loading Datastore Authentication Problem

[Joseph Mansigian]

Hello,

I am trying to move data from my local datastore to the appengine live datastore by downloading from
my local datastore to a file I intend as input in an appcfg.py upload_data action.  I am getting stopped
on authentication. I have carefully retried to rule out entering wrong email/password.  My questions are :

1) Am I on the right track with the method I am using ?

2) What do I have to do to be seen as authenticated on the development server for appcfg.py use ?

3) Is it necessary for me to generate or write a configuration file if I only want
   to upload my local datastore with no transformations on the data already in there ?

Thanks,  Joe


COMMAND :

appcfg.py download_data --application=pathways-energy-demo --url=http://localhost:8080 --filename=dump

LOG FILE :

[INFO    ] Logging to bulkloader-log-20110707.065327
[INFO    ] Throttling transfers:
[INFO    ] Bandwidth: 250000 bytes/second
[INFO    ] HTTP connections: 8/second
[INFO    ] Entities inserted/fetched/modified: 20/second
[INFO    ] Batch Size: 10
[INFO    ] Opening database: bulkloader-progress-20110707.065327.sql3
[INFO    ] Opening database: bulkloader-results-20110707.065327.sql3
Please enter login credentials for localhost
Email: jcman...@gmail.com
Password for jcman...@gmail.com:
[INFO    ] Connecting to localhost:8080
[ERROR   ] Exception during authentication
Traceback (most recent call last):
  File "/home/joe/google_appengine_1.5.1/google/appengine/tools/bulkloader.py", line 3431, in Run
    self.request_manager.Authenticate()
  File "/home/joe/google_appengine_1.5.1/google/appengine/tools/bulkloader.py", line 1319, in Authenticate
    remote_api_stub.MaybeInvokeAuthentication()
  File "/home/joe/google_appengine_1.5.1/google/appengine/ext/remote_api/remote_api_stub.py", line 656, in MaybeInvokeAuthentication
    datastore_stub._server.Send(datastore_stub._path, payload=None)
  File "/home/joe/google_appengine_1.5.1/google/appengine/tools/appengine_rpc.py", line 365, in Send
    f = self.opener.open(req)
  File "/usr/lib/python2.6/urllib2.py", line 397, in open
    response = meth(req, response)
  File "/usr/lib/python2.6/urllib2.py", line 510, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.6/urllib2.py", line 435, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.6/urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.6/urllib2.py", line 518, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 404: Not Found
[INFO    ] Authentication Failed

[Renan Mobile]

I get stopped on authentication too!  When i tried too update my dowloaded appengine data to the development server...

I'll post everything that i tried to avoid this error later.

Please, someone help us.

Thanks

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/TWRo2Tr9wmkJ.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
>

[Renan Mobile]

Hello! I'll detail what i did.

What i need: I always want upload production data to the development server.
Development Environment:
Notebook: Macbook Pro/ Snow Leopard
Eclipse: Helios/ AppEngine Java SDK

What i searched and found:
First i found this discussions:
https://groups.google.com/d/topic/google-appengine-java/f_Jf_3R5t8s/discussion (Remote_api in Java works in Development Server?)
https://groups.google.com/d/topic/google-appengine-java/OOhnk1yrF-E/discussion (How to use Python Bulk uploader to import data in local_db.bin ?)
https://groups.google.com/d/topic/google-appengine-java/mEwbR0fBpE4/discussion (Python bulk loader tool with local dev server of GAE Java)
https://groups.google.com/d/topic/google-appengine/5NHTMV8OneA/discussion (Upload data to development server) - This last link post a workaround, but it didn't work for me.

After that i found a chapter of a book and an article from http://appengine-cookbook.appspot.com :
http://books.google.com.br/books?id=6cL_kCZ4NJ4C&pg=PA280&lpg=PA280&dq=bulk+to+local+development+authentication+failed&source=bl&ots=sJbePRNRji&sig=oa03p1NCys1YxQVbXz3iYCz_zzQ&hl=pt-BR&ei=f5y_TZGlMMHDgQfsltDXBQ&sa=X&oi=book_result&ct=result&resnum=2&ved=0CB8Q6AEwAQ#v=onepage&q=bulk%20to%20local%20development%20authentication%20failed&f=false (BOOK)


http://appengine-cookbook.appspot.com/recipe/the-complete-guide-to-managing-datastore-on-google-app-engine-for-java-using-bulk-loader/?id=ahJhcHBlbmdpbmUtY29va2Jvb2tylwELEgtSZWNpcGVJbmRleCI8YWhKaGNIQmxibWRwYm1VdFkyOXZhMkp2YjJ0eUZ3c1NDRU5oZEdWbmIzSjVJZ2xFWVhSaGMzUnZjbVVNDAsSBlJlY2lwZSI-YWhKaGNIQmxibWRwYm1VdFkyOXZhMkp2YjJ0eUZ3c1NDRU5oZEdWbmIzSjVJZ2xFWVhSaGMzUnZjbVVNNzMM#add-comments-container (Article)

What i beg for:
Please... i really need this help. it'll make my work a lot of easier.

Thanks for create this discussion, Joseph Mansigian

2011/7/7 Renan Mobile <renan...@renanmobile.com>

--
Atenciosamente,

-----
Presidente Renan Franca
____
Renan Mobile ltda: http://renanmobile.com - Soluções em Dispositivos Móveis (Smartphones) com integração via web.
Soluções em:
        Android (Smartphones);
        Google Web Toolkit (Web);

[Renan Mobile]

OMG!

IT WORKS!!!!!!!!!!!

I just download the Charles Proxy app (Mac OSX), run it and use the command line:
./appcfg.py upload_data --application=myapplicationid --filename=data/mydatastorebackup.cvs --url=http://localhost:8888/remote_api

I don't know why and how it works! BUT WORKS!

2011/7/7 Renan Mobile <renan...@renanmobile.com>