Issue 342 in google-api-python-client: oauth2client on GCE throws AttributeError no attribute redirect_uri

[google-api-p...@googlecode.com]

Status: New
Owner: ----
Labels: Type-Defect Priority-Medium

New issue 342 by ccliff...@archipelagois.com: oauth2client on GCE throws
AttributeError no attribute redirect_uri
https://code.google.com/p/google-api-python-client/issues/detail?id=342

[Use this form for both apiclient and oauth2client issues]

What steps will reproduce the problem?
1. I am porting an Python 2.7 script to a new GCE
2. The script runs on local laptop and connects to BigQuery perfectly
3. The script throws error when run on GCE instance

What is the expected output? What do you see instead?
When run on local laptop all is good. But, when run on a new GCE which I
build 2 hours ago with the latest client API, the script throws the
following error after the client creates the flow:


_HAVE_FLOW: True
TEST _HAVE_FLOW: True
have storage, next use it to retrieve credential from file:
bigquery_credentials.dat
ERROR - credentials is None
Run oauth2 flow with default arguments
- Write_CVS_Records_to_BigQuery() Unexpected error:
<type 'exceptions.AttributeError'>
Write_CVS_Records_to_BigQuery() AttributeError: 'NoneType' object has no
attribute 'redirect_uri'
CLOUDSDK_CONFIG: /home/.../.config/gcloud
GOOGLE_APPLICATION_CREDENTIALS:
client_secret_Xkjduoiyewryq3.apps.googleusercontent.com.json
GCLOUD_DATASET_ID: applied-algebra-93003
------------------------------------------------------------
Traceback (most recent call last):
File "/dump/CI_SA_load_bq.py", line 221, in Write_CVS_Records_to_BigQuery
credentials = tools.run_flow(_FLOW, storage,
tools.argparser.parse_args([]))
File "/usr/lib/python2.7/site-packages/oauth2client/util.py", line 137,
in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/oauth2client/tools.py", line 190,
in run_flow
flow.redirect_uri = oauth_callback
AttributeError: 'NoneType' object has no attribute 'redirect_uri'
------------------------------------------------------------
Traceback (most recent call last):
File "/dump/CI_SA_load_bq.py", line 266, in <module>
Write_CVS_Records_to_BigQuery()
File "/dump/CI_SA_load_bq.py", line 221, in Write_CVS_Records_to_BigQuery
credentials = tools.run_flow(_FLOW, storage,
tools.argparser.parse_args([]))
File "/usr/lib/python2.7/site-packages/oauth2client/util.py", line 137,
in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/oauth2client/tools.py", line 190,
in run_flow
flow.redirect_uri = oauth_callback
AttributeError: 'NoneType' object has no attribute 'redirect_uri'
~]$

What version of the product are you using? On what operating system?
The latest verion installed by pip. The most recent Centos version of GCE

Please provide any additional information below.

More than likely this is a configuration problem on the GCE; I've likely
missed adding some setting required on a GCE instance. Here's the 2 suspect
methods related to the AttributeError:

_SECRET_FILE_NAME='client_secret_devgce2.apps.googleusercontent.com.json'
_REDIRECT_URI='urn:ietf:wg:oauth:2.0:oob'

# Set up flow object to be used for authenticating the client
def Get_Client_Flow():
try:
if os.path.exists(_SECRET_FOLDER_NAME):
print "_SECRET_FOLDER_NAME: %s
exists"%(str(_SECRET_FOLDER_NAME))
_SECRET_FILE =
os.path.join(_SECRET_FOLDER_NAME,_SECRET_FILE_NAME)
if os.path.isfile(_SECRET_FILE):
print "_SECRET_FILE: %s exists"%(_SECRET_FILE)
_HAVE_SECRET_FILE=True
_FLOW = flow_from_clientsecrets(_SECRET_FILE,

scope='https://www.googleapis.com/auth/bigquery',
redirect_uri=_REDIRECT_URI)
if not _FLOW==None:
_HAVE_FLOW.append(True)
print ("_HAVE_FLOW: %s")%(_HAVE_FLOW[0])
else:
_HAVE_FLOW.append(False)
print ("_HAVE_FLOW: %s")%(_HAVE_FLOW[0])
else:
print "_SECRET_FILE: %s does not exist"%(str(_SECRET_FILE))
else:
print "_SECRET_FOLDER_NAME: %s does not
exist"%(str(_SECRET_FOLDER_NAME))

except Exception, inst:
print "\n - Get_Client_Flow() Unexpected
error: %s"%(str(sys.exc_info()[0]))
if isinstance(inst,ValueError):
print "Get_Client_Flow() - ValueError: %s\n"%(inst.message)
if isinstance(inst,AttributeError):
print "Get_Client_Flow() - AttributeError: %s\n"%(inst.message)
if isinstance(inst,TypeError):
print "Get_Client_Flow() - TypeError: %s\n"%(inst.message)
#print "\nPYTHONPATH: %s" % (os.environ['PYTHONPATH'])
print "CLOUDSDK_CONFIG: %s" % (os.environ['CLOUDSDK_CONFIG'])

print "GOOGLE_APPLICATION_CREDENTIALS: %s"%(os.environ['GOOGLE_APPLICATION_CREDENTIALS'])
print "GCLOUD_DATASET_ID: %s"%(os.environ['GCLOUD_DATASET_ID'])
print '-'*60
traceback.print_exc(file=sys.stdout)
print '-'*60
raise


def Write_CVS_Records_to_BigQuery():
try:
print "\n Write_CVS_Records_to_BigQuery()"
'''
Connect to BigQuery Service API
'''
Get_Client_Flow()

if _HAVE_FLOW[0]:
print ("TEST _HAVE_FLOW: %s")%(_HAVE_FLOW[0])
#_FLOW.redirect_uri = _REDIRECT_URI

# GET oauth2client STORAGE
storage = Storage('bigquery_credentials.dat')
if storage is None:
print "storage is None, error creating means for retrieving
credential from file: %s"%('bigquery_credentials.dat')
else:
print "have storage, next use it to retrieve credential
from file: %s"%('bigquery_credentials.dat')
credentials = storage.get()
if credentials is None:
print "ERROR - credentials is None"

if credentials is None or credentials.invalid:
print "Run oauth2 flow with default arguments"
# Run oauth2 flow with default arguments.
credentials = tools.run_flow(_FLOW, storage,
tools.argparser.parse_args([]))

# create the HTTP object to handle your requests, and authorize
with your credentials
http = httplib2.Http()
http = credentials.authorize(http)

# create the service object for interacting with BigQuery
_BIGQUERY_SERVICE = build('bigquery', 'v2', http=http)

print ("BEGIN call to loadTable()")
try:
#print "did not call loadTable()"
loadTable(_BIGQUERY_SERVICE, _PROJECT_NUMBER,
_BIGQUERY_DATASET_ID, _TARGET_TABLE_ID, _SOURCE_CSV)

except HttpError as err:
print 'Write_CVS_Records_to_BigQuery() HttpError:',
pprint.pprint(err.resp)
print 'Write_CVS_Records_to_BigQuery()- HttpError
content: %s: '%(err.content)
print 'Write_CVS_Records_to_BigQuery() HttpError uri -
loadTable(): ', pprint.pprint(err.uri)

except AccessTokenRefreshError:
print ("Write_CVS_Records_to_BigQuery() - Credentials have
been revoked or expired, please re-run"
"the application to re-authorize")
else:
print ("TEST _HAVE_FLOW: %s")%(_HAVE_FLOW[0])

except Exception, inst:
print "\n - Write_CVS_Records_to_BigQuery() Unexpected
error: %s"%(str(sys.exc_info()[0]))
if isinstance(inst,ValueError):
print "Write_CVS_Records_to_BigQuery()
ValueError: %s\n"%(inst.message)
if isinstance(inst,AttributeError):
print "Write_CVS_Records_to_BigQuery()
AttributeError: %s\n"%(inst.message)
if isinstance(inst,TypeError):

print "Write_CVS_Records_to_BigQuery()TypeError: %s\n"%(inst.message)
#print "\nPYTHONPATH: %s" % (os.environ['PYTHONPATH'])
print "CLOUDSDK_CONFIG: %s" % (os.environ['CLOUDSDK_CONFIG'])

print "GOOGLE_APPLICATION_CREDENTIALS: %s"%(os.environ['GOOGLE_APPLICATION_CREDENTIALS'])
print "GCLOUD_DATASET_ID: %s"%(os.environ['GCLOUD_DATASET_ID'])
print '-'*60
traceback.print_exc(file=sys.stdout)
print '-'*60
raise

This is not likely, in my view, a bug with the API, but a matter of an
omitted setting in the code or in the .bashrc file. The only difference in
the code that runs on the laptop and the code that fails to run on the GCE
is the new addition of _REDIRECT_URI (when creating the flow object)

Any suggestions to fix this mis-configuration are appreciated.



--
You received this message because this project is configured to send all
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

[google-api-p...@googlecode.com]

Comment #1 on issue 342 by ccliff...@archipelagois.com: oauth2client on GCE

throws AttributeError no attribute redirect_uri
https://code.google.com/p/google-api-python-client/issues/detail?id=342

I edited the client secret file to
contain "redirect_uris":["http://localhost", "urn:ietf:wg:oauth:2.0:oob"],
and I assigned these to the _REDIRECT_URI array as well, but the same error
is thrown.