Sqoop2 doesnt work with Hue 3.11

78 views
Skip to first unread message

Roberto Sancho Rojas

unread,
Oct 19, 2016, 7:11:35 AM10/19/16
to Hue-Users
Hi: there are any special configuracion for sqoop2 in Hue 3.11, its not working and sqoop2 server is running

From sqoop2 the log is:
 [org.apache.sqoop.audit.FileAuditLogger.logAuditEvent(FileAuditLogger.java:61)] user=sqoop.anonymous.user ip=xx.x.xxx.xx  op=get  obj=driver      objId=



Here from hue the error:
[19/Oct/2016 13:07:25 +0200] access       INFO     172.22.36.58 hue - "GET /jobbrowser/ HTTP/1.1"
[19/Oct/2016 13:07:25 +0200] middleware   INFO     Processing exception: 'unicode' object has no attribute 'setdefault': Traceback (most recent call last):
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 112, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/transaction.py", line 371, in inner
    return func(*args, **kwargs)
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/views/decorators/cache.py", line 52, in _wrapped_view_func
    response = view_func(request, *args, **kwargs)
  File "/usr/local/hue/apps/sqoop/src/sqoop/api/driver.py", line 46, in driver
    response['driver'] = c.get_driver().to_dict()
  File "/usr/local/hue/apps/sqoop/src/sqoop/client/base.py", line 77, in get_driver
    driver = Driver.from_dict(resp_dict)
  File "/usr/local/hue/apps/sqoop/src/sqoop/client/driver.py", line 35, in from_dict
    driver_dict['job_config'] = [ Config.from_dict(job_config_dict) for job_config_dict in driver_dict['job-config']]
  File "/usr/local/hue/apps/sqoop/src/sqoop/client/config.py", line 32, in from_dict
    config_dict['inputs'] = [Input.from_dict(input_dict) for input_dict in config_dict.setdefault('inputs', [])]
AttributeError: 'unicode' object has no attribute 'setdefault'

[19/Oct/2016 13:07:25 +0200] resource     DEBUG    GET Got response:
{'transfer-encoding': 'chunked', 'sqoop-error-code': '1000', 'server': 'Jetty(9.2.13.v20150730)', 'sqoop-error-message': 'OK', 'date': 'Wed, 19 Oct 2016 13:07:17 GMT', 'content-type': 'application/json; charset="UTF-8"'}
{"job-config":{"configs":[{"validators":[],"inputs":[{"editable":"ANY","validators":[],"name":"throttlingConfig.numExtractors","id":88,"sensitive":false,"overrides":"","type":"INTEGER"},{"editable":"ANY","validators":[],"name":"throttlingConfig.numLoaders","id":89,"sensitive":false,"overrides":"","type":"INTEGER"}],"name":"throttlingConfig","id":22,"type":"JOB"},{"validators":[],"inputs":[{"editable":"ANY","validators":[],"name":"jarConfig.extraJars","id":90,"sensitive":false,"overrides":"","type":"LIST"}],"name":"jarConfig","id":23,"type":"JOB"}],"validators":[]},"all-config-resources":{"jarConfig.help":"Classpath configuration specific to the driver","throttlingConfig.numLoaders.label":"Loaders","jarConfig.label":"Classpath configuration","throttlingConfig.numExtractors.help":"Number of extractors that Sqoop will use","throttlingConfig.numLoaders.help":"Number of loaders that Sqoop will use","jarConfig.extraJars.help":"A list of the FQDNs of additional jars that are needed to execute the job","throttlingConfig.numExtractors.label":"Extractors","jarConfig.extraJars.label":"Extra mapper jars","throttlingConfig.label":"Throttling resources","throttlingConfig.help":"Set throttling boundaries to not overload your systems"},"id":8,"version":"1"}
[19/Oct/2016 13:07:25 +0200] exception    ERROR    <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /sqoop/v1/connectors. Reason:
<pre>    Not Found</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>

[19/Oct/2016 13:07:25 +0200] connectionpool DEBUG    "GET /sqoop/v1/driver HTTP/1.1" 200 None
[19/Oct/2016 13:07:25 +0200] exception    ERROR    No se han podido obtener los conectores.

August Wu

unread,
Dec 8, 2016, 1:27:51 AM12/8/16
to Hue-Users, robert...@gmail.com
I have the same error,hue 3.9 ,Sqoop 1.4.6-cdh5.9.0
did you  resolved  it?

在 2016年10月19日星期三 UTC+8下午7:11:35，Roberto Sancho Rojas写道：

Romain Rigaux

unread,
Dec 8, 2016, 5:18:11 PM12/8/16
to August Wu, Hue-Users, robert...@gmail.com
The Sqoop2 App only works with exactly 1.99.5,
above version is Sqoop1

--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+unsubscribe@cloudera.org.

Reply all
Reply to author
Forward
0 new messages