Cannot be found on the History Server

瀏覽次數:119 次
跳到第一則未讀訊息

Roberto Sancho Rojas

未讀,
2016年10月21日 下午1:38:562016/10/21
收件者:Hue-Users

​Hi:

Finally i have configure the sqoop2 and from the shell everythin is working, y create link and jobs, but when i execute the job, i can see this error:

Any idea??


sqoop:000> start job --jid 4
Submission details
Job ID: 4
Server URL: http://localhost:12000/sqoop/
Created by: hdfs
Creation date: 2016-10-21 16:42:17 CEST
Lastly updated by: hdfs
External ID: job_1477053779692_0011
        http://xxx.xx.xx.xx:8088/proxy/application_1477053779692_0011/
Source Connector schema: Schema{name=test.Persons,columns=[
        FixedPoint{name=PersonID,nullable=true,type=FIXED_POINT,byteSize=4,signed=true},
        Text{name=LastName,nullable=true,type=TEXT,charSize=null},
        Text{name=FirstName,nullable=true,type=TEXT,charSize=null},
        Text{name=Address,nullable=true,type=TEXT,charSize=null},
        Text{name=City,nullable=true,type=TEXT,charSize=null}]}
2016-10-21 16:42:17 CEST: BOOTING  - Progress is not available      
There was a problem communicating with the server: Job application_1477053779692_0007 has expired.
779692_0012 has expired.: Traceback (most recent call last):
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 112, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/transaction.py", line 371, in inner
    return func(*args, **kwargs)
  File "/usr/local/hue/apps/jobbrowser/src/jobbrowser/views.py", line 81, in decorate
    raise PopupException(_('Job %s has expired.') % jobid, detail=_('Cannot be found on the History Server.'))
PopupException: Job application_1477053779692_0012 has expired.
[21/Oct/2016 16:51:51 +0200] connectionpool INFO     Starting new HTTP connection (10): xxx.xx.xx.xx
[21/Oct/2016 16:51:51 +0200] resource     DEBUG    GET Got response: {"app":{"id":"application_1477053779692_0012","user":"sqoop","name":"Sqoop: test","queue":"default","state":"FAILED","finalStatus":"FAILED","progress":0.0,"trackingUI":"History","trackingUrl":"http://xxx.xx.xx.xx:8088/cluster/app/application_1477053779692_0012","diagnostics":"Application application_1477053779692_0012 failed 2 times due to AM Container for appattempt_1477053779692_0012_000002 exited with  exitCode: 1\nFor more detailed output, check the application tracking page: http://xxx.xx.xx.xx:8088/cluster/app/application_1477053779692_0012 Then click on links to logs of each attempt.\nDiagnostics: Exception from container-launch.\nContainer id: container_e55_1477053779692_0012_02_000001\nExit code: 1\nException message: /hadoop/yarn/local/usercache/sqoop/appcache/application_1477053779692_0012/container_e55_1477053779692_0012_02_000001/launch_container.sh: línea 23: $PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-fram...
[21/Oct/2016 16:51:51 +0200] connectionpool DEBUG    "GET /ws/v1/cluster/apps/application_1477053779692_0012?user.name=hue&doAs=sqoop HTTP/1.1" 200 None
[21/Oct/2016 16:51:51 +0200] access       INFO     xxx.xx.xx.xx sqoop - "GET /jobbrowser/jobs/application_1477053779692_0012 HTTP/1.1"
[21/Oct/2016 16:51:43 +0200] middleware   INFO     Processing exception: Job application_1477053779692_0012 has expired.: Traceback (most recent call last):
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py", line 112, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/local/hue/build/env/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/transaction.py", line 371, in inner
    return func(*args, **kwargs)
  File "/usr/local/hue/apps/jobbrowser/src/jobbrowser/views.py", line 81, in decorate
    raise PopupException(_('Job %s has expired.') % jobid, detail=_('Cannot be found on the History Server.'))
PopupException: Job application_1477053779692_0012 has expired.
[21/Oct/2016 16:51:43 +0200] connectionpool INFO     Starting new HTTP connection (9): xxx.xx.xx.xx
[21/Oct/2016 16:51:43 +0200] resource     DEBUG    GET Got response: {"app":{"id":"application_1477053779692_0012","user":"sqoop","name":"Sqoop: test","queue":"default","state":"FAILED","finalStatus":"FAILED","progress":0.0,"trackingUI":"History","trackingUrl":"http://xxx.xx.xx.xx:8088/cluster/app/application_1477053779692_0012","diagnostics":"Application application_1477053779692_0012 failed 2 times due to AM Container for appattempt_1477053779692_0012_000002 exited with  exitCode: 1\nFor more detailed output, check the application tracking page: http://xxx.xx.xx:8088/cluster/app/application_1477053779692_0012 Then click on links to logs of each attempt.\nDiagnostics: Exception from container-launch.\nContainer id: container_e55_1477053779692_0012_02_000001\nExit code: 1\nException message: /hadoop/yarn/local/usercache/sqoop/appcache/application_1477053779692_0012/container_e55_1477053779692_0012_02_000001/launch_container.sh: línea 23: $PWD:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-fram...
[21/Oct/2016 16:51:43 +0200] connectionpool DEBUG    "GET /ws/v1/cluster/apps/application_1477053779692_0012?user.name=hue&doAs=sqoop HTTP/1.1" 200 None
[21/Oct/2016 16:51:43 +0200] access       INFO     xxx.xx.xx.xx sqoop - "GET /jobbrowser/jobs/application_1477053779692_0012 HTTP/1.1"
[21/Oct/2016 16:51:43 +0200] resource     DEBUG    GET Got response: {"apps":null}
[21/Oct/2016 16:51:43 +0200] connectionpool DEBUG    "GET /ws/v1/cluster/apps?finalStatus=UNDEFINED&limit=1000&user.name=hue&doAs=sqoop HTTP/1.1" 200 None
[21/Oct/2016 16:51:43 +0200] access       INFO     xxx.xx.xx.xx sqoop - "POST /jobbrowser/jobs/ HTTP/1.1"
[21/Oct/2016 16:51:41 +0200] resource     DEBUG    GET Got response: {"apps":{"app":[{"id":"application_1477053779692_0012","user":"sqoop","name":"Sqoop: test","queue":"default","state":"ACCEPTED","finalStatus":"UNDEFINED","progress":0.0,"trackingUI":"UNASSIGNED","diagnostics":"[vie oct 21 16:51:41 +0200 2016] Application is Activated, waiting for resources to be assigned for AM.  Details : AM Partition = <DEFAULT_PARTITION> ; Partition Resource = <memory:2816, vCores:1> ; Queue's Absolute capacity = 100.0 % ; Queue's Absolute used capacity = 0.0 % ; Queue's Absolute max capacity = 100.0 % ; ","clusterId":1477053779692,"applicationType":"MAPREDUCE","applicationTags":"","priority":0,"startedTime":1477061501319,"finishedTime":0,"elapsedTime":287,"allocatedMB":0,"allocatedVCores":0,"runningContainers":0,"memorySeconds":0,"vcoreSeconds":0,"queueUsagePercentage":0.0,"clusterUsagePercentage":0.0,"preemptedResourceMB":0,"preemptedResourceVCores":0,"numNonAMContainerPreempted":0,"numAMContainerPreempted":0,"resourceRequests":[{"capability":{"memory":256,"memory...

I can connect into MYSQL database from my workers 
[ro...@xxx.xx.xx.xx opt]# telnet xxx.xx.xx.xx 3306
Trying xxx.xxx.x.xxx...
Connected to xxx.xxx.x.xx.
Escape character is '^]'.  

Roberto Sancho Rojas

未讀,
2016年10月21日 下午2:51:282016/10/21
收件者:Hue-Users

Hi: after get to run jobs from shell, now i cant run jobs from hue, but i can see all the links and jobs, so, any suggestion??
回覆所有人
回覆作者
轉寄
0 則新訊息