Lipstick fails on remote pig job (Works OK when running debug mode)
104 views
Skip to first unread message
jimfr...@gmail.com
Aug 2, 2013, 8:52:14 PM8/2/13
to lipsti...@googlegroups.com
Hi,
When I run a pig job on a remote cluster, the lipstick server fails.
Lipstick Server Output
2013-08-02 17:33:38,711 [http-bio-8080-exec-1] ERROR errors.
When I run a pig job on a remote cluster, the lipstick server fails.
Lipstick Server Output
2013-08-02 17:33:38,711 [http-bio-8080-exec-1] ERROR errors.
GrailsExceptionResolver - JsonMappingException occurred when processing request: [POST] /lipstick-1.0/job/
Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"]). Stacktrace follows:
org.codehaus.jackson.map.JsonMappingException: Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"])
at org.codehaus.jackson.map.deser.SettableBeanProperty$SetterlessProperty.deserializeAndSet(SettableBeanProperty.java:418)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:119)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:96)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:369)
at org.codehaus.jackson.map.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:76)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeWithType(BeanDeserializer.java:424)
at org.codehaus.jackson.map.deser.MapDeserializer._readAndBind(MapDeserializer.java:237)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:165)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2131)
at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1395)
at pigstatus.PlanService.save(PlanService.groovy:31)
at lipstick.JobController$_closure1.doCall(JobController.groovy:55)
at lipstick.JobController.index(JobController.groovy:40)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
2013-08-02 17:33:51,592 [http-bio-8080-exec-5] ERROR errors.GrailsExceptionResolver - NullPointerException occurred when processing request: [PUT] /lipstick-1.0/job/d8a2d631-7ae5-471b-8122-60d9c3fce3b7/sampleOutput/scope-14
Cannot invoke method getSampleOutputMap() on null object. Stacktrace follows:
java.lang.NullPointerException: Cannot invoke method getSampleOutputMap() on null object
at pigstatus.PlanService.addSampleOutput(PlanService.groovy:52)
at lipstick.JobController.addSampleOutput(JobController.groovy:45)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
2013-08-02 17:35:05,238 [http-bio-8080-exec-9] ERROR errors.GrailsExceptionResolver - JsonMappingException occurred when processing request: [POST] /lipstick-1.0/job/
Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"]). Stacktrace follows:
org.codehaus.jackson.map.JsonMappingException: Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"])
at org.codehaus.jackson.map.deser.SettableBeanProperty$SetterlessProperty.deserializeAndSet(SettableBeanProperty.java:418)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:119)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:96)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:369)
at org.codehaus.jackson.map.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:76)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeWithType(BeanDeserializer.java:424)
at org.codehaus.jackson.map.deser.MapDeserializer._readAndBind(MapDeserializer.java:237)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:165)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2131)
at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1395)
at pigstatus.PlanService.save(PlanService.groovy:31)
at lipstick.JobController$_closure1.doCall(JobController.groovy:55)
at lipstick.JobController.index(JobController.groovy:40)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
2013-08-02 17:35:16,494 [http-bio-8080-exec-10] ERROR errors.GrailsExceptionResolver - NullPointerException occurred when processing request: [PUT] /lipstick-1.0/job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea/sampleOutput/scope-14
Cannot invoke method getSampleOutputMap() on null object. Stacktrace follows:
java.lang.NullPointerException: Cannot invoke method getSampleOutputMap() on null object
at pigstatus.PlanService.addSampleOutput(PlanService.groovy:52)
at lipstick.JobController.addSampleOutput(JobController.groovy:45)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
Pig Output
hadoop jar lipstick-console-0.3.jar -Dlipstick.server.url=http://192.168.1.112/lipstick -f test2.pig
13/08/02 17:35:04 INFO lipstick.Main:
build version: 0.3, ts: 2013-08-02T17:29Z, git: 23d5ef8ce9c148c305485403237f366e296bbd77
2013-08-02 17:35:04,119 [main] INFO com.netflix.lipstick.Main - build version: 0.3, ts: 2013-08-02T17:29Z, git: 23d5ef8ce9c148c305485403237f366e296bbd77
2013-08-02 17:35:04,119 [main] INFO com.netflix.lipstick.Main - Logging error messages to: /lipstick/pig_1375490104117.log
2013-08-02 17:35:04,130 [main] INFO com.netflix.lipstick.listeners.LipstickPPNL - --- Init TBPPNL ---
2013-08-02 17:35:04,391 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2013-08-02 17:35:04,811 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY
2013-08-02 17:35:05,024 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Initializing class com.netflix.lipstick.pigstatus.RestfulPigStatusClient with serviceUrl: http://192.168.1.112/lipstick
2013-08-02 17:35:05,025 [main] INFO com.netflix.lipstick.listeners.LipstickPPNL - [com.netflix.lipstick.pigtolipstick.BasicP2LClient@33c13d0b]
2013-08-02 17:35:05,039 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
2013-08-02 17:35:05,060 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1
2013-08-02 17:35:05,060 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1
2013-08-02 17:35:05,087 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2013-08-02 17:35:05,107 [main] WARN org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2013-08-02 17:35:05,899 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 500
2013-08-02 17:35:06,040 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:06,042 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2013-08-02 17:35:06,043 [main] WARN org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2013-08-02 17:35:06,043 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2013-08-02 17:35:06,046 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
2013-08-02 17:35:06,047 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=67
2013-08-02 17:35:06,048 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1
2013-08-02 17:35:06,048 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - creating jar file Job6429596826463848937.jar
2013-08-02 17:35:11,036 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - jar file Job6429596826463848937.jar created
2013-08-02 17:35:11,050 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2013-08-02 17:35:11,055 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
2013-08-02 17:35:11,055 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
2013-08-02 17:35:11,056 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Setting key [pig.schematuple.classes] with classes to deserialize []
2013-08-02 17:35:11,099 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission.
2013-08-02 17:35:11,110 [JobControl] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-08-02 17:35:11,231 [JobControl] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2013-08-02 17:35:11,232 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1
2013-08-02 17:35:11,238 [JobControl] WARN org.apache.hadoop.io.compress.snappy.LoadSnappy - Snappy native library not loaded
2013-08-02 17:35:11,240 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths (combined) to process : 1
2013-08-02 17:35:11,353 [JobControl] WARN org.apache.hadoop.mapred.LocalJobRunner - LocalJobRunner does not support symlinking into current working dir.
2013-08-02 17:35:11,467 [Thread-6] INFO org.apache.hadoop.mapred.Task - Using ResourceCalculatorPlugin : null
2013-08-02 17:35:11,481 [Thread-6] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader - Current split being processed file:/lipstick/weather.data:0+67
2013-08-02 17:35:11,486 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - io.sort.mb = 100
2013-08-02 17:35:11,608 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_local_0001
2013-08-02 17:35:11,609 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases ratings_grouped,raw
2013-08-02 17:35:11,609 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: raw[3,6],raw[-1,-1],ratings_grouped[5,18] C: R:
2013-08-02 17:35:11,609 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - data buffer = 79691776/99614720
2013-08-02 17:35:11,609 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - record buffer = 262144/327680
2013-08-02 17:35:11,627 [Thread-6] INFO org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not set... will not generate code.
2013-08-02 17:35:11,675 [main] INFO com.netflix.lipstick.pigtolipstick.BasicP2LClient - jobStartedNotification - scope scope-14 is jobId job_local_0001
2013-08-02 17:35:11,675 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
2013-08-02 17:35:11,675 [main] WARN com.netflix.lipstick.pigtolipstick.BasicP2LClient - Couldn't find job status for jobId=job_local_0001
2013-08-02 17:35:11,699 [Thread-6] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Map - Aliases being processed per job phase (AliasName[line,offset]): M: raw[3,6],raw[-1,-1],ratings_grouped[5,18] C: R:
2013-08-02 17:35:11,746 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - Starting flush of map output
2013-08-02 17:35:11,762 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - Finished spill 0
2013-08-02 17:35:11,764 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2013-08-02 17:35:11,766 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,767 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task 'attempt_local_0001_m_000000_0' done.
2013-08-02 17:35:11,780 [Thread-6] INFO org.apache.hadoop.mapred.Task - Using ResourceCalculatorPlugin : null
2013-08-02 17:35:11,780 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,784 [Thread-6] INFO org.apache.hadoop.mapred.Merger - Merging 1 sorted segments
2013-08-02 17:35:11,805 [Thread-6] INFO org.apache.hadoop.mapred.Merger - Down to the last merge-pass, with 1 segments left of total size: 124 bytes
2013-08-02 17:35:11,805 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,827 [Thread-6] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized
2013-08-02 17:35:11,829 [Thread-6] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce - Aliases being processed per job phase (AliasName[line,offset]): M: raw[3,6],raw[-1,-1],ratings_grouped[5,18] C: R:
2013-08-02 17:35:11,846 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2013-08-02 17:35:11,846 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,847 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task attempt_local_0001_r_000000_0 is allowed to commit now
2013-08-02 17:35:11,849 [Thread-6] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - Saved output of task 'attempt_local_0001_r_000000_0' to /tmp/ratings_group
2013-08-02 17:35:11,849 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce
2013-08-02 17:35:11,849 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task 'attempt_local_0001_r_000000_0' done.
2013-08-02 17:35:12,092 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:12,094 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:12,094 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:16,605 [main] WARN org.apache.pig.tools.pigstats.PigStatsUtil - Failed to get RunningJob for job job_local_0001
2013-08-02 17:35:16,650 [main] WARN com.netflix.lipstick.pigtolipstick.BasicP2LClient - Couldn't find job status for jobId=job_local_0001
2013-08-02 17:35:16,887 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:16,887 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:16,887 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:16,897 [main] INFO com.netflix.lipstick.util.OutputSampler - Sample output: (Name: ratings_grouped: Store(/tmp/ratings_group:PigStorage) - scope-13 Operator Key: scope-13)
2013-08-02 17:35:16,897 [main] INFO com.netflix.lipstick.util.OutputSampler - StoreFunc: class org.apache.pig.builtin.PigStorage
2013-08-02 17:35:16,900 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2013-08-02 17:35:16,900 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1
2013-08-02 17:35:17,142 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 500
2013-08-02 17:35:17,142 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:17,503 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:17,504 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:17,504 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:17,504 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
2013-08-02 17:35:17,726 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:17,726 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:17,726 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:17,727 [main] WARN org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2013-08-02 17:35:17,763 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
Thank You,
James
Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"]). Stacktrace follows:
org.codehaus.jackson.map.JsonMappingException: Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"])
at org.codehaus.jackson.map.deser.SettableBeanProperty$SetterlessProperty.deserializeAndSet(SettableBeanProperty.java:418)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:119)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:96)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:369)
at org.codehaus.jackson.map.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:76)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeWithType(BeanDeserializer.java:424)
at org.codehaus.jackson.map.deser.MapDeserializer._readAndBind(MapDeserializer.java:237)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:165)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2131)
at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1395)
at pigstatus.PlanService.save(PlanService.groovy:31)
at lipstick.JobController$_closure1.doCall(JobController.groovy:55)
at lipstick.JobController.index(JobController.groovy:40)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
2013-08-02 17:33:51,592 [http-bio-8080-exec-5] ERROR errors.GrailsExceptionResolver - NullPointerException occurred when processing request: [PUT] /lipstick-1.0/job/d8a2d631-7ae5-471b-8122-60d9c3fce3b7/sampleOutput/scope-14
Cannot invoke method getSampleOutputMap() on null object. Stacktrace follows:
java.lang.NullPointerException: Cannot invoke method getSampleOutputMap() on null object
at pigstatus.PlanService.addSampleOutput(PlanService.groovy:52)
at lipstick.JobController.addSampleOutput(JobController.groovy:45)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
2013-08-02 17:35:05,238 [http-bio-8080-exec-9] ERROR errors.GrailsExceptionResolver - JsonMappingException occurred when processing request: [POST] /lipstick-1.0/job/
Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"]). Stacktrace follows:
org.codehaus.jackson.map.JsonMappingException: Problem deserializing 'setterless' property 'schema': get method returned null (through reference chain: com.netflix.lipstick.model.P2jPlanPackage["optimized"]->com.netflix.lipstick.model.P2jPlan["plan"]->com.netflix.lipstick.model.operators.P2jLOCogroup["schema"]->com.netflix.lipstick.model.operators.elements.SchemaElement["schema"])
at org.codehaus.jackson.map.deser.SettableBeanProperty$SetterlessProperty.deserializeAndSet(SettableBeanProperty.java:418)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:119)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:96)
at org.codehaus.jackson.map.deser.CollectionDeserializer.deserialize(CollectionDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:369)
at org.codehaus.jackson.map.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:76)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeWithType(BeanDeserializer.java:424)
at org.codehaus.jackson.map.deser.MapDeserializer._readAndBind(MapDeserializer.java:237)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:165)
at org.codehaus.jackson.map.deser.MapDeserializer.deserialize(MapDeserializer.java:25)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:230)
at org.codehaus.jackson.map.deser.SettableBeanProperty$MethodProperty.deserializeAndSet(SettableBeanProperty.java:334)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:495)
at org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:351)
at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2131)
at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1395)
at pigstatus.PlanService.save(PlanService.groovy:31)
at lipstick.JobController$_closure1.doCall(JobController.groovy:55)
at lipstick.JobController.index(JobController.groovy:40)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
2013-08-02 17:35:16,494 [http-bio-8080-exec-10] ERROR errors.GrailsExceptionResolver - NullPointerException occurred when processing request: [PUT] /lipstick-1.0/job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea/sampleOutput/scope-14
Cannot invoke method getSampleOutputMap() on null object. Stacktrace follows:
java.lang.NullPointerException: Cannot invoke method getSampleOutputMap() on null object
at pigstatus.PlanService.addSampleOutput(PlanService.groovy:52)
at lipstick.JobController.addSampleOutput(JobController.groovy:45)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
Pig Output
hadoop jar lipstick-console-0.3.jar -Dlipstick.server.url=http://192.168.1.112/lipstick -f test2.pig
13/08/02 17:35:04 INFO lipstick.Main:
build version: 0.3, ts: 2013-08-02T17:29Z, git: 23d5ef8ce9c148c305485403237f366e296bbd77
2013-08-02 17:35:04,119 [main] INFO com.netflix.lipstick.Main - build version: 0.3, ts: 2013-08-02T17:29Z, git: 23d5ef8ce9c148c305485403237f366e296bbd77
2013-08-02 17:35:04,119 [main] INFO com.netflix.lipstick.Main - Logging error messages to: /lipstick/pig_1375490104117.log
2013-08-02 17:35:04,130 [main] INFO com.netflix.lipstick.listeners.LipstickPPNL - --- Init TBPPNL ---
2013-08-02 17:35:04,391 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:///
2013-08-02 17:35:04,811 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY
2013-08-02 17:35:05,024 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Initializing class com.netflix.lipstick.pigstatus.RestfulPigStatusClient with serviceUrl: http://192.168.1.112/lipstick
2013-08-02 17:35:05,025 [main] INFO com.netflix.lipstick.listeners.LipstickPPNL - [com.netflix.lipstick.pigtolipstick.BasicP2LClient@33c13d0b]
2013-08-02 17:35:05,039 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
2013-08-02 17:35:05,060 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1
2013-08-02 17:35:05,060 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1
2013-08-02 17:35:05,087 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2013-08-02 17:35:05,107 [main] WARN org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2013-08-02 17:35:05,899 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 500
2013-08-02 17:35:06,040 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:06,042 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2013-08-02 17:35:06,043 [main] WARN org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2013-08-02 17:35:06,043 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2013-08-02 17:35:06,046 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
2013-08-02 17:35:06,047 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=67
2013-08-02 17:35:06,048 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1
2013-08-02 17:35:06,048 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - creating jar file Job6429596826463848937.jar
2013-08-02 17:35:11,036 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - jar file Job6429596826463848937.jar created
2013-08-02 17:35:11,050 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2013-08-02 17:35:11,055 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
2013-08-02 17:35:11,055 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
2013-08-02 17:35:11,056 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Setting key [pig.schematuple.classes] with classes to deserialize []
2013-08-02 17:35:11,099 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission.
2013-08-02 17:35:11,110 [JobControl] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-08-02 17:35:11,231 [JobControl] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2013-08-02 17:35:11,232 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1
2013-08-02 17:35:11,238 [JobControl] WARN org.apache.hadoop.io.compress.snappy.LoadSnappy - Snappy native library not loaded
2013-08-02 17:35:11,240 [JobControl] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths (combined) to process : 1
2013-08-02 17:35:11,353 [JobControl] WARN org.apache.hadoop.mapred.LocalJobRunner - LocalJobRunner does not support symlinking into current working dir.
2013-08-02 17:35:11,467 [Thread-6] INFO org.apache.hadoop.mapred.Task - Using ResourceCalculatorPlugin : null
2013-08-02 17:35:11,481 [Thread-6] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader - Current split being processed file:/lipstick/weather.data:0+67
2013-08-02 17:35:11,486 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - io.sort.mb = 100
2013-08-02 17:35:11,608 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_local_0001
2013-08-02 17:35:11,609 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Processing aliases ratings_grouped,raw
2013-08-02 17:35:11,609 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: raw[3,6],raw[-1,-1],ratings_grouped[5,18] C: R:
2013-08-02 17:35:11,609 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - data buffer = 79691776/99614720
2013-08-02 17:35:11,609 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - record buffer = 262144/327680
2013-08-02 17:35:11,627 [Thread-6] INFO org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not set... will not generate code.
2013-08-02 17:35:11,675 [main] INFO com.netflix.lipstick.pigtolipstick.BasicP2LClient - jobStartedNotification - scope scope-14 is jobId job_local_0001
2013-08-02 17:35:11,675 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
2013-08-02 17:35:11,675 [main] WARN com.netflix.lipstick.pigtolipstick.BasicP2LClient - Couldn't find job status for jobId=job_local_0001
2013-08-02 17:35:11,699 [Thread-6] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Map - Aliases being processed per job phase (AliasName[line,offset]): M: raw[3,6],raw[-1,-1],ratings_grouped[5,18] C: R:
2013-08-02 17:35:11,746 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - Starting flush of map output
2013-08-02 17:35:11,762 [Thread-6] INFO org.apache.hadoop.mapred.MapTask - Finished spill 0
2013-08-02 17:35:11,764 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
2013-08-02 17:35:11,766 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,767 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task 'attempt_local_0001_m_000000_0' done.
2013-08-02 17:35:11,780 [Thread-6] INFO org.apache.hadoop.mapred.Task - Using ResourceCalculatorPlugin : null
2013-08-02 17:35:11,780 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,784 [Thread-6] INFO org.apache.hadoop.mapred.Merger - Merging 1 sorted segments
2013-08-02 17:35:11,805 [Thread-6] INFO org.apache.hadoop.mapred.Merger - Down to the last merge-pass, with 1 segments left of total size: 124 bytes
2013-08-02 17:35:11,805 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,827 [Thread-6] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized
2013-08-02 17:35:11,829 [Thread-6] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce - Aliases being processed per job phase (AliasName[line,offset]): M: raw[3,6],raw[-1,-1],ratings_grouped[5,18] C: R:
2013-08-02 17:35:11,846 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
2013-08-02 17:35:11,846 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner -
2013-08-02 17:35:11,847 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task attempt_local_0001_r_000000_0 is allowed to commit now
2013-08-02 17:35:11,849 [Thread-6] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - Saved output of task 'attempt_local_0001_r_000000_0' to /tmp/ratings_group
2013-08-02 17:35:11,849 [Thread-6] INFO org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce
2013-08-02 17:35:11,849 [Thread-6] INFO org.apache.hadoop.mapred.Task - Task 'attempt_local_0001_r_000000_0' done.
2013-08-02 17:35:12,092 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:12,094 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:12,094 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:16,605 [main] WARN org.apache.pig.tools.pigstats.PigStatsUtil - Failed to get RunningJob for job job_local_0001
2013-08-02 17:35:16,650 [main] WARN com.netflix.lipstick.pigtolipstick.BasicP2LClient - Couldn't find job status for jobId=job_local_0001
2013-08-02 17:35:16,887 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:16,887 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:16,887 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:16,897 [main] INFO com.netflix.lipstick.util.OutputSampler - Sample output: (Name: ratings_grouped: Store(/tmp/ratings_group:PigStorage) - scope-13 Operator Key: scope-13)
2013-08-02 17:35:16,897 [main] INFO com.netflix.lipstick.util.OutputSampler - StoreFunc: class org.apache.pig.builtin.PigStorage
2013-08-02 17:35:16,900 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1
2013-08-02 17:35:16,900 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1
2013-08-02 17:35:17,142 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 500
2013-08-02 17:35:17,142 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:17,503 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:17,504 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:17,504 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:17,504 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
2013-08-02 17:35:17,726 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server. Received status code 404
2013-08-02 17:35:17,726 [main] ERROR com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Error contacting Lipstick server.
2013-08-02 17:35:17,726 [main] INFO com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://192.168.1.112/lipstick#job/02e207e1-ffa3-48be-8de9-c8df6ddb59ea to view progress.
2013-08-02 17:35:17,727 [main] WARN org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2013-08-02 17:35:17,763 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
Thank You,
James
Reply all
Reply to author
Forward
0 new messages