--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/FNZeo2vlWRY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/c1881649-7234-40dd-8f28-76d7a0d5e2e0%40googlegroups.com.
"ioConfig" : {
  "type" : "hadoop",
  "inputSpec" : {
    "type" : "static",
    "paths" : "quickstart/wikiticker-2016-06-27-sampled.json"
  },
  "metadataUpdateSpec" : null,
  "segmentOutputPath" : null
},
When the deep storage is defined correctly, your segmentOutputPath is not null.
You should investigate that way, see the overlord logs when it starts maybe ?
--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/FNZeo2vlWRY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/f2fe0652-8cdf-4287-8c5e-fb6018420ceb%40googlegroups.com.
No abnormalities in overlord and coordinator logs . Attached for your reference.
On Thu, Jul 28, 2016 at 6:57 PM, Benjamin Angelaud <be.an...@gmail.com> wrote:
You should investigate that way, see the overlord logs when it starts maybe ?
--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/FNZeo2vlWRY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+unsubscribe@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
Hi Manish, this is a bug with the Cloudfiles extension and it actually doesn't work with Hadoop indexing.The problem is here if you want to fix it:That needs to return an actual valid directory
I should also add that Cloudfiles is not an officially supported module by the Druid committers.
On Thursday, July 28, 2016 at 6:37:22 AM UTC-7, Manish Deora wrote:
No abnormalities in overlord and coordinator logs . Attached for your reference.
On Thu, Jul 28, 2016 at 6:57 PM, Benjamin Angelaud <be.an...@gmail.com> wrote:
You should investigate that way, see the overlord logs when it starts maybe ?
--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/FNZeo2vlWRY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/f2fe0652-8cdf-4287-8c5e-fb6018420ceb%40googlegroups.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/FNZeo2vlWRY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/f3118edc-6427-4108-b341-fdcccab2be64%40googlegroups.com.
2016-08-02T11:12:17,657 INFO [communication thread] org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce 2016-08-02T11:14:16,498 ERROR [pool-23-thread-1] io.druid.indexer.JobHelper - Exception in retry loop java.lang.NullPointerException at org.apache.hadoop.fs.swift.snative.SwiftNativeOutputStream.flush(SwiftNativeOutputStream.java:102) ~[hadoop-openstack-2.3.0.jar:?] at java.io.FilterOutputStream.flush(FilterOutputStream.java:140) ~[?:1.8.0_73] at java.io.DataOutputStream.flush(DataOutputStream.java:123) ~[?:1.8.0_73] at io.druid.indexer.JobHelper$4.push(JobHelper.java:375) [druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_73] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_73] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_73] at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_73] at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186) [hadoop-common-2.3.0.jar:?] at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) [hadoop-common-2.3.0.jar:?] at com.sun.proxy.$Proxy229.push(Unknown Source) [?:?] at io.druid.indexer.JobHelper.serializeOutIndex(JobHelper.java:386) [druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1] at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:703) [druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1] at io.druid.indexer.IndexGeneratorJob$IndexGeneratorReducer.reduce(IndexGeneratorJob.java:469) [druid-indexing-hadoop-0.9.1.1.jar:0.9.1.1] at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) [hadoop-mapreduce-client-core-2.3.0.jar:?] at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) [hadoop-mapreduce-client-core-2.3.0.jar:?] at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) [hadoop-mapreduce-client-core-2.3.0.jar:?] at org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319) [hadoop-mapreduce-client-common-2.3.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_73] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_73] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_73] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_73] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_73] 2016-08-02T11:14:29,917 INFO [pool-23-thread-1] io.druid.indexer.JobHelper - Creating new ZipEntry[00000.smoosh] 2016-08-02T11:14:30,422 INFO [pool-23-thread-1] io.druid.indexer.JobHelper - Creating new ZipEntry[meta.smoosh] 2016-08-02T11:14:30,431 INFO [pool-23-thread-1] io.druid.indexer.JobHelper - Creating new ZipEntry[version.bin] 2016-08-02T11:14:35,769 INFO [communication thread] org.apache.hadoop.mapred.LocalJobRunner - reduce > reduce