Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework

688 views
Skip to first unread message

karteek chada

unread,
Aug 25, 2016, 1:38:36 PM8/25/16
to Druid User
Hi Druid Gurus,

Our druid ( version 0.8.0) setup was running fine until we upgraded our Hadoop environment to  version 2.6.0. When i tried to index data it fails due to error

Caused by: java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path


is this a druid error? any suggestions on how to resolve this? Please let me know


Regards

Karteek




Jonathan Wei

unread,
Aug 25, 2016, 5:10:34 PM8/25/16
to druid...@googlegroups.com
Hi Karteek,

Is that setting from the mapred-site.xml that was copied to Druid's configuration path? 

If so, can you try replacing ${hdp.version} with what it would resolve to for your version of HDP, e.g.:

/hdp/apps/2.4.0.0-169/mapreduce/mapreduce.tar.gz#mr-framework

Thanks,
Jon

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/e40bcdb9-c096-4874-8ddd-e3d086fddc01%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

karteek chada

unread,
Aug 27, 2016, 2:07:26 PM8/27/16
to Druid User
Thank You Jonathan. That worked. i had to make another copy  that xml  with the changes suggested and point my hadoop conf dir to that path and it worked

karteek

--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/iw2YuIN6GQE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+unsubscribe@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--
Karteek Chada

Nishant Bangarwa

unread,
Aug 29, 2016, 3:39:51 AM8/29/16
to Druid User
Alternatively, you can add -Dhdp.version=<your-hdp-version> to druid.indexer.runner.javaOpts in runtime.properties for middlemanager.

On Sat, 27 Aug 2016 at 23:37 karteek chada <kart...@gmail.com> wrote:
Thank You Jonathan. That worked. i had to make another copy  that xml  with the changes suggested and point my hadoop conf dir to that path and it worked

karteek

On Thu, Aug 25, 2016 at 2:10 PM, Jonathan Wei <jon...@imply.io> wrote:
Hi Karteek,

Is that setting from the mapred-site.xml that was copied to Druid's configuration path? 

If so, can you try replacing ${hdp.version} with what it would resolve to for your version of HDP, e.g.:

/hdp/apps/2.4.0.0-169/mapreduce/mapreduce.tar.gz#mr-framework

Thanks,
Jon
On Thu, Aug 25, 2016 at 10:38 AM, karteek chada <kart...@gmail.com> wrote:
Hi Druid Gurus,

Our druid ( version 0.8.0) setup was running fine until we upgraded our Hadoop environment to  version 2.6.0. When i tried to index data it fails due to error

Caused by: java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path


is this a druid error? any suggestions on how to resolve this? Please let me know


Regards

Karteek




--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/e40bcdb9-c096-4874-8ddd-e3d086fddc01%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/iw2YuIN6GQE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.



--
Karteek Chada

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

karteek chada

unread,
Aug 30, 2016, 4:40:33 PM8/30/16
to Druid User
Thank You Nishant. Will try and let you know about it.

karteek

On Mon, Aug 29, 2016 at 12:39 AM, Nishant Bangarwa <nishant...@gmail.com> wrote:
Alternatively, you can add -Dhdp.version=<your-hdp-version> to druid.indexer.runner.javaOpts in runtime.properties for middlemanager.

On Sat, 27 Aug 2016 at 23:37 karteek chada <kart...@gmail.com> wrote:
Thank You Jonathan. That worked. i had to make another copy  that xml  with the changes suggested and point my hadoop conf dir to that path and it worked

karteek

On Thu, Aug 25, 2016 at 2:10 PM, Jonathan Wei <jon...@imply.io> wrote:
Hi Karteek,

Is that setting from the mapred-site.xml that was copied to Druid's configuration path? 

If so, can you try replacing ${hdp.version} with what it would resolve to for your version of HDP, e.g.:

/hdp/apps/2.4.0.0-169/mapreduce/mapreduce.tar.gz#mr-framework

Thanks,
Jon
On Thu, Aug 25, 2016 at 10:38 AM, karteek chada <kart...@gmail.com> wrote:
Hi Druid Gurus,

Our druid ( version 0.8.0) setup was running fine until we upgraded our Hadoop environment to  version 2.6.0. When i tried to index data it fails due to error

Caused by: java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path


is this a druid error? any suggestions on how to resolve this? Please let me know


Regards

Karteek




--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/e40bcdb9-c096-4874-8ddd-e3d086fddc01%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/iw2YuIN6GQE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+unsubscribe@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.



--
Karteek Chada

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/iw2YuIN6GQE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+unsubscribe@googlegroups.com.

To post to this group, send email to druid...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--
Karteek Chada
Reply all
Reply to author
Forward
0 new messages