Has anyone solved the Cygwin problem HADOOP-7682 for Cascalog execution?

104 views
Skip to first unread message

Jack Fox

unread,
Apr 21, 2013, 12:46:42 PM4/21/13
to cascal...@googlegroups.com
https://issues.apache.org/jira/browse/HADOOP-7682 

My immediate problem (and possibly the last one in the way of stand-alone Cascalog execution) is with my Windows path E:\tmp. I have tried configuring hadoop-env.sh a couple of different ways. Neither works. (I have Hadoop 1.1.2 running.)

#export TMP=E:/tmp
#export TEMP=E:/tmp
#export HADOOP_TMP_DIR=E:/tmp

export TMP=/cygdrive/e/tmp
export TEMP=/cygdrive/e/tmp
export HADOOP_TMP_DIR=/cygdrive/e/tmp

One poster on the issues.apache thread suggests "The only fix seems to be to downgrade to 0.20.2".


FKorning added a comment - 23/Mar/12 14:59 

This "yak-shaving" solution is long and complex for a novice to Java/Cygwin/Hadoop.


Joshua Caplan added a comment - 23/Aug/12 09:17 

This solution appears simpler for someone like myself who only wants a local solution for education, not production purposes, and was made available as this patch, which I have installed, but I suspect this may only properly work with Java 1.7. I have downgraded to 1.6 to get Cascalog working.

Nilesh

unread,
Jun 21, 2013, 9:39:09 AM6/21/13
to cascal...@googlegroups.com
Hi Jack 

I m facing the same prblem i m using hadoop 1.1.2,JDK 7,win xp and cygwin
I have created eclipse pulgin from hadoop 1.1.2, but when im running any job i m getting same permission excpetion. i have already applied the patch-hadoop_7682-1.1.2-win.jar as suggested at github but still getting same permission excpetion. Can some one please help me on this.

Regards
Nilesh

Jack Fox

unread,
Jun 21, 2013, 11:03:07 AM6/21/13
to cascal...@googlegroups.com

Nilesh,

 

From what I have learned JDK 7 is a non-starter. You need to be using JDK 6. I was able to get Cascalog working enough to work through the tutorials, and documented how on my blog http://jackfoxy.com/cascalog-on-windows8

 

There are likely a couple of inaccuracies in my article, but generally you should get the tutorials working.

 

Having said that, I’ve also learned Cygwin is a total non-starter for Hadoop. So beyond very simple tutorial stuff, you will need to a real Linux distro, maybe on a VM. I haven’t gotten there yet.

 

Jack

--
You received this message because you are subscribed to a topic in the Google Groups "cascalog-user" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cascalog-user/CpjBFuPBH98/unsubscribe.
To unsubscribe from this group and all its topics, send an email to cascalog-use...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Mason

unread,
Jun 21, 2013, 7:16:35 PM6/21/13
to cascal...@googlegroups.com
If you take the VM approach, you could use this Vagrant box I made for Hadoop development: https://github.com/Verba/wandering-elephant. It installs Leiningen by default.
You received this message because you are subscribed to the Google Groups "cascalog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascalog-use...@googlegroups.com.

Jack Fox

unread,
Jun 21, 2013, 8:32:27 PM6/21/13
to cascal...@googlegroups.com

Thanks, Mason!

Nilesh Pandey

unread,
Jun 24, 2013, 6:18:15 AM6/24/13
to cascal...@googlegroups.com
thanks will check this
Reply all
Reply to author
Forward
0 new messages