[Virgil] Mapreduce by Ruby script

37 views
Skip to first unread message

Hieu Nguyen Trong

unread,
Dec 15, 2011, 5:03:25 AM12/15/11
to virgil-users
Hi guys,

I've try using virgil with external cassandra and mapreduce wordcount
in Ruby in the wiki page and always get this error. Is this feature
working ?

org.jruby.embed.ParseFailedException: (SyntaxError) <script>:1:
hunknown regexp options - h
at
org.jruby.embed.internal.EmbedRubyRuntimeAdapterImpl.runParser(EmbedRubyRuntimeAdapterImpl.java:
207)
at
org.jruby.embed.internal.EmbedRubyRuntimeAdapterImpl.parse(EmbedRubyRuntimeAdapterImpl.java:
93)
at
org.jruby.embed.ScriptingContainer.parse(ScriptingContainer.java:1163)
at
org.jruby.embed.ScriptingContainer.runScriptlet(ScriptingContainer.java:
1223)
at org.apache.cassandra.http.mapreduce.CassandraMapReduce
$CassandraMapper.setup(CassandraMapReduce.java:115)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:
621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.LocalJobRunner
$Job.run(LocalJobRunner.java:177)
Caused by: org.jruby.exceptions.RaiseException: (SyntaxError) <script>:
1: hunknown regexp options - h

Thanks for any help.
Regards,
Hieu

Brian O'Neill

unread,
Dec 15, 2011, 6:06:23 AM12/15/11
to virgil...@googlegroups.com
Hieu,

It should be working.  It looks like it is having trouble compiling the ruby file you are posting. 
Maybe the contents of the ruby file are not correct, or the POST command isn't sending them properly.

What platform are you on? And how are you posting the file? 
(linux/curl?)

-brian
--
Brian ONeill
Lead Architect, Health Market Science (http://healthmarketscience.com)
mobile:215.588.6024
blog: http://weblogs.java.net/blog/boneill42/
blog: http://brianoneill.blogspot.com/

Hieu Nguyen Trong

unread,
Dec 15, 2011, 9:25:05 PM12/15/11
to virgil-users
Hi Brian,

I use exactly the wordcount.rb in the @virgil-read-only/src/test/
resources. My virgil and cassandra run in Redhat Enterprise Linux 5. I
also use curl to POST command as the example in wiki page but I forgot
the '@' character before the file name. Now it's working.

Thanks you,
Hieu

On Dec 15, 6:06 pm, "Brian O'Neill" <b...@alumni.brown.edu> wrote:
> Hieu,
>
> It should be working.  It looks like it is having trouble compiling the
> ruby file you are posting.
> Maybe the contents of the ruby file are not correct, or the POST command
> isn't sending them properly.
>
> What platform are you on? And how are you posting the file?
> (linux/curl?)
>
> -brian
>

Brian O'Neill

unread,
Dec 15, 2011, 10:33:10 PM12/15/11
to virgil...@googlegroups.com
Great to hear.  Let us know if you have any other issues.

By next week, we should have the ability to deploy the job to a remote Hadoop cluster.
Stay tuned.

-brian
Reply all
Reply to author
Forward
0 new messages