Scribe 2.1 doesn't compile with libhdfs from Hadoop 0.20.1

Tom

unread,

Jan 14, 2010, 8:37:59 PM1/14/10

to Scribe Server

hi,

I'm trying to build scribe 2.1 (the distribution archive from github)
with Hadoop 0.20.1 (distribution archive). However, I get this error:

HdfsFile.cpp:236: error: ‘hdfsConnectNewInstance’ was not declared in
this scope

A quick check in hdfs.h confirms that in Hadoop 0.20.1, there is no
such function (see
http://svn.apache.org/viewvc/hadoop/common/tags/release-0.20.1/src/c%2B%2B/libhdfs/hdfs.h?revision=812594&view=co).
Apparently this function was added after 0.20.1 was released as I see
it in the trunk version of libhdfs (http://svn.apache.org/viewvc/
hadoop/hdfs/trunk/src/c%2B%2B/libhdfs/hdfs.h?view=co).

The question is, should I use trunk of libhdfs, or what version of
libhdfs is safe to use with both Hadoop 0.20.1 and Scribe 2.1 ?

cheers,
Tom

Kevin Weil

unread,

Jan 15, 2010, 3:07:55 AM1/15/10

to Scribe Server

Tom,

You may want to look at the Cloudera (free) RPM for Hadoop 0.20.1 (the
current version is the +152 one). The hdfsConnectNewInstance stuff
was in a patch from Dhruba IIRC, and it's in 0.21. Cloudera
backported this for us and others who were looking to use Scribe with
a pre-0.21 version. I think that's what you need to compile against.

Kevin

On Jan 14, 5:37 pm, Tom <tom...@gmail.com> wrote:
> hi,
>
> I'm trying to build scribe 2.1 (the distribution archive from github)
> with Hadoop 0.20.1 (distribution archive). However, I get this error:
>
> HdfsFile.cpp:236: error: ‘hdfsConnectNewInstance’ was not declared in
> this scope
>
> A quick check in hdfs.h confirms that in Hadoop 0.20.1, there is no

> such function (seehttp://svn.apache.org/viewvc/hadoop/common/tags/release-0.20.1/src/c%...).

Dhruba Borthakur

unread,

Jan 15, 2010, 9:19:52 AM1/15/10

to scribe...@googlegroups.com

Kevin is right. ConnectNewInstance is there in starting hadoop 0.21. If you want it in earlier hadoop release, you would have to either port it to that hadoop version or use the Cloudera release.

thanks,
dhruba

--
Connect to me at http://www.facebook.com/dhruba

Tom

unread,

Jan 18, 2010, 6:09:31 PM1/18/10

to Scribe Server

Thanks, the Cloudera version works fine.

Tom

Chris Trezzo

unread,

Feb 21, 2010, 3:22:22 PM2/21/10

to Scribe Server

Hi all,

I am building Scribe 2.1 with Hadoop Cloudera-dist 0.20.1+152, as per
the same problem covered previously by this thread.

I now receive the following error when trying to build:

libhdfs.so: undefined reference to `__stack_chk_fail@GLIBC_2.4'

Any insight into how I can remedy this is much appreciated.

Thanks in advance.
Chris

On Jan 18, 3:09 pm, Tom <tom...@gmail.com> wrote:
> Thanks, the Cloudera version works fine.
>
> Tom
>
> On Jan 15, 12:07 am, Kevin Weil <kevinw...@gmail.com> wrote:
>
>
>
> > Tom,
>

> > You may want to look at the Cloudera (free) RPM forHadoop0.20.1 (the

> > current version is the +152 one). The hdfsConnectNewInstance stuff
> > was in a patch from Dhruba IIRC, and it's in 0.21. Cloudera
> > backported this for us and others who were looking to useScribewith
> > a pre-0.21 version. I think that's what you need to compile against.
>
> > Kevin
>
> > On Jan 14, 5:37 pm, Tom <tom...@gmail.com> wrote:
>
> > > hi,
>
> > > I'm trying to buildscribe2.1(the distribution archive from github)

> > > withHadoop0.20.1 (distribution archive). However, I get this error:

>
> > > HdfsFile.cpp:236: error: ‘hdfsConnectNewInstance’ was not declared in
> > > this scope
>

> > > A quick check in hdfs.h confirms that inHadoop0.20.1, there is no

Reply all

Reply to author

Forward