Recommended versions of dependencies? ( on CentOS release 5.4 (Final) )

[guti deng]

Hi there,

I'm new to Scribe.

From README at https://github.com/facebook/scribe, i learned that
Scribe requires these:
[libevent] Event Notification library
[boost] Boost C++ library (version 1.36 or later)
[thrift] Thrift framework (version 0.5.0 or later)
[fb303] Facebook Bassline (included in thrift/contrib/fb303/)

I've tried boost 1.36 and 1.46, thrift 0.5.0, 0.6.0 and 0.7, and
Scribe 2.1 and 2.2, and it is really a very disgusting experience...
Fb303 has problem building with thrift 0.6 and higher, so thrift 0.5
is the only choice.
With boost 1.46 and thrift 0.5, when compiling Scribe, things like
` file.cpp:248: error: ‘class boost::filesystem3::directory_entry’
has no member named ‘filename’ ' appears.

From here(http://agiletesting.blogspot.com/2009/10/compiling-
installing-and-test-running.html), i learned that,
` error: ‘class boost::filesystem::basic_directory_entry,
std::allocator >, boost::filesystem::path_traits> >’ has no member
named ‘filename’ The impression I'm coming away with is that the
boost library is very troublesome to compile with---the API seems
completely unstable, changing with even minor revisions. '
This post is out of date but i can't find any recent thread talking
about this problem.



Could anyone successfully built Scribe on CentOS 5.4 provide your
versions of these dependencies?

[Stig Bakken]

Hi guti,

I've successfully built RPMs for rhel5 using these versions:
boost 1.33 (with a tiny patch)
libevent 1.4.13
thrift/fb303 0.4.0

- Stig

[Rexque Futuruss]

The scribe you built, was it able to write to HDFS ?

[guti deng]

Hi Stig,

Thanks! I'll try this combination now!


Guti

On Mar 8, 2:58 am, Stig Bakken <stig.bak...@gmail.com> wrote:
> Hi guti,
>
> I've successfully built RPMs for rhel5 using these versions:
> boost 1.33 (with a tiny patch)
> libevent 1.4.13
> thrift/fb303 0.4.0
>
>  - Stig
>
>
>
>
>
>
>
> On Mon, Mar 7, 2011 at 12:36 PM, guti deng <guti.d...@gmail.com> wrote:
> > Hi there,
>
> > I'm new to Scribe.
>

> > From README athttps://github.com/facebook/scribe, i learned that

[guti deng]

Hi Stig,

Sadly it still doesn't work...

With scribe 2.1, the error is:
scribe_server.h:45: error: conflicting return type specified for
‘virtual scribe::thrift::ResultCode scribeHandler::Log(const
std::vector<scribe::thrift::LogEntry,
std::allocator<scribe::thrift::LogEntry> >&)’
../src/gen-cpp/scribe.h:18: error: overriding ‘virtual
scribe::thrift::ResultCode::type scribe::thrift::scribeIf::Log(const
std::vector<scribe::thrift::LogEntry,
std::allocator<scribe::thrift::LogEntry> >&)’

With facebook-scribe-2ee14d3, the error is:
file.cpp:248: error: ‘class boost::filesystem::path’ has no member
named ‘filename’
Also noticed a warning in configure:
checking for boostlib >= 1.36... configure: Your boost libraries seems
to old (version 1.33_1).

What version is your scribe?

On Mar 8, 2:58 am, Stig Bakken <stig.bak...@gmail.com> wrote:

> Hi guti,
>
> I've successfully built RPMs for rhel5 using these versions:
> boost 1.33 (with a tiny patch)
> libevent 1.4.13
> thrift/fb303 0.4.0
>
>  - Stig
>
>
>
>
>
>
>
> On Mon, Mar 7, 2011 at 12:36 PM, guti deng <guti.d...@gmail.com> wrote:
> > Hi there,
>
> > I'm new to Scribe.
>

> > From README athttps://github.com/facebook/scribe, i learned that

[Bob T. Terminal]

Guti
I have posted the specs I use for creating thrift and scribe rpms for centos 5.4 and 5.5. I included the source for scribe and thrift as well as a necessary patch for thrift to make it compile with the new cpp enums. You will have to go download boost, which you can find here: http://sourceforge.net/projects/boost/files/boost/1.42.0/

Everything else you need I places on github: https://github.com/bterm/sandbox/tree/master/centos/rpm

Requires
default system libevent.x86_64. Currently I have version 1.4.13-1

Rpms created
boost 1.42.0
thrift 0.5.0
fb303 0.5.0
scribe 2.2

Hope this helps
Jake Farrell

[Stig Bakken]

Yes, it was built with libhdfs (using packages from cloudera's cdh3 repo).
I started off with Silas Sewell's source rpms here:
http://www.silassewell.com/blog/2009/05/07/scribe-scalable-real-time-log-aggregation-for-centos-5-rhel-5/
My RPMs are a bit in-house customized, but the spec files are probably
useful to others, so I've attached them.
You might want to fix the hardcoded jni linker path. :)

- Stig

[guti deng]

Bob,

Many thanks, i'll try it!

On Mar 8, 10:38 pm, "Bob T. Terminal" <bob.t.termi...@gmail.com>
wrote:

[guti deng]

Stig,

Hi, I've been busy working around Hbase these days. Now I come back to
scribe again. Additional requirement from my boss that scribe working
with Hadoop arrives just now.

Wish me luck ? :)

On Mar 9, 4:15 am, Stig Bakken <stig.bak...@gmail.com> wrote:
> Yes, it was built with libhdfs (using packages from cloudera's cdh3 repo).

> I started off with Silas Sewell's source rpms here:http://www.silassewell.com/blog/2009/05/07/scribe-scalable-real-time-...

> My RPMs are a bit in-house customized, but the spec files are probably
> useful to others, so I've attached them.
> You might want to fix the hardcoded jni linker path. :)
>
>  - Stig
>
> On Mon, Mar 7, 2011 at 11:59 PM, Rexque Futuruss
>
>
>
>
>
>
>
> <rexque.futur...@gmail.com> wrote:
> > The scribe you built, was it able to write to HDFS ?
>

> > On Mon, Mar 7, 2011 at 10:58 AM, Stig Bakken <stig.bak...@gmail.com> wrote:
>
> >> Hi guti,
>
> >> I've successfully built RPMs for rhel5 using these versions:
> >> boost 1.33 (with a tiny patch)
> >> libevent 1.4.13
> >> thrift/fb303 0.4.0
>
> >>  - Stig
>

> >> On Mon, Mar 7, 2011 at 12:36 PM, guti deng <guti.d...@gmail.com> wrote:
> >> > Hi there,
>
> >> > I'm new to Scribe.
>

> >> > From README athttps://github.com/facebook/scribe, i learned that

> >> > Scribe requires these:
> >> > [libevent] Event Notification library
> >> > [boost] Boost C++ library (version 1.36 or later)
> >> > [thrift] Thrift framework (version 0.5.0 or later)
> >> > [fb303] Facebook Bassline (included in thrift/contrib/fb303/)
>
> >> > I've tried boost 1.36 and 1.46, thrift 0.5.0, 0.6.0 and 0.7, and
> >> > Scribe 2.1 and 2.2, and it is really a very disgusting experience...
> >> > Fb303 has problem building with thrift 0.6 and higher, so thrift 0.5
> >> > is the only choice.
> >> > With boost 1.46 and thrift 0.5, when compiling Scribe, things like
> >> > `  file.cpp:248: error: ‘class boost::filesystem3::directory_entry’
> >> > has no member named ‘filename’  ' appears.
>
> >> > From here(http://agiletesting.blogspot.com/2009/10/compiling-
> >> > installing-and-test-running.html),  i learned that,
> >> > `  error: ‘class boost::filesystem::basic_directory_entry,
> >> > std::allocator >, boost::filesystem::path_traits> >’ has no member
> >> > named ‘filename’     The impression I'm coming away with is that the
> >> > boost library is very troublesome to compile with---the API seems
> >> > completely unstable, changing with even minor revisions. '
> >> > This post is out of date but i can't find any recent thread talking
> >> > about this problem.
>
> >> > Could anyone successfully built Scribe on CentOS 5.4 provide your
> >> > versions of these dependencies?
>
>
>

>  thrift.spec
> 6KViewDownload
>
>  fb303.spec
> 3KViewDownload
>
>  scribe.spec
> 6KViewDownload

[Yorgo Sun]

I've success builded Scribe after I got this problem too. The core
problem is Boost changes it's filesystem module version from v2 to v3.
Before v1.46, it set filesystem2 by default, v1.46 is using
filesystem3 by default. Current Scribe only work with filesystem2. So
make sure you have only one Boost lib in your environment, remove
another like v1.33 install by yum, v1.46 in /usr/local/lib, cause
Scribe's build script will add some default path into gcc's libpath,
maybe you Scribe using wrong Boost lib.

My environment are:
CentOS 5.5
Boost 1.45.0
Thrift 0.5.0
fb303 r1084109
Scribe 2.2

On Mar 7, 7:36 pm, guti deng <guti.d...@gmail.com> wrote:
> Hi there,
>
> I'm new to Scribe.
>

> From README athttps://github.com/facebook/scribe, i learned that

[Yorgo Sun]

I've success builded Scribe after I got this problem too. The core
problem is Boost changes it's filesystem module version from v2 to v3.
Before v1.46, it set filesystem2 by default, v1.46 is using
filesystem3 by default. Current Scribe only work with filesystem2. So
make sure you have only one Boost lib in your environment, remove
another like v1.33 install by yum, v1.46 in /usr/local/lib, cause
Scribe's build script will add some default path into gcc's libpath,
maybe you Scribe using wrong Boost lib.

My environment are:
CentOS 5.5
Boost 1.45.0
Thrift 0.5.0
fb303 r1084109
Scribe 2.2

Yorgo Sun

On Mar 7, 7:36 pm, guti deng <guti.d...@gmail.com> wrote:

> Hi there,
>
> I'm new to Scribe.
>

> From README athttps://github.com/facebook/scribe, i learned that

[Yorgo Sun]

I didn't know why I couldn't post. Try again!

I've success builded Scribe after I got this problem too. The core problem is Boost changes it's filesystem module version from v2 to v3. Before v1.46, it set filesystem2 by default, v1.46 is using filesystem3 by default. Current Scribe only work with filesystem2. So make sure you have only one Boost lib in your environment, remove another like v1.33 install by yum, v1.46 in /usr/local/lib, cause Scribe's build script will add some default path into gcc's libpath, maybe you Scribe using wrong Boost lib.

My environment are:

CentOS 5.5

Boost 1.45.0

Thrift 0.5.0

fb303 r1084109

Scribe 2.2

2011/3/23 guti deng <guti...@gmail.com>

--
孙绍轩 Yorgo Sun