cephBroker

[Dan Mullineux]

After few days fiddling around, and wasting too much time forgetting  about ldconfig (it appears sigar install does not run it)

I've got hypertable building. 

More importantly for my experiment, I've also ported cephBroker to the new libcephfs api, so cephBroker builds against the ceph release binaries 

It was just a matter of...

1. installing the libcef binaries..  apt-get install libcephfs1

2. fixing the cmake/FindCeph.cmake to find cephfs/libcephfs.h

3. woefully hacking cmake/FindCeph.cmake to find the systems own openSSL - 

find_library(SSL_LIB NAMES ssl

             PATHS /usr/lib/x86_64-linux-gnu )

(sorry)

4. grabbing the new cephBroker from the ceph codebase.

5. Adding the couple of (unused in ceph) verify_checksum bools to open and pread

6. removing ceph_version from main.cc as it has been dropped in the new ceph api.

I have yet to test it out, but it builds :)

I can put this in a pull request if any maintainers like, I think only the openSSL hackery needs some elegance applied.

I'll be trying this out in the next few days

Cheers.

[Doug Judd]

Hi Dan,

If you're willing to contribute this, we would gladly accept it!  I'll contact you about it off-list.

- Doug

--
You received this message because you are subscribed to the Google Groups "Hypertable Development" group.
To view this discussion on the web visit https://groups.google.com/d/msg/hypertable-dev/-/7Qh7fnsBg4sJ.
To post to this group, send email to hyperta...@googlegroups.com.
To unsubscribe from this group, send email to hypertable-de...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/hypertable-dev?hl=en.

--

Doug Judd

CEO, Hypertable Inc.

[Dan Mullineux]

Yeh, no problem.

There were a couple of other things to tweak as well, some expected preferences and the cephBroker in ceph's own repo tries to set "mon_addr" but a dig through ceph code shows it should be mon_host.

I am worried about my ability to get this reliable enough to consider using in production, problems take longer to track down than makes me feel comfortable. This is obviously mainly to do with my own expertise and familiarity, but I think compounded by the current admin documentation, community etc. Anyway, thats just my frustration.

A sample of the kinds of issue I'm having and struggling to deal with..

The start-all-servers does not bring up the master reliably, starting each server independently does more often.

When it did start and I could make tables and import a couple of rows, I was getting the master logs spinning out of control (range exception or summink)  when I was doing nothing, and this was all just with the local file broker.

Some examples of the kind of info that has to be found from fragmented sources: Config file, loglevels, and other command line options.

I'm going to push forwards and get ceph working though because I still think hypertable is amazing, you have done a great job.

Cheers. 

On Saturday, 14 July 2012 00:34:25 UTC+1, Doug Judd wrote:

Hi Dan,

If you're willing to contribute this, we would gladly accept it!  I'll contact you about it off-list.

- Doug

On Fri, Jul 13, 2012 at 4:04 AM, Dan Mullineux  wrote:

After few days fiddling around, and wasting too much time forgetting  about ldconfig (it appears sigar install does not run it)

I've got hypertable building. 

More importantly for my experiment, I've also ported cephBroker to the new libcephfs api, so cephBroker builds against the ceph release binaries 

It was just a matter of...

1. installing the libcef binaries..  apt-get install libcephfs1

2. fixing the cmake/FindCeph.cmake to find cephfs/libcephfs.h

3. woefully hacking cmake/FindCeph.cmake to find the systems own openSSL - 

find_library(SSL_LIB NAMES ssl

             PATHS /usr/lib/x86_64-linux-gnu )

(sorry)

4. grabbing the new cephBroker from the ceph codebase.

5. Adding the couple of (unused in ceph) verify_checksum bools to open and pread

6. removing ceph_version from main.cc as it has been dropped in the new ceph api.

I have yet to test it out, but it builds :)

I can put this in a pull request if any maintainers like, I think only the openSSL hackery needs some elegance applied.

I'll be trying this out in the next few days

Cheers.

--