blob server protocol and spec

86 views
Skip to first unread message

Nick Gerakines

unread,
Mar 1, 2013, 12:51:28 PM3/1/13
to camli...@googlegroups.com
Hi everyone,

I started a c++ reference implementation of some of the camlistore services and have some questions on the protocol and expected features.

The project code is all on GitHub, licensed under the MIT:

    https://github.com/ngerakines/camlispp


I'm comfortable with both perl, go and python, but am having a hard time find a solid feature list for the blob service. Other than the blob related docs folder within the main repo, is there anything that describes the expected features of a blob storage daemon? I ask this with the end-goal of being able to have the go/python impl connect with and sync to the c++ one without any issues or hiccups.

# Nick Gerakines

Brad Fitzpatrick

unread,
Mar 3, 2013, 9:27:05 PM3/3/13
to camli...@googlegroups.com
There's also the doc/protocol directory. It should be accurate.

You can test that it all works with the bs-test.pl script (maybe out of date?) or more accurately: with camget, camput, and "camtool sync" to sync between blobservers.

Any particular motivation for a C++ server? I see few advantages over the Go version.



# Nick Gerakines

--
You received this message because you are subscribed to the Google Groups "Camlistore" group.
To unsubscribe from this group and stop receiving emails from it, send an email to camlistore+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

Nick Gerakines

unread,
Mar 4, 2013, 12:46:59 AM3/4/13
to camli...@googlegroups.com, br...@danga.com
Good to know, thanks.

I like Go and I'm pretty comfortable with it, but at work we primarily use c++ and java (generally speaking).

Brad Fitzpatrick

unread,
Mar 4, 2013, 12:48:16 AM3/4/13
to camli...@googlegroups.com
Yeah, but I use tools all the time written in languages my employer doesn't typically use, but I don't typically rewrite them.  Hence my curiosity about your motivation.  Just for fun, or ... ?

Nick Gerakines

unread,
Mar 4, 2013, 12:55:32 AM3/4/13
to camli...@googlegroups.com, br...@danga.com
This is a research project for me to prototype a CAS service spec and see how it can be applied to what I do at work. Battle.net deals with gobs and gobs of data of different types and from many difference sources and we are always looking for better ways to improve how we work with that data.

Brad Fitzpatrick

unread,
Mar 4, 2013, 12:59:28 AM3/4/13
to camli...@googlegroups.com
Gotcha. The blob server should be the easiest part. Do you intend to reimplement all the indexing and search stuff too?

Nick Gerakines

unread,
Mar 4, 2013, 1:01:47 AM3/4/13
to camli...@googlegroups.com, br...@danga.com
Yeah, that is the plan. I'm also thinking about doing some sort of view transform to retrieve blobs with different compression types or create torrent definitions on-the-fly.
Reply all
Reply to author
Forward
0 new messages