Testing with live data

Skip to first unread message

Attila Tajti

Jan 23, 2018, 2:56:39 AM1/23/18
to Camlistore
Is there a way to set up camlistored/devcam server so that it uses an existing perkeep instance as the source?

I would like to be able to do usability tests of my patches (eg. the geotagging CL) that need extra bits of data (permanodes, claims and files)
on top of real data (my own perkeep server), ideally without actually modifying the underlying source.

What would be the best way to do it? The new "union" storage seems close, only one can't delete blobs (or rather mark them deleted if they exist in the source).

Mathieu Lonjaret

Jan 23, 2018, 9:28:55 AM1/23/18
to camli...@googlegroups.com
That's a good question indeed. I usually just backup
$HOME/var/camlistore when it's a bunch of data that I need to work on
a CL and that is too long to recreate, so i can use it as a source
again whenever I need to. But yeah that does involve camtool sync or
rsync over the source, which is what you want to avoid.

I haven't tested union, but it does seem to be what you want. So if
removing blobs is what's missing for you, wouldn't it be easy enough
to just add the implementation for it?
> --
> You received this message because you are subscribed to the Google Groups
> "Camlistore" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to camlistore+...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

Attila Tajti

Jan 23, 2018, 10:52:12 AM1/23/18
to Camlistore
I will add the implementation for it. It's mostly done, and yes, it seemed easy. I just need to write the tests.

In case anyone has a suggestion for the name, I would be glad to hear it.

In my first iteration I went for the name "view", and with the following handlerArgs fields (all required):

"source": underlying (read-only) source handler
"delta": storage for changes
"deleted": sorted.KeyValue spec to store deletes
Reply all
Reply to author
0 new messages