Is there a way to query a mediaflux instance for all files in a datastore?

[Scott Wood]

Hey folks,

The filesystem our datastore sits on is missing some of the files that mediflux had its assets in.  As a result, any queries that attempt to query the content/url fail as follows:

asset.query :where namespace >=/the_namespace :action get-value :xpath content/url

arc.mf.client.ServerClient$ExServer: executing asset.query: [arc.mf.server.Services$ExServiceError]: call to service 'asset.query' failed: Store [type=file-system] 3 does not contain item 86417

The file 86417 is missing (we're investigating the why).  We expect it's not the only one, but we are looking for the best avenue to get the full list of missing files from mediaflux, somehow.  Any tips?

Thanks in advance.

Regards,
Scott

[Jason Lohrey]

The following will find all files that are missing:

asset.query :where namespace>=‘/the_namespace’ and content is missing

How did they disappear?

Jason

--
You received this message because you are subscribed to the Google Groups "mediaflux" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mediaflux+...@googlegroups.com.
To post to this group, send email to medi...@googlegroups.com.
Visit this group at http://groups.google.com/group/mediaflux.
For more options, visit https://groups.google.com/d/optout.

JASON LOHREY

Chief Technical Officer

[Jason Lohrey]

Actually a more useful query is:

asset.query :where namespace>=‘/the_namespace’ and content is missing :action get-path

That way you can see which asset (paths) have missing content.

Jason

<Arcitecta.png>

JASON LOHREY

Chief Technical Officer

ARCITECTA

5/26-36 High Street, Northcote

Victoria, Australia 3070

T:+61 3 9029 3437

M:+61 418 364 941

F:+61 3 9005 2876

http://www.arcitecta.com

Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer does not consent to email or messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of Arcitecta shall be understood as neither given nor endorsed by it.

[Wei Liu]

How about

asset.query :where content store 'your_store' and content is missing

Regards,

Wilson

[Scott Wood]

Hey Wei,

I'v been backing and forthing with the good folks at arcitecta outside of this thread and they've been a great help. I had missed that the "content missing" was an asset.query  option, and they suggested it, too.  Thanks to both parties!

We found that if the query asks for ":action get-value :xpath content/url", it chokes on the first failure so you don't get the whole list.  If, however, it asks for :action get-meta, it succeeds, so we're able to get the whole list of missing assets.  Just knowing the item number of the asset is enough to infer its path in the filesystem and move our investigations to that side

We're currently in the process of trying to sort out how/when the assets' content was deleted, and we're think we're getting there.

Scott